Don't put data science notebooks into production

We've come across many clients who are interested in taking the computational notebooks developed by their data scientists, and putting them directly into the codebase of production applications. My colleague David Johnston points out that while data science ideas do need to move out of notebooks and into production, trying to deploy that notebooks as a code artifact breaks a multitude of good software practices. Predictably, that results in a number of observed pain points. This behavior is a symptom of a deeper problem: a lack of collaboration between data scientists and software developers. more… https://martinfowler.com/articles/productize-data-sci-notebooks.html

Created 4y | Nov 18, 2020, 4:21:50 PM


Login to add comment

Other posts in this group

How is GenAI different from other code generators?

How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou

Oct 18, 2023, 8:10:05 PM | Martin Fowler
How is GenAI different from other code generators?

How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou

Sep 19, 2023, 10:10:06 AM | Martin Fowler
TDD with GitHub Copilot

At Thoughtworks, we are strong practitioners of Test Driven Development (TDD). Naturally this leads to the question of how generative AI can

Aug 17, 2023, 8:30:07 PM | Martin Fowler