Data Science, Machine Learning, Jupyter Notebook, Open Source, Software Development.
Monitoring data quality Suppose you have a notebook that ingests data every week. You can use snapshot testing to measure the quality of the ingested data and throw an error if it suddenly degrades. For example, you might have a cell that prints the percentage of NAs in a column named age: