Data Engineering, Databricks, Snowflake, Data Science, Machine Learning.
it even more difficult to tune or optimize a particular job. Change is scary — There’s an innate fear to change. If a production job is flowing, do we want to risk tweaking it? The old adage comes to mind: “if it ain’t broke, don’t fix it.” Oftentimes this fear is real, if a job is not idempotent