Data Enginnering, Data Pipeline, Etl, Workflow Management, Airflow.
impact on other workflows. Different teams or developers can work on different data layers and their own set of data pipelines independently once the agreement on signalling mechanism is established. Cons Retry and reprocessing of upstream pipeline runs which had completed successfully once before,