Data Enginnering, Data Pipeline, Etl, Workflow Management, Airflow.
previous technique, for newly added downstream consumers, the upstream pipeline has to be modified to trigger the new pipeline after its completion. Changes to the downstream pipelines, such as changing the pipeline name might affect upstream pipeline as it has to updated accordingly. Feedback