Data Enginnering, Data Pipeline, Etl, Workflow Management, Airflow.
downstream pipeline should ideally also be running hourly. Due to increased coupling between data pipelines on different layer, working independently on each data layer might become a challenge. This pattern can get more complicated when multiple downstream layers and integration pipelines are