Data Enginnering, Data Pipeline, Etl, Workflow Management, Airflow.
loops might be required to determine whether the downstream jobs have started or not. Similar to previous technique, using this technique would probably require the downstream pipelines to be running on the same time interval. For instance if the parent pipeline is running on hourly basis, then the