Airflow, Data Pipeline, Data, Workflow, Data Engineering.
parallelism configuration of airflow is blocking new task scheduling DAG level max_active_tasks This defines the maximum number of task instances allowed to run across all active DAG run for the specific DAG. If not set it will fallback to MAX_ACTIVE_TASK_PER_DAG. Earlier versions of airflow used