<h3 dir="auto">Apache Airflow version</h3>
<p dir="auto">2.3.2 (latest released)</p>
<h3 dir="auto">What happened</h3>
<p dir="auto">The scheduler crashes with the following exception. Once the scheduler crashes restarts will cause it to immediately crash again. To get scheduler back working. All dags must be paused and all tasks that are running need to have it's state changed to up for retry. This is something we just started noticing after switching to the CeleryKubernetesExecutor.</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="[2022-06-16 20:12:04,535] {scheduler_job.py:1350} WARNING - Failing (3) jobs without heartbeat after 2022-06-16 20:07:04.512590+00:00
[2022-06-16 20:12:04,535] {scheduler_job.py:1358} ERROR - Detected zombie job: {'full_filepath': '/airflow-efs/dags/Scanner.py', 'msg': 'Detected &lt;TaskInstance: lmnop-domain-scanner.Macadocious manual__2022-06-16T02:27:36.281445+00:00 [running]&gt; as zombie', 'simple_task_instance': &lt;airflow.models.taskinstance.SimpleTaskInstance object at 0x7f96de2fc890&gt;, 'is_failure_callback': True}
[2022-06-16 20:12:04,537] {scheduler_job.py:756} ERROR - Exception when executing SchedulerJob._run_scheduler_loop
Traceback (most recent call last):
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 739, in _execute
    self._run_scheduler_loop()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 839, in _run_scheduler_loop
    next_event = timers.run(blocking=False)
  File &quot;/usr/local/lib/python3.7/sched.py&quot;, line 151, in run
    action(*argument, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/event_scheduler.py&quot;, line 36, in repeat
    action(*args, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 1359, in _find_zombies
    self.executor.send_callback(request)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/executors/celery_kubernetes_executor.py&quot;, line 218, in send_callback
    self.callback_sink.send(request)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/callbacks/database_callback_sink.py&quot;, line 34, in send
    db_callback = DbCallbackRequest(callback=callback, priority_weight=10)
  File &quot;&lt;string&gt;&quot;, line 4, in __init__
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py&quot;, line 437, in _initialize_instance
    manager.dispatch.init_failure(self, args, kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/util/langhelpers.py&quot;, line 72, in __exit__
    with_traceback=exc_tb,
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/util/compat.py&quot;, line 211, in raise_
    raise exception
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py&quot;, line 434, in _initialize_instance
    return manager.original_init(*mixed[1:], **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/models/db_callback_request.py&quot;, line 44, in __init__
    self.callback_data = callback.to_json()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/callbacks/callback_requests.py&quot;, line 79, in to_json
    return json.dumps(dict_obj)
  File &quot;/usr/local/lib/python3.7/json/__init__.py&quot;, line 231, in dumps
    return _default_encoder.encode(obj)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 257, in iterencode
    return _iterencode(o, 0)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type datetime is not JSON serializable
[2022-06-16 20:12:04,573] {kubernetes_executor.py:813} INFO - Shutting down Kubernetes executor
[2022-06-16 20:12:04,574] {kubernetes_executor.py:773} WARNING - Executor shutting down, will NOT run task=(TaskInstanceKey(dag_id='lmnop-processor', task_id='launch-xyz-pod', run_id='manual__2022-06-16T19:53:04.707461+00:00', try_number=1, map_index=-1), ['airflow', 'tasks', 'run', 'lmnop-processor', 'launch-xyz-pod', 'manual__2022-06-16T19:53:04.707461+00:00', '--local', '--subdir', 'DAGS_FOLDER/lmnop.py'], None, None)
[2022-06-16 20:12:04,574] {kubernetes_executor.py:773} WARNING - Executor shutting down, will NOT run task=(TaskInstanceKey(dag_id='lmnop-processor', task_id='launch-xyz-pod', run_id='manual__2022-06-16T19:53:04.831929+00:00', try_number=1, map_index=-1), ['airflow', 'tasks', 'run', 'lmnop-processor', 'launch-xyz-pod', 'manual__2022-06-16T19:53:04.831929+00:00', '--local', '--subdir', 'DAGS_FOLDER/lmnop.py'], None, None)
[2022-06-16 20:12:04,601] {scheduler_job.py:768} INFO - Exited execute loop
Traceback (most recent call last):
  File &quot;/pyroot/bin/airflow&quot;, line 8, in &lt;module&gt;
    sys.exit(main())
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/__main__.py&quot;, line 38, in main
    args.func(args)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/cli/cli_parser.py&quot;, line 51, in command
    return func(*args, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/cli.py&quot;, line 99, in wrapper
    return f(*args, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/cli/commands/scheduler_command.py&quot;, line 75, in scheduler
    _run_scheduler_job(args=args)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/cli/commands/scheduler_command.py&quot;, line 46, in _run_scheduler_job
    job.run()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/base_job.py&quot;, line 244, in run
    self._execute()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 739, in _execute
    self._run_scheduler_loop()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 839, in _run_scheduler_loop
    next_event = timers.run(blocking=False)
  File &quot;/usr/local/lib/python3.7/sched.py&quot;, line 151, in run
    action(*argument, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/event_scheduler.py&quot;, line 36, in repeat
    action(*args, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py&quot;, line 1359, in _find_zombies
    self.executor.send_callback(request)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/executors/celery_kubernetes_executor.py&quot;, line 218, in send_callback
    self.callback_sink.send(request)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/callbacks/database_callback_sink.py&quot;, line 34, in send
    db_callback = DbCallbackRequest(callback=callback, priority_weight=10)
  File &quot;&lt;string&gt;&quot;, line 4, in __init__
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py&quot;, line 437, in _initialize_instance
    manager.dispatch.init_failure(self, args, kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/util/langhelpers.py&quot;, line 72, in __exit__
    with_traceback=exc_tb,
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/util/compat.py&quot;, line 211, in raise_
    raise exception
  File &quot;/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py&quot;, line 434, in _initialize_instance
    return manager.original_init(*mixed[1:], **kwargs)
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/models/db_callback_request.py&quot;, line 44, in __init__
    self.callback_data = callback.to_json()
  File &quot;/pyroot/lib/python3.7/site-packages/airflow/callbacks/callback_requests.py&quot;, line 79, in to_json
    return json.dumps(dict_obj)
  File &quot;/usr/local/lib/python3.7/json/__init__.py&quot;, line 231, in dumps
    return _default_encoder.encode(obj)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 257, in iterencode
    return _iterencode(o, 0)
  File &quot;/usr/local/lib/python3.7/json/encoder.py&quot;, line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type datetime is not JSON serializable"><pre class="notranslate"><code class="notranslate">[2022-06-16 20:12:04,535] {scheduler_job.py:1350} WARNING - Failing (3) jobs without heartbeat after 2022-06-16 20:07:04.512590+00:00
[2022-06-16 20:12:04,535] {scheduler_job.py:1358} ERROR - Detected zombie job: {'full_filepath': '/airflow-efs/dags/Scanner.py', 'msg': 'Detected &lt;TaskInstance: lmnop-domain-scanner.Macadocious manual__2022-06-16T02:27:36.281445+00:00 [running]&gt; as zombie', 'simple_task_instance': &lt;airflow.models.taskinstance.SimpleTaskInstance object at 0x7f96de2fc890&gt;, 'is_failure_callback': True}
[2022-06-16 20:12:04,537] {scheduler_job.py:756} ERROR - Exception when executing SchedulerJob._run_scheduler_loop
Traceback (most recent call last):
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 739, in _execute
    self._run_scheduler_loop()
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 839, in _run_scheduler_loop
    next_event = timers.run(blocking=False)
  File "/usr/local/lib/python3.7/sched.py", line 151, in run
    action(*argument, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/event_scheduler.py", line 36, in repeat
    action(*args, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/session.py", line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 1359, in _find_zombies
    self.executor.send_callback(request)
  File "/pyroot/lib/python3.7/site-packages/airflow/executors/celery_kubernetes_executor.py", line 218, in send_callback
    self.callback_sink.send(request)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/session.py", line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/callbacks/database_callback_sink.py", line 34, in send
    db_callback = DbCallbackRequest(callback=callback, priority_weight=10)
  File "&lt;string&gt;", line 4, in __init__
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py", line 437, in _initialize_instance
    manager.dispatch.init_failure(self, args, kwargs)
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/util/langhelpers.py", line 72, in __exit__
    with_traceback=exc_tb,
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py", line 434, in _initialize_instance
    return manager.original_init(*mixed[1:], **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/models/db_callback_request.py", line 44, in __init__
    self.callback_data = callback.to_json()
  File "/pyroot/lib/python3.7/site-packages/airflow/callbacks/callback_requests.py", line 79, in to_json
    return json.dumps(dict_obj)
  File "/usr/local/lib/python3.7/json/__init__.py", line 231, in dumps
    return _default_encoder.encode(obj)
  File "/usr/local/lib/python3.7/json/encoder.py", line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File "/usr/local/lib/python3.7/json/encoder.py", line 257, in iterencode
    return _iterencode(o, 0)
  File "/usr/local/lib/python3.7/json/encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type datetime is not JSON serializable
[2022-06-16 20:12:04,573] {kubernetes_executor.py:813} INFO - Shutting down Kubernetes executor
[2022-06-16 20:12:04,574] {kubernetes_executor.py:773} WARNING - Executor shutting down, will NOT run task=(TaskInstanceKey(dag_id='lmnop-processor', task_id='launch-xyz-pod', run_id='manual__2022-06-16T19:53:04.707461+00:00', try_number=1, map_index=-1), ['airflow', 'tasks', 'run', 'lmnop-processor', 'launch-xyz-pod', 'manual__2022-06-16T19:53:04.707461+00:00', '--local', '--subdir', 'DAGS_FOLDER/lmnop.py'], None, None)
[2022-06-16 20:12:04,574] {kubernetes_executor.py:773} WARNING - Executor shutting down, will NOT run task=(TaskInstanceKey(dag_id='lmnop-processor', task_id='launch-xyz-pod', run_id='manual__2022-06-16T19:53:04.831929+00:00', try_number=1, map_index=-1), ['airflow', 'tasks', 'run', 'lmnop-processor', 'launch-xyz-pod', 'manual__2022-06-16T19:53:04.831929+00:00', '--local', '--subdir', 'DAGS_FOLDER/lmnop.py'], None, None)
[2022-06-16 20:12:04,601] {scheduler_job.py:768} INFO - Exited execute loop
Traceback (most recent call last):
  File "/pyroot/bin/airflow", line 8, in &lt;module&gt;
    sys.exit(main())
  File "/pyroot/lib/python3.7/site-packages/airflow/__main__.py", line 38, in main
    args.func(args)
  File "/pyroot/lib/python3.7/site-packages/airflow/cli/cli_parser.py", line 51, in command
    return func(*args, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/cli.py", line 99, in wrapper
    return f(*args, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/cli/commands/scheduler_command.py", line 75, in scheduler
    _run_scheduler_job(args=args)
  File "/pyroot/lib/python3.7/site-packages/airflow/cli/commands/scheduler_command.py", line 46, in _run_scheduler_job
    job.run()
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/base_job.py", line 244, in run
    self._execute()
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 739, in _execute
    self._run_scheduler_loop()
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 839, in _run_scheduler_loop
    next_event = timers.run(blocking=False)
  File "/usr/local/lib/python3.7/sched.py", line 151, in run
    action(*argument, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/event_scheduler.py", line 36, in repeat
    action(*args, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/session.py", line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py", line 1359, in _find_zombies
    self.executor.send_callback(request)
  File "/pyroot/lib/python3.7/site-packages/airflow/executors/celery_kubernetes_executor.py", line 218, in send_callback
    self.callback_sink.send(request)
  File "/pyroot/lib/python3.7/site-packages/airflow/utils/session.py", line 71, in wrapper
    return func(*args, session=session, **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/callbacks/database_callback_sink.py", line 34, in send
    db_callback = DbCallbackRequest(callback=callback, priority_weight=10)
  File "&lt;string&gt;", line 4, in __init__
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py", line 437, in _initialize_instance
    manager.dispatch.init_failure(self, args, kwargs)
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/util/langhelpers.py", line 72, in __exit__
    with_traceback=exc_tb,
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
    raise exception
  File "/pyroot/lib/python3.7/site-packages/sqlalchemy/orm/state.py", line 434, in _initialize_instance
    return manager.original_init(*mixed[1:], **kwargs)
  File "/pyroot/lib/python3.7/site-packages/airflow/models/db_callback_request.py", line 44, in __init__
    self.callback_data = callback.to_json()
  File "/pyroot/lib/python3.7/site-packages/airflow/callbacks/callback_requests.py", line 79, in to_json
    return json.dumps(dict_obj)
  File "/usr/local/lib/python3.7/json/__init__.py", line 231, in dumps
    return _default_encoder.encode(obj)
  File "/usr/local/lib/python3.7/json/encoder.py", line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File "/usr/local/lib/python3.7/json/encoder.py", line 257, in iterencode
    return _iterencode(o, 0)
  File "/usr/local/lib/python3.7/json/encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type datetime is not JSON serializable
</code></pre></div>
<h3 dir="auto">What you think should happen instead</h3>
<p dir="auto">The error itself seems like a minor issue and should not happen and easy to fix. But what seems like a bigger issue is how the scheduler was not able to recover on it's own and was stuck in an endless restart loop.</p>
<h3 dir="auto">How to reproduce</h3>
<p dir="auto">I'm not sure of the most simple step by step way to reproduce. But the conditions of my airflow workflow was about 4 active dags chugging through with about 50 max active runs and 50 concurrent each, with one dag set with 150 max active runs and 50 concurrent. ( not really that much )</p>
<p dir="auto">The dag with the 150 max active runs is running the kubernetesExecutor create a pod in the local kubernetes environment. this I think is the reason we're seeing this issue all of a sudden.</p>
<p dir="auto">Hopefully this helps in potentially reproducing it.</p>
<h3 dir="auto">Operating System</h3>
<p dir="auto">Debian GNU/Linux 10 (buster)</p>
<h3 dir="auto">Versions of Apache Airflow Providers</h3>
<p dir="auto">apache-airflow-providers-amazon==3.4.0<br>
apache-airflow-providers-celery==2.1.4<br>
apache-airflow-providers-cncf-kubernetes==4.0.2<br>
apache-airflow-providers-ftp==2.1.2<br>
apache-airflow-providers-http==2.1.2<br>
apache-airflow-providers-imap==2.2.3<br>
apache-airflow-providers-postgres==4.1.0<br>
apache-airflow-providers-redis==2.0.4<br>
apache-airflow-providers-sqlite==2.1.3</p>
<h3 dir="auto">Deployment</h3>
<p dir="auto">Other Docker-based deployment</p>
<h3 dir="auto">Deployment details</h3>
<p dir="auto">we create our own airflow base images using the instructions provided on your site, here is a snippet of the code we use to install</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="RUN pip3 install &quot;apache-airflow[statsd,aws,kubernetes,celery,redis,postgres,sentry]==${AIRFLOW_VERSION}&quot; --constraint &quot;https://raw.githubusercontent.com/apache/airflow/constraints-$AIRFLOW_VERSION/constraints-$PYTHON_VERSION.txt&quot;
"><pre class="notranslate"><code class="notranslate">RUN pip3 install "apache-airflow[statsd,aws,kubernetes,celery,redis,postgres,sentry]==${AIRFLOW_VERSION}" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-$AIRFLOW_VERSION/constraints-$PYTHON_VERSION.txt"

</code></pre></div>
<p dir="auto">We then use this docker image for all of our airflow workers, scheduler, dagprocessor and airflow web<br>
This is managed through a custom helm script. Also we have incorporated the use of pgbouncer to manage db connections similar to the publicly available helm charts</p>
<h3 dir="auto">Anything else</h3>
<p dir="auto">The problem seems to occur quite frequently. It makes the system completely unusable.</p>
<h3 dir="auto">Are you willing to submit PR?</h3>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> Yes I am willing to submit a PR!</li>
</ul>
<h3 dir="auto">Code of Conduct</h3>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I agree to follow this project's <a href="https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md">Code of Conduct</a></li>
</ul>
<p dir="auto">There is a new design of system tests that was introduced by the <a href="https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-47+New+design+of+Airflow+System+Tests" rel="nofollow">AIP-47</a>.</p>
<p dir="auto">All current example dags need to be migrated and converted into system tests, so they can be run in the CI process automatically before releases.</p>
<p dir="auto">This is an aggregated issue for all example DAGs related to <code class="notranslate">Amazon</code> provider. It is created to track progress of their migration.</p>
<p dir="auto">List of paths to example DAGs:</p>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_s3_bucket_tagging.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_emr_eks.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_athena.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_sqs.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroups.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_dms_full_load_task.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_emr.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_sagemaker.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_eks_with_nodegroup_in_one_step.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_dynamodb_to_s3.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_s3_to_sftp.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_local_to_s3.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_s3_bucket.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_basic.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_redshift_cluster.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_lambda.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_s3_to_redshift.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_imap_attachment_to_s3.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_ecs_fargate.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_rds.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_eks_with_fargate_in_one_step.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_batch.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_datasync_2.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_dynamodb_to_s3_segmented.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_ecs_ec2.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_eks_with_fargate_profile.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_redshift_to_s3.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_redshift_sql.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_sns.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_advanced.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_datasync_1.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_glacier_to_gcs.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_redshift_data_execute_sql.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_eks_templated.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_sftp_to_s3.py</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> airflow/providers/amazon/aws/example_dags/example_salesforce_to_s3.py</li>
</ul>