<h3 dir="auto">Apache Airflow Provider(s)</h3>
<p dir="auto">google</p>
<h3 dir="auto">Versions of Apache Airflow Providers</h3>
<p dir="auto">apache-airflow-providers-google==6.3.0</p>
<h3 dir="auto">Apache Airflow version</h3>
<p dir="auto">2.2.3 (latest released)</p>
<h3 dir="auto">Operating System</h3>
<p dir="auto">Macos m1</p>
<h3 dir="auto">Deployment</h3>
<p dir="auto">Virtualenv installation</p>
<h3 dir="auto">Deployment details</h3>
<p dir="auto"><em>No response</em></p>
<h3 dir="auto">What happened</h3>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="get_dataset = BigQueryGetDatasetOperator(task_id=&quot;get-dataset&quot;, dataset_id=&quot;my_table&quot;)"><pre class="notranslate"><code class="notranslate">get_dataset = BigQueryGetDatasetOperator(task_id="get-dataset", dataset_id="my_table")
</code></pre></div>
<p dir="auto">Google libraries cause:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="'/usr/lib/cygrpc.cpython-310-darwin.so' (no such file)"><pre class="notranslate"><code class="notranslate">'/usr/lib/cygrpc.cpython-310-darwin.so' (no such file)
</code></pre></div>
<p dir="auto">Similar issue fixed: <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="777504528" data-permission-text="Title is private" data-url="https://github.com/grpc/grpc/issues/25082" data-hovercard-type="issue" data-hovercard-url="/grpc/grpc/issues/25082/hovercard" href="https://github.com/grpc/grpc/issues/25082">grpc/grpc#25082</a><br>
Need to update libraries</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content=" from grpc._cython import cygrpc
ImportError: dlopen(/.venv/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so, 0x0002): tried: '/.venv/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e')), '/usr/local/lib/cygrpc.cpython-310-darwin.so' (no such file), '/usr/lib/cygrpc.cpython-310-darwin.so' (no such file)
"><pre class="notranslate"><code class="notranslate"> from grpc._cython import cygrpc
ImportError: dlopen(/.venv/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so, 0x0002): tried: '/.venv/lib/python3.10/site-packages/grpc/_cython/cygrpc.cpython-310-darwin.so' (mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e')), '/usr/local/lib/cygrpc.cpython-310-darwin.so' (no such file), '/usr/lib/cygrpc.cpython-310-darwin.so' (no such file)

</code></pre></div>
<h3 dir="auto">What you expected to happen</h3>
<p dir="auto"><em>No response</em></p>
<h3 dir="auto">How to reproduce</h3>
<p dir="auto">Install <code class="notranslate">apache-airflow-providers-google==6.3.0</code> on Apple Silicon mac</p>
<h3 dir="auto">Anything else</h3>
<p dir="auto">Similar issue been fixed here:</p>
<p dir="auto"><a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="777504528" data-permission-text="Title is private" data-url="https://github.com/grpc/grpc/issues/25082" data-hovercard-type="issue" data-hovercard-url="/grpc/grpc/issues/25082/hovercard" href="https://github.com/grpc/grpc/issues/25082">grpc/grpc#25082</a></p>
<p dir="auto">Need to update google packages</p>
<h3 dir="auto">Are you willing to submit PR?</h3>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> Yes I am willing to submit a PR!</li>
</ul>
<h3 dir="auto">Code of Conduct</h3>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I agree to follow this project's <a href="https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md">Code of Conduct</a></li>
</ul>
<p dir="auto"><strong>Apache Airflow version</strong>:  v2.0.0b3</p>
<p dir="auto"><strong>Kubernetes version (if you are using kubernetes)</strong> (use <code class="notranslate">kubectl version</code>): 1.16.15</p>
<p dir="auto"><strong>Environment</strong>:</p>
<ul dir="auto">
<li><strong>Cloud provider or hardware configuration</strong>: AWS</li>
<li><strong>OS</strong> (e.g. from /etc/os-release):</li>
<li><strong>Kernel</strong> (e.g. <code class="notranslate">uname -a</code>):</li>
<li><strong>Install tools</strong>: Custom Helm Chart</li>
<li><strong>Others</strong>:</li>
</ul>
<p dir="auto"><strong>What happened</strong>:</p>
<p dir="auto">S3 Remote Logging not working. Below is the stacktrace:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content=" Running &lt;TaskInstance: canary_dag.print_date 2020-12-09T19:46:17.200838+00:00 [queued]&gt; on host canarydagprintdate-9fafada4409d4eafb5e6e9c7187810ae                                                                                                                          │
│ [2020-12-09 19:54:09,825] {s3_task_handler.py:183} ERROR - Could not verify previous log to append: 'NoneType' object is not callable                                                                                                                                        │
│ Traceback (most recent call last):                                                                                                                                                                                                                                           │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py&quot;, line 179, in s3_write                                                                                                                                         │
│     if append and self.s3_log_exists(remote_log_location):                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py&quot;, line 141, in s3_log_exists                                                                                                                                    │
│     return self.hook.check_for_key(remote_log_location)                                                                                                                                                                                                                      │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/hooks/s3.py&quot;, line 57, in wrapper                                                                                                                                                      │
│     connection = self.get_connection(self.aws_conn_id)                                                                                                                                                                                                                       │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/hooks/base.py&quot;, line 63, in get_connection                                                                                                                                                                  │
│     conn = Connection.get_connection_from_secrets(conn_id)                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/models/connection.py&quot;, line 351, in get_connection_from_secrets                                                                                                                                             │
│     conn = secrets_backend.get_connection(conn_id=conn_id)                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 64, in wrapper                                                                                                                                                                      │
│     with create_session() as session:                                                                                                                                                                                                                                        │
│   File &quot;/usr/local/lib/python3.7/contextlib.py&quot;, line 112, in __enter__                                                                                                                                                                                                      │
│     return next(self.gen)                                                                                                                                                                                                                                                    │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 29, in create_session                                                                                                                                                               │
│     session = settings.Session()                                                                                                                                                                                                                                             │
│ TypeError: 'NoneType' object is not callable                                                                                                                                                                                                                                 │
│ [2020-12-09 19:54:09,826] {s3_task_handler.py:193} ERROR - Could not write logs to s3://my-favorite-airflow-logs/canary_dag/print_date/2020-12-09T19:46:17.200838+00:00/2.log                                                                                                   │
│ Traceback (most recent call last):                                                                                                                                                                                                                                           │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py&quot;, line 190, in s3_write                                                                                                                                         │
│     encrypt=conf.getboolean('logging', 'ENCRYPT_S3_LOGS'),                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/hooks/s3.py&quot;, line 57, in wrapper                                                                                                                                                      │
│     connection = self.get_connection(self.aws_conn_id)                                                                                                                                                                                                                       │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/hooks/base.py&quot;, line 63, in get_connection                                                                                                                                                                  │
│     conn = Connection.get_connection_from_secrets(conn_id)                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/models/connection.py&quot;, line 351, in get_connection_from_secrets                                                                                                                                             │
│     conn = secrets_backend.get_connection(conn_id=conn_id)                                                                                                                                                                                                                   │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 64, in wrapper                                                                                                                                                                      │
│     with create_session() as session:                                                                                                                                                                                                                                        │
│   File &quot;/usr/local/lib/python3.7/contextlib.py&quot;, line 112, in __enter__                                                                                                                                                                                                      │
│     return next(self.gen)                                                                                                                                                                                                                                                    │
│   File &quot;/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py&quot;, line 29, in create_session                                                                                                                                                               │
│     session = settings.Session()                                                                                                                                                                                                                                             │
│ TypeError: 'NoneType' object is not callable                                                                                                                                                                                                                                 
 stream closed"><pre class="notranslate"><code class="notranslate"> Running &lt;TaskInstance: canary_dag.print_date 2020-12-09T19:46:17.200838+00:00 [queued]&gt; on host canarydagprintdate-9fafada4409d4eafb5e6e9c7187810ae                                                                                                                          │
│ [2020-12-09 19:54:09,825] {s3_task_handler.py:183} ERROR - Could not verify previous log to append: 'NoneType' object is not callable                                                                                                                                        │
│ Traceback (most recent call last):                                                                                                                                                                                                                                           │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py", line 179, in s3_write                                                                                                                                         │
│     if append and self.s3_log_exists(remote_log_location):                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py", line 141, in s3_log_exists                                                                                                                                    │
│     return self.hook.check_for_key(remote_log_location)                                                                                                                                                                                                                      │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/hooks/s3.py", line 57, in wrapper                                                                                                                                                      │
│     connection = self.get_connection(self.aws_conn_id)                                                                                                                                                                                                                       │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/hooks/base.py", line 63, in get_connection                                                                                                                                                                  │
│     conn = Connection.get_connection_from_secrets(conn_id)                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/connection.py", line 351, in get_connection_from_secrets                                                                                                                                             │
│     conn = secrets_backend.get_connection(conn_id=conn_id)                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py", line 64, in wrapper                                                                                                                                                                      │
│     with create_session() as session:                                                                                                                                                                                                                                        │
│   File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__                                                                                                                                                                                                      │
│     return next(self.gen)                                                                                                                                                                                                                                                    │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py", line 29, in create_session                                                                                                                                                               │
│     session = settings.Session()                                                                                                                                                                                                                                             │
│ TypeError: 'NoneType' object is not callable                                                                                                                                                                                                                                 │
│ [2020-12-09 19:54:09,826] {s3_task_handler.py:193} ERROR - Could not write logs to s3://my-favorite-airflow-logs/canary_dag/print_date/2020-12-09T19:46:17.200838+00:00/2.log                                                                                                   │
│ Traceback (most recent call last):                                                                                                                                                                                                                                           │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/log/s3_task_handler.py", line 190, in s3_write                                                                                                                                         │
│     encrypt=conf.getboolean('logging', 'ENCRYPT_S3_LOGS'),                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/providers/amazon/aws/hooks/s3.py", line 57, in wrapper                                                                                                                                                      │
│     connection = self.get_connection(self.aws_conn_id)                                                                                                                                                                                                                       │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/hooks/base.py", line 63, in get_connection                                                                                                                                                                  │
│     conn = Connection.get_connection_from_secrets(conn_id)                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/models/connection.py", line 351, in get_connection_from_secrets                                                                                                                                             │
│     conn = secrets_backend.get_connection(conn_id=conn_id)                                                                                                                                                                                                                   │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py", line 64, in wrapper                                                                                                                                                                      │
│     with create_session() as session:                                                                                                                                                                                                                                        │
│   File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__                                                                                                                                                                                                      │
│     return next(self.gen)                                                                                                                                                                                                                                                    │
│   File "/home/airflow/.local/lib/python3.7/site-packages/airflow/utils/session.py", line 29, in create_session                                                                                                                                                               │
│     session = settings.Session()                                                                                                                                                                                                                                             │
│ TypeError: 'NoneType' object is not callable                                                                                                                                                                                                                                 
 stream closed
</code></pre></div>
<p dir="auto"><strong>What you expected to happen</strong><br>
Able to see the task instance logs in the airflow UI being read from S3 remote location.</p>
<p dir="auto"><strong>How to reproduce it</strong>:</p>
<p dir="auto">Pulled the latest master and created an airflow image from the dockerfile mentioned in the repo.</p>