<p dir="auto">My use case: I have Macbook Pro M1 laptop as my host machine. I want to run celery worker nodes inside linux based docker containers.</p>
<p dir="auto">Ubuntu 18.04 as host machine works without any problem, but not the macbook pro with M1 processor. I can create tasks from my host machine, but dockerized workers does not work on anything.</p>

<h1 dir="auto">Checklist</h1>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have verified that the issue exists against the <code class="notranslate">master</code> branch of Celery.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> This has already been asked to the <a href="https://groups.google.com/forum/#!forum/celery-users" rel="nofollow">discussion group</a> first.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have read the relevant section in the<br>
<a href="http://docs.celeryproject.org/en/latest/contributing.html#other-bugs" rel="nofollow">contribution guide</a><br>
on reporting bugs.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/issues?q=is%3Aissue+label%3A%22Issue+Type%3A+Bug+Report%22+-label%3A%22Category%3A+Documentation%22">issues list</a><br>
for similar or identical bug reports.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/pulls?q=is%3Apr+label%3A%22PR+Type%3A+Bugfix%22+-label%3A%22Category%3A+Documentation%22">pull requests list</a><br>
for existing proposed fixes.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/commits/master">commit log</a><br>
to find out if the bug was already fixed in the master branch.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included all related issues and possible duplicate issues<br>
in this issue (If there are none, check this box anyway).</li>
</ul>
<h2 dir="auto">Mandatory Debugging Information</h2>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included the output of <code class="notranslate">celery -A proj report</code> in the issue.<br>
(if you are not able to do this, then at least specify the Celery<br>
version affected).</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have verified that the issue exists against the <code class="notranslate">master</code> branch of Celery.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included the contents of <code class="notranslate">pip freeze</code> in the issue.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included all the versions of all the external dependencies required<br>
to reproduce this bug.</li>
</ul>
<h2 dir="auto">Optional Debugging Information</h2>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have tried reproducing the issue on more than one Python version<br>
and/or implementation.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one message broker and/or<br>
result backend.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one version of the message<br>
broker and/or result backend.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have tried reproducing the issue on more than one operating system.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one workers pool.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue with autoscaling, retries,<br>
ETA/Countdown &amp; rate limits disabled.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have tried reproducing the issue after downgrading<br>
and/or upgrading Celery and its dependencies.</li>
</ul>
<h2 dir="auto">Related Issues and Possible Duplicates</h2>

<h4 dir="auto">Related Issues</h4>
<ul dir="auto">
<li>None</li>
</ul>
<h4 dir="auto">Possible Duplicates</h4>
<ul dir="auto">
<li>None</li>
</ul>
<h2 dir="auto">Environment &amp; Settings</h2>

<p dir="auto"><strong>Celery version</strong>: 5.0.5</p>

<details>
<summary><b><code class="notranslate">celery report</code> Output:</b></summary>
<p dir="auto">
</p><div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### host machine
software -&gt; celery:5.0.5 (singularity) kombu:5.0.2 py:3.9.2
            billiard:3.6.3.0 redis:3.5.3
platform -&gt; system:Darwin arch:64bit
            kernel version:20.3.0 imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://localhost:6379/0

broker_url: 'redis://localhost:6379/0'
result_backend: 'redis://localhost:6379/0'
deprecated_settings: None"><pre class="notranslate"><code class="notranslate">### host machine
software -&gt; celery:5.0.5 (singularity) kombu:5.0.2 py:3.9.2
            billiard:3.6.3.0 redis:3.5.3
platform -&gt; system:Darwin arch:64bit
            kernel version:20.3.0 imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://localhost:6379/0

broker_url: 'redis://localhost:6379/0'
result_backend: 'redis://localhost:6379/0'
deprecated_settings: None
</code></pre></div>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### inside docker
software -&gt; celery:5.0.5 (singularity) kombu:5.0.2 py:3.9.2
            billiard:3.6.3.0 redis:3.5.3
platform -&gt; system:Linux arch:64bit, ELF
            kernel version:4.19.121-linuxkit imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://host.docker.internal:6379/0

broker_url: 'redis://host.docker.internal:6379/0'
result_backend: 'redis://host.docker.internal:6379/0'
deprecated_settings: None"><pre class="notranslate"><code class="notranslate">### inside docker
software -&gt; celery:5.0.5 (singularity) kombu:5.0.2 py:3.9.2
            billiard:3.6.3.0 redis:3.5.3
platform -&gt; system:Linux arch:64bit, ELF
            kernel version:4.19.121-linuxkit imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://host.docker.internal:6379/0

broker_url: 'redis://host.docker.internal:6379/0'
result_backend: 'redis://host.docker.internal:6379/0'
deprecated_settings: None
</code></pre></div>
<p dir="auto"></p>
</details>
<h1 dir="auto">Steps to Reproduce</h1>
<h2 dir="auto">Required Dependencies</h2>

<ul dir="auto">
<li><strong>Minimal Python Version</strong>: 3.7 or 3.9</li>
<li><strong>Minimal Celery Version</strong>: 5.0.5</li>
<li><strong>Minimal Kombu Version</strong>: see below</li>
<li><strong>Minimal Broker Version</strong>: see below</li>
<li><strong>Minimal Result Backend Version</strong>: see below</li>
<li><strong>Minimal OS and/or Kernel Version</strong>: see below</li>
<li><strong>Minimal Broker Client Version</strong>: see below</li>
<li><strong>Minimal Result Backend Client Version</strong>: see below</li>
</ul>
<h3 dir="auto">Python Packages</h3>

<details>
<summary><b><code class="notranslate">pip freeze</code> Output:</b></summary>
<p dir="auto">
</p><div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### host machine
amqp==5.0.5
billiard==3.6.3.0
celery @ https://github.com/celery/celery/zipball/master
click==7.1.2
click-didyoumean==0.0.3
click-plugins==1.1.1
click-repl==0.1.6
kombu==5.0.2
prompt-toolkit==3.0.18
pytz==2021.1
redis==3.5.3
six==1.15.0
vine==5.0.0
wcwidth==0.2.5"><pre class="notranslate"><code class="notranslate">### host machine
amqp==5.0.5
billiard==3.6.3.0
celery @ https://github.com/celery/celery/zipball/master
click==7.1.2
click-didyoumean==0.0.3
click-plugins==1.1.1
click-repl==0.1.6
kombu==5.0.2
prompt-toolkit==3.0.18
pytz==2021.1
redis==3.5.3
six==1.15.0
vine==5.0.0
wcwidth==0.2.5
</code></pre></div>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### inside docker
amqp==5.0.5
billiard @ https://github.com/celery/billiard/zipball/master
celery @ https://github.com/celery/celery/zipball/master
click==7.1.2
click-didyoumean==0.0.3
click-plugins==1.1.1
click-repl==0.1.6
kombu @ https://github.com/celery/kombu/zipball/master
prompt-toolkit==3.0.18
pytz==2021.1
redis==3.5.3
six==1.15.0
vine @ https://github.com/celery/vine/zipball/master
wcwidth==0.2.5"><pre class="notranslate"><code class="notranslate">### inside docker
amqp==5.0.5
billiard @ https://github.com/celery/billiard/zipball/master
celery @ https://github.com/celery/celery/zipball/master
click==7.1.2
click-didyoumean==0.0.3
click-plugins==1.1.1
click-repl==0.1.6
kombu @ https://github.com/celery/kombu/zipball/master
prompt-toolkit==3.0.18
pytz==2021.1
redis==3.5.3
six==1.15.0
vine @ https://github.com/celery/vine/zipball/master
wcwidth==0.2.5
</code></pre></div>
<p dir="auto"></p>
</details>
<h3 dir="auto">Other Dependencies</h3>

<details>
<p dir="auto">
</p><div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### host machine
% uname -a 
Darwin Ignacios-MBP.fritz.box 20.3.0 Darwin Kernel Version 20.3.0: Thu Jan 21 00:06:51 PST 2021; root:xnu-7195.81.3~1/RELEASE_ARM64_T8101 arm64"><pre class="notranslate"><code class="notranslate">### host machine
% uname -a 
Darwin Ignacios-MBP.fritz.box 20.3.0 Darwin Kernel Version 20.3.0: Thu Jan 21 00:06:51 PST 2021; root:xnu-7195.81.3~1/RELEASE_ARM64_T8101 arm64
</code></pre></div>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="### inside docker
% uname -a
Linux 29461f0a74a4 4.19.121-linuxkit #1 SMP PREEMPT Thu Jan 21 15:45:22 UTC 2021 aarch64 GNU/Linux"><pre class="notranslate"><code class="notranslate">### inside docker
% uname -a
Linux 29461f0a74a4 4.19.121-linuxkit #1 SMP PREEMPT Thu Jan 21 15:45:22 UTC 2021 aarch64 GNU/Linux
</code></pre></div>
<p dir="auto">for redis and docker see test case 0. below</p>
<p dir="auto"></p>
</details>
<h2 dir="auto">Minimally Reproducible Test Case</h2>

<details>
<p dir="auto">
</p><ol start="0" dir="auto">
<li>Host machine setup environment: using redis and docker</li>
</ol>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="% redis-server --version
Redis server v=6.2.1 sha=00000000:0 malloc=libc bits=64 build=cfaa1431404ef25b"><pre class="notranslate">% redis-server --version
Redis server v=6.2.1 sha=00000000:0 malloc=libc bits=64 build=cfaa1431404ef25b</pre></div>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="% docker version
Client: Docker Engine - Community
 Version:           20.10.5
 API version:       1.41
 Go version:        go1.16
 Git commit:        55c4c88
 Built:             Wed Mar  3 00:56:04 2021
 OS/Arch:           darwin/arm64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.5
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       363e9a8
  Built:            Tue Mar  2 20:16:48 2021
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.4.4
  GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
 runc:
  Version:          1.0.0-rc93
  GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0"><pre class="notranslate">% docker version
Client: Docker Engine - Community
 Version:           20.10.5
 API version:       1.41
 Go version:        go1.16
 Git commit:        55c4c88
 Built:             Wed Mar  3 00:56:04 2021
 OS/Arch:           darwin/arm64
 Context:           default
 Experimental:      <span class="pl-c1">true</span>

Server: Docker Engine - Community
 Engine:
  Version:          20.10.5
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       363e9a8
  Built:            Tue Mar  2 20:16:48 2021
  OS/Arch:          linux/arm64
  Experimental:     <span class="pl-c1">false</span>
 containerd:
  Version:          1.4.4
  GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
 runc:
  Version:          1.0.0-rc93
  GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0</pre></div>
<ol dir="auto">
<li>Run redis-server on host machine</li>
</ol>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="redis-server --protected mode no --loglevel verbose"><pre class="notranslate">redis-server --protected mode no --loglevel verbose</pre></div>
<ol start="2" dir="auto">
<li>Create a dockerized worker, run it</li>
</ol>
<div class="highlight highlight-source-python notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="# tasks.py
from celery import Celery
host = &quot;host.docker.internal&quot;
redis_str = f'redis://{host}:6379/0'
app = Celery('tasks', broker=redis_str, backend=redis_str)
@app.task
def add(x, y):
    return x + y"><pre class="notranslate"><span class="pl-c"># tasks.py</span>
<span class="pl-k">from</span> <span class="pl-s1">celery</span> <span class="pl-k">import</span> <span class="pl-v">Celery</span>
<span class="pl-s1">host</span> <span class="pl-c1">=</span> <span class="pl-s">"host.docker.internal"</span>
<span class="pl-s1">redis_str</span> <span class="pl-c1">=</span> <span class="pl-s">f'redis://<span class="pl-s1"><span class="pl-kos">{</span><span class="pl-s1">host</span><span class="pl-kos">}</span></span>:6379/0'</span>
<span class="pl-s1">app</span> <span class="pl-c1">=</span> <span class="pl-v">Celery</span>(<span class="pl-s">'tasks'</span>, <span class="pl-s1">broker</span><span class="pl-c1">=</span><span class="pl-s1">redis_str</span>, <span class="pl-s1">backend</span><span class="pl-c1">=</span><span class="pl-s1">redis_str</span>)
<span class="pl-en">@<span class="pl-s1">app</span>.<span class="pl-s1">task</span></span>
<span class="pl-k">def</span> <span class="pl-en">add</span>(<span class="pl-s1">x</span>, <span class="pl-s1">y</span>):
    <span class="pl-k">return</span> <span class="pl-s1">x</span> <span class="pl-c1">+</span> <span class="pl-s1">y</span></pre></div>
<div class="highlight highlight-source-dockerfile notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="# Dockerfile
FROM python:3.9
ENV LANG=C.UTF-8 LC_ALL=C.UTF-8 PYTHONUNBUFFERED=1

RUN pip install https://github.com/celery/celery/zipball/master#egg=celery \
 https://github.com/celery/billiard/zipball/master#egg=billiard \
 https://github.com/celery/kombu/zipball/master#egg=kombu \
 https://github.com/celery/vine/zipball/master#egg=vine
RUN pip install redis

COPY . /app
WORKDIR /app
CMD [&quot;celery&quot;, &quot;-A&quot;, &quot;tasks&quot;, &quot;worker&quot;, &quot;-l&quot; ,&quot;DEBUG&quot;]"><pre class="notranslate"><span class="pl-c"><span class="pl-c">#</span> Dockerfile</span>
<span class="pl-k">FROM</span> python:3.9
<span class="pl-k">ENV</span> LANG=C.UTF-8 LC_ALL=C.UTF-8 PYTHONUNBUFFERED=1

<span class="pl-k">RUN</span> pip install https://github.com/celery/celery/zipball/master#egg=celery \
 https://github.com/celery/billiard/zipball/master#egg=billiard \
 https://github.com/celery/kombu/zipball/master#egg=kombu \
 https://github.com/celery/vine/zipball/master#egg=vine
<span class="pl-k">RUN</span> pip install redis

<span class="pl-k">COPY</span> . /app
<span class="pl-k">WORKDIR</span> /app
<span class="pl-k">CMD</span> [<span class="pl-s">"celery"</span>, <span class="pl-s">"-A"</span>, <span class="pl-s">"tasks"</span>, <span class="pl-s">"worker"</span>, <span class="pl-s">"-l"</span> ,<span class="pl-s">"DEBUG"</span>]</pre></div>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="docker build -f Dockerfile -t celery_dockerized .
docker run celery_dockerized"><pre class="notranslate">docker build -f Dockerfile -t celery_dockerized <span class="pl-c1">.</span>
docker run celery_dockerized</pre></div>
<ol start="2" dir="auto">
<li>Setup host machine celery, change <code class="notranslate">host="localhost"</code> for the host machine in tasks.py</li>
</ol>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="python3 -m venv venv  # tried with python 3.7 and 3.9
source venv/bin/activate
pip install https://github.com/celery/celery/zipball/master#egg=celery \
 https://github.com/celery/billiard/zipball/master#egg=billiard \
 https://github.com/celery/kombu/zipball/master#egg=kombu \
 https://github.com/celery/vine/zipball/master#egg=vine
pip install redis  "><pre class="notranslate">python3 -m venv venv  <span class="pl-c"><span class="pl-c">#</span> tried with python 3.7 and 3.9</span>
<span class="pl-c1">source</span> venv/bin/activate
pip install https://github.com/celery/celery/zipball/master#egg=celery \
 https://github.com/celery/billiard/zipball/master#egg=billiard \
 https://github.com/celery/kombu/zipball/master#egg=kombu \
 https://github.com/celery/vine/zipball/master#egg=vine
pip install redis  </pre></div>
<div class="highlight highlight-source-python notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="# tasks.py
from celery import Celery
host = &quot;localhost&quot;
redis_str = f'redis://{host}:6379/0'
app = Celery('tasks', broker=redis_str, backend=redis_str)
@app.task
def add(x, y):
    return x + y"><pre class="notranslate"><span class="pl-c"># tasks.py</span>
<span class="pl-k">from</span> <span class="pl-s1">celery</span> <span class="pl-k">import</span> <span class="pl-v">Celery</span>
<span class="pl-s1">host</span> <span class="pl-c1">=</span> <span class="pl-s">"localhost"</span>
<span class="pl-s1">redis_str</span> <span class="pl-c1">=</span> <span class="pl-s">f'redis://<span class="pl-s1"><span class="pl-kos">{</span><span class="pl-s1">host</span><span class="pl-kos">}</span></span>:6379/0'</span>
<span class="pl-s1">app</span> <span class="pl-c1">=</span> <span class="pl-v">Celery</span>(<span class="pl-s">'tasks'</span>, <span class="pl-s1">broker</span><span class="pl-c1">=</span><span class="pl-s1">redis_str</span>, <span class="pl-s1">backend</span><span class="pl-c1">=</span><span class="pl-s1">redis_str</span>)
<span class="pl-en">@<span class="pl-s1">app</span>.<span class="pl-s1">task</span></span>
<span class="pl-k">def</span> <span class="pl-en">add</span>(<span class="pl-s1">x</span>, <span class="pl-s1">y</span>):
    <span class="pl-k">return</span> <span class="pl-s1">x</span> <span class="pl-c1">+</span> <span class="pl-s1">y</span></pre></div>
<ol start="3" dir="auto">
<li>Trigger the task from host machine, it will give the task id</li>
</ol>
<div class="highlight highlight-source-shell notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content="% celery -A tasks call --args='[1,2]' tasks.add

&lt;some_task_id&gt;"><pre class="notranslate">% celery -A tasks call --args=<span class="pl-s"><span class="pl-pds">'</span>[1,2]<span class="pl-pds">'</span></span> tasks.add

<span class="pl-k">&lt;</span>some_task_id<span class="pl-k">&gt;</span></pre></div>
<p dir="auto"></p>
</details>
<h1 dir="auto">Expected Behavior</h1>

<p dir="auto">Dockerized containers (linux) take and execute tasks that are initiated from host machine (mac m1).</p>
<h1 dir="auto">Actual Behavior</h1>

<p dir="auto">Dockerized containers (linux) does not take any tasks that are initiated from host machine (mac m1). Also, they also cannot see any other worker nodes on host machine. But, they can see other worker nodes within the docker container. There are no error/warning messages on celery workers.</p>
<ul dir="auto">
<li>Redis server logs, when a dockerized worker created</li>
</ul>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="18405:M 24 Mar 2021 17:13:05.576 - DB 0: 2 keys (0 volatile) in 8 slots HT.
18405:M 24 Mar 2021 17:13:09.565 - Accepted 192.168.64.6:57300
18405:M 24 Mar 2021 17:13:09.566 - Accepted 192.168.64.6:57302
18405:M 24 Mar 2021 17:13:10.740 - DB 0: 2 keys (0 volatile) in 8 slots HT.
18405:M 24 Mar 2021 17:13:14.581 - Accepted 192.168.64.6:57304
18405:M 24 Mar 2021 17:13:14.615 - Accepted 192.168.64.6:57306
18405:M 24 Mar 2021 17:13:14.619 - Accepted 192.168.64.6:57308
18405:M 24 Mar 2021 17:13:15.648 - Accepted 192.168.64.6:57310
18405:M 24 Mar 2021 17:13:15.654 - Accepted 192.168.64.6:57312
18405:M 24 Mar 2021 17:13:15.663 - Accepted 192.168.64.6:57314
18405:M 24 Mar 2021 17:13:15.669 - Accepted 192.168.64.6:57316
18405:M 24 Mar 2021 17:13:15.678 - Accepted 192.168.64.6:57318
18405:M 24 Mar 2021 17:13:15.717 * 100 changes in 300 seconds. Saving..."><pre class="notranslate"><code class="notranslate">18405:M 24 Mar 2021 17:13:05.576 - DB 0: 2 keys (0 volatile) in 8 slots HT.
18405:M 24 Mar 2021 17:13:09.565 - Accepted 192.168.64.6:57300
18405:M 24 Mar 2021 17:13:09.566 - Accepted 192.168.64.6:57302
18405:M 24 Mar 2021 17:13:10.740 - DB 0: 2 keys (0 volatile) in 8 slots HT.
18405:M 24 Mar 2021 17:13:14.581 - Accepted 192.168.64.6:57304
18405:M 24 Mar 2021 17:13:14.615 - Accepted 192.168.64.6:57306
18405:M 24 Mar 2021 17:13:14.619 - Accepted 192.168.64.6:57308
18405:M 24 Mar 2021 17:13:15.648 - Accepted 192.168.64.6:57310
18405:M 24 Mar 2021 17:13:15.654 - Accepted 192.168.64.6:57312
18405:M 24 Mar 2021 17:13:15.663 - Accepted 192.168.64.6:57314
18405:M 24 Mar 2021 17:13:15.669 - Accepted 192.168.64.6:57316
18405:M 24 Mar 2021 17:13:15.678 - Accepted 192.168.64.6:57318
18405:M 24 Mar 2021 17:13:15.717 * 100 changes in 300 seconds. Saving...
</code></pre></div>
<ul dir="auto">
<li>Worker node running inside docker, when a task created from host machine nothing happens. Or, when there is a new worker on host machine also nothing..</li>
</ul>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="[2021-03-24 15:29:12,402: INFO/MainProcess] Connected to redis://host.docker.internal:6379/0
[2021-03-24 15:29:12,402: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:12,403: DEBUG/MainProcess] | Consumer: Starting Events
[2021-03-24 15:29:12,424: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:12,424: DEBUG/MainProcess] | Consumer: Starting Mingle
[2021-03-24 15:29:12,425: INFO/MainProcess] mingle: searching for neighbors
[2021-03-24 15:29:13,463: INFO/MainProcess] mingle: all alone
[2021-03-24 15:29:13,463: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,463: DEBUG/MainProcess] | Consumer: Starting Gossip
[2021-03-24 15:29:13,477: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,478: DEBUG/MainProcess] | Consumer: Starting Tasks
[2021-03-24 15:29:13,485: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,485: DEBUG/MainProcess] | Consumer: Starting Control
[2021-03-24 15:29:13,494: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,494: DEBUG/MainProcess] | Consumer: Starting Heart
[2021-03-24 15:29:13,500: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,501: DEBUG/MainProcess] | Consumer: Starting event loop
[2021-03-24 15:29:13,501: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2021-03-24 15:29:13,501: INFO/MainProcess] celery@d03f98ad699a ready."><pre class="notranslate"><code class="notranslate">[2021-03-24 15:29:12,402: INFO/MainProcess] Connected to redis://host.docker.internal:6379/0
[2021-03-24 15:29:12,402: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:12,403: DEBUG/MainProcess] | Consumer: Starting Events
[2021-03-24 15:29:12,424: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:12,424: DEBUG/MainProcess] | Consumer: Starting Mingle
[2021-03-24 15:29:12,425: INFO/MainProcess] mingle: searching for neighbors
[2021-03-24 15:29:13,463: INFO/MainProcess] mingle: all alone
[2021-03-24 15:29:13,463: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,463: DEBUG/MainProcess] | Consumer: Starting Gossip
[2021-03-24 15:29:13,477: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,478: DEBUG/MainProcess] | Consumer: Starting Tasks
[2021-03-24 15:29:13,485: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,485: DEBUG/MainProcess] | Consumer: Starting Control
[2021-03-24 15:29:13,494: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,494: DEBUG/MainProcess] | Consumer: Starting Heart
[2021-03-24 15:29:13,500: DEBUG/MainProcess] ^-- substep ok
[2021-03-24 15:29:13,501: DEBUG/MainProcess] | Consumer: Starting event loop
[2021-03-24 15:29:13,501: DEBUG/MainProcess] | Worker: Hub.register Pool...
[2021-03-24 15:29:13,501: INFO/MainProcess] celery@d03f98ad699a ready.
</code></pre></div>
<ul dir="auto">
<li>Same worker node above, when another one created in the same docker container, or inside a new container. Also, it runs tasks that are triggered inside the same or other container just fine.</li>
</ul>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="[2021-03-24 15:45:40,711: DEBUG/MainProcess] pidbox received method hello(from_node='celery@10dde1c3db69', revoked={}) [reply_to:{'exchange': 'reply.celery.pidbox', 'routing_key': 'acf00853-a0b7-3d14-bb4d-92295b74b1b8'} ticket:3bc055e9-d508-4f18-add5-bf80ffb83aa9]
[2021-03-24 15:45:40,711: INFO/MainProcess] sync with celery@10dde1c3db69
[2021-03-24 15:45:41,765: DEBUG/MainProcess] celery@10dde1c3db69 joined the party"><pre class="notranslate"><code class="notranslate">[2021-03-24 15:45:40,711: DEBUG/MainProcess] pidbox received method hello(from_node='celery@10dde1c3db69', revoked={}) [reply_to:{'exchange': 'reply.celery.pidbox', 'routing_key': 'acf00853-a0b7-3d14-bb4d-92295b74b1b8'} ticket:3bc055e9-d508-4f18-add5-bf80ffb83aa9]
[2021-03-24 15:45:40,711: INFO/MainProcess] sync with celery@10dde1c3db69
[2021-03-24 15:45:41,765: DEBUG/MainProcess] celery@10dde1c3db69 joined the party
</code></pre></div>
<h1 dir="auto">Checklist</h1>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have read the relevant section in the<br>
<a href="http://docs.celeryproject.org/en/latest/contributing.html#other-bugs" rel="nofollow">contribution guide</a><br>
on reporting bugs.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/issues?q=is%3Aissue+label%3A%22Issue+Type%3A+Bug+Report%22+-label%3A%22Category%3A+Documentation%22">issues list</a><br>
for similar or identical bug reports.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/pulls?q=is%3Apr+label%3A%22PR+Type%3A+Bugfix%22+-label%3A%22Category%3A+Documentation%22">pull requests list</a><br>
for existing proposed fixes.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have checked the <a href="https://github.com/celery/celery/commits/master">commit log</a><br>
to find out if the bug was already fixed in the master branch.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included all related issues and possible duplicate issues<br>
in this issue (If there are none, check this box anyway).</li>
</ul>
<h2 dir="auto">Mandatory Debugging Information</h2>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included the output of <code class="notranslate">celery -A proj report</code> in the issue.<br>
(if you are not able to do this, then at least specify the Celery<br>
version affected).</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have verified that the issue exists against the <code class="notranslate">master</code> branch of Celery.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included the contents of <code class="notranslate">pip freeze</code> in the issue.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have included all the versions of all the external dependencies required<br>
to reproduce this bug.</li>
</ul>
<h2 dir="auto">Optional Debugging Information</h2>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one Python version<br>
and/or implementation.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one message broker and/or<br>
result backend.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one version of the message<br>
broker and/or result backend.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one operating system.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue on more than one workers pool.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue with autoscaling, retries,<br>
ETA/Countdown &amp; rate limits disabled.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have tried reproducing the issue after downgrading<br>
and/or upgrading Celery and its dependencies.</li>
</ul>
<h2 dir="auto">Related Issues and Possible Duplicates</h2>

<h4 dir="auto">Related Issues</h4>
<ul dir="auto">
<li>None</li>
</ul>
<h4 dir="auto">Possible Duplicates</h4>
<p dir="auto"><a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="327218798" data-permission-text="Title is private" data-url="https://github.com/celery/celery/issues/4777" data-hovercard-type="issue" data-hovercard-url="/celery/celery/issues/4777/hovercard" href="https://github.com/celery/celery/issues/4777">#4777</a> (but the work around "delete celerybeat-schedule file" does not work)</p>
<h2 dir="auto">Environment &amp; Settings</h2>

<p dir="auto"><strong>Celery version</strong>:<br>
4.3.0 (rhubarb)</p>

<details>
<summary><b><code class="notranslate">celery report</code> Output:</b></summary>
<p dir="auto">
</p><div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="software -&gt; celery:4.3.0 (rhubarb) kombu:4.4.0 py:3.7.2+
            billiard:3.6.0.0 redis:3.2.1
platform -&gt; system:Linux arch:64bit, ELF
            kernel version:4.19.0-4-amd64 imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://localhost:6379/0

BROKER_URL: 'redis://localhost:6379/0'
CELERY_RESULT_BACKEND: 'redis://localhost:6379/0'
ENV: 'production'
DEBUG: False
TESTING: False
PROPAGATE_EXCEPTIONS: None
PRESERVE_CONTEXT_ON_EXCEPTION: None
SECRET_KEY: '********'
PERMANENT_SESSION_LIFETIME: datetime.timedelta(days=31)
USE_X_SENDFILE: False
SERVER_NAME: None
APPLICATION_ROOT: '/'
SESSION_COOKIE_NAME: 'session'
SESSION_COOKIE_DOMAIN: None
SESSION_COOKIE_PATH: None
SESSION_COOKIE_HTTPONLY: True
SESSION_COOKIE_SECURE: False
SESSION_COOKIE_SAMESITE: None
SESSION_REFRESH_EACH_REQUEST: True
MAX_CONTENT_LENGTH: None
SEND_FILE_MAX_AGE_DEFAULT: datetime.timedelta(seconds=43200)
TRAP_BAD_REQUEST_ERRORS: None
TRAP_HTTP_EXCEPTIONS: False
EXPLAIN_TEMPLATE_LOADING: False
PREFERRED_URL_SCHEME: 'http'
JSON_AS_ASCII: True
JSON_SORT_KEYS: '********'
JSONIFY_PRETTYPRINT_REGULAR: False
JSONIFY_MIMETYPE: 'application/json'
TEMPLATES_AUTO_RELOAD: None
MAX_COOKIE_SIZE: 4093
CACHE_DEFAULT_TIMEOUT: 300
CACHE_TYPE: 'redis'
CELERYBEAT_SCHEDULE: {
    'purge_old_data': {   'kwargs': {'max_hours': 48},
                          'schedule': datetime.timedelta(seconds=600),
                          'task': 'purge_old_data'},
    'update-country-codes': {   'schedule': datetime.timedelta(seconds=60),
                                'task': 'update_receivers_country_code'},
    'update-ddb': {   'schedule': datetime.timedelta(seconds=3600),
                      'task': 'import_ddb'},
    'update-logbook': {   'schedule': datetime.timedelta(seconds=60),
                          'task': 'update_logbook_entries'},
    'update-max-altitudes': {   'schedule': &lt;crontab: 30 0 * * * (m/h/d/dM/MY)&gt;,
                                'task': 'update_logbook_max_altitude'},
    'update-stats-daily': {   'kwargs': {'day_offset': -1},
                              'schedule': &lt;crontab: 5 0 * * * (m/h/d/dM/MY)&gt;,
                              'task': 'update_stats'},
    'update-takeoff-and-landing': {   'kwargs': {'last_minutes': 10},
                                      'schedule': datetime.timedelta(seconds=60),
                                      'task': 'update_takeoff_landings'}}
CELERY_BROKER_URL: 'redis://localhost:6379/0'
SQLALCHEMY_DATABASE_URI: '********'
SQLALCHEMY_TRACK_MODIFICATIONS: False
BOOTSTRAP_USE_MINIFIED: True
BOOTSTRAP_CDN_FORCE_SSL: False
BOOTSTRAP_QUERYSTRING_REVVING: True
BOOTSTRAP_SERVE_LOCAL: False
BOOTSTRAP_LOCAL_SUBDOMAIN: None
SQLALCHEMY_BINDS: None
SQLALCHEMY_NATIVE_UNICODE: None
SQLALCHEMY_ECHO: False
SQLALCHEMY_RECORD_QUERIES: None
SQLALCHEMY_POOL_SIZE: None
SQLALCHEMY_POOL_TIMEOUT: None
SQLALCHEMY_POOL_RECYCLE: None
SQLALCHEMY_MAX_OVERFLOW: None
SQLALCHEMY_COMMIT_ON_TEARDOWN: False"><pre class="notranslate"><code class="notranslate">software -&gt; celery:4.3.0 (rhubarb) kombu:4.4.0 py:3.7.2+
            billiard:3.6.0.0 redis:3.2.1
platform -&gt; system:Linux arch:64bit, ELF
            kernel version:4.19.0-4-amd64 imp:CPython
loader   -&gt; celery.loaders.app.AppLoader
settings -&gt; transport:redis results:redis://localhost:6379/0

BROKER_URL: 'redis://localhost:6379/0'
CELERY_RESULT_BACKEND: 'redis://localhost:6379/0'
ENV: 'production'
DEBUG: False
TESTING: False
PROPAGATE_EXCEPTIONS: None
PRESERVE_CONTEXT_ON_EXCEPTION: None
SECRET_KEY: '********'
PERMANENT_SESSION_LIFETIME: datetime.timedelta(days=31)
USE_X_SENDFILE: False
SERVER_NAME: None
APPLICATION_ROOT: '/'
SESSION_COOKIE_NAME: 'session'
SESSION_COOKIE_DOMAIN: None
SESSION_COOKIE_PATH: None
SESSION_COOKIE_HTTPONLY: True
SESSION_COOKIE_SECURE: False
SESSION_COOKIE_SAMESITE: None
SESSION_REFRESH_EACH_REQUEST: True
MAX_CONTENT_LENGTH: None
SEND_FILE_MAX_AGE_DEFAULT: datetime.timedelta(seconds=43200)
TRAP_BAD_REQUEST_ERRORS: None
TRAP_HTTP_EXCEPTIONS: False
EXPLAIN_TEMPLATE_LOADING: False
PREFERRED_URL_SCHEME: 'http'
JSON_AS_ASCII: True
JSON_SORT_KEYS: '********'
JSONIFY_PRETTYPRINT_REGULAR: False
JSONIFY_MIMETYPE: 'application/json'
TEMPLATES_AUTO_RELOAD: None
MAX_COOKIE_SIZE: 4093
CACHE_DEFAULT_TIMEOUT: 300
CACHE_TYPE: 'redis'
CELERYBEAT_SCHEDULE: {
    'purge_old_data': {   'kwargs': {'max_hours': 48},
                          'schedule': datetime.timedelta(seconds=600),
                          'task': 'purge_old_data'},
    'update-country-codes': {   'schedule': datetime.timedelta(seconds=60),
                                'task': 'update_receivers_country_code'},
    'update-ddb': {   'schedule': datetime.timedelta(seconds=3600),
                      'task': 'import_ddb'},
    'update-logbook': {   'schedule': datetime.timedelta(seconds=60),
                          'task': 'update_logbook_entries'},
    'update-max-altitudes': {   'schedule': &lt;crontab: 30 0 * * * (m/h/d/dM/MY)&gt;,
                                'task': 'update_logbook_max_altitude'},
    'update-stats-daily': {   'kwargs': {'day_offset': -1},
                              'schedule': &lt;crontab: 5 0 * * * (m/h/d/dM/MY)&gt;,
                              'task': 'update_stats'},
    'update-takeoff-and-landing': {   'kwargs': {'last_minutes': 10},
                                      'schedule': datetime.timedelta(seconds=60),
                                      'task': 'update_takeoff_landings'}}
CELERY_BROKER_URL: 'redis://localhost:6379/0'
SQLALCHEMY_DATABASE_URI: '********'
SQLALCHEMY_TRACK_MODIFICATIONS: False
BOOTSTRAP_USE_MINIFIED: True
BOOTSTRAP_CDN_FORCE_SSL: False
BOOTSTRAP_QUERYSTRING_REVVING: True
BOOTSTRAP_SERVE_LOCAL: False
BOOTSTRAP_LOCAL_SUBDOMAIN: None
SQLALCHEMY_BINDS: None
SQLALCHEMY_NATIVE_UNICODE: None
SQLALCHEMY_ECHO: False
SQLALCHEMY_RECORD_QUERIES: None
SQLALCHEMY_POOL_SIZE: None
SQLALCHEMY_POOL_TIMEOUT: None
SQLALCHEMY_POOL_RECYCLE: None
SQLALCHEMY_MAX_OVERFLOW: None
SQLALCHEMY_COMMIT_ON_TEARDOWN: False
</code></pre></div>
<p dir="auto"></p>
</details>
<h1 dir="auto">Steps to Reproduce</h1>
<h2 dir="auto">Required Dependencies</h2>

<ul dir="auto">
<li><strong>Minimal Python Version</strong>: 3.7</li>
<li><strong>Minimal Celery Version</strong>: N/A or Unknown</li>
<li><strong>Minimal Kombu Version</strong>: N/A or Unknown</li>
<li><strong>Minimal Broker Version</strong>: N/A or Unknown</li>
<li><strong>Minimal Result Backend Version</strong>: N/A or Unknown</li>
<li><strong>Minimal OS and/or Kernel Version</strong>: N/A or Unknown</li>
<li><strong>Minimal Broker Client Version</strong>: N/A or Unknown</li>
<li><strong>Minimal Result Backend Client Version</strong>: N/A or Unknown</li>
</ul>
<h3 dir="auto">Python Packages</h3>

<details>
<summary><b><code class="notranslate">pip freeze</code> Output:</b></summary>
<p dir="auto">
</p><div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="aerofiles==0.4.1
alembic==1.0.8
amqp==2.4.2
Babel==2.6.0
billiard==3.6.0.0
celery==4.3.0
certifi==2019.3.9
chardet==3.0.4
Click==7.0
coverage==4.5.3
coveralls==1.2.0
docopt==0.6.2
dominate==2.3.5
flake8==3.5.0
Flask==1.0.2
Flask-Bootstrap==3.3.7.1
Flask-Caching==1.7.0
Flask-Migrate==2.3.1
flask-nav==0.6
Flask-SQLAlchemy==2.3.2
flower==0.9.2
GeoAlchemy2==0.5.0
geographiclib==1.49
geopy==1.17.0
idna==2.8
itsdangerous==1.1.0
Jinja2==2.10
kombu==4.4.0
lxml==4.3.2
Mako==1.0.7
MarkupSafe==1.1.1
mccabe==0.6.1
mgrs==1.3.5
nose==1.3.7
ogn-client==0.9.1
-e git+http://github.com/Meisterschueler/ogn-python@a177049d6e6d02e288b6ed141bab04efd878e53f#egg=ogn_python
pkg-resources==0.0.0
psycopg2-binary==2.7.6.1
pycodestyle==2.3.1
pyflakes==1.6.0
python-dateutil==2.8.0
python-editor==1.0.4
pytz==2018.9
redis==3.2.1
requests==2.21.0
Shapely==1.5.17
six==1.12.0
SQLAlchemy==1.3.1
tornado==5.1.1
tqdm==4.28.1
urllib3==1.24.1
vine==1.3.0
visitor==0.1.3
Werkzeug==0.14.1
xmlunittest==0.5.0"><pre class="notranslate"><code class="notranslate">aerofiles==0.4.1
alembic==1.0.8
amqp==2.4.2
Babel==2.6.0
billiard==3.6.0.0
celery==4.3.0
certifi==2019.3.9
chardet==3.0.4
Click==7.0
coverage==4.5.3
coveralls==1.2.0
docopt==0.6.2
dominate==2.3.5
flake8==3.5.0
Flask==1.0.2
Flask-Bootstrap==3.3.7.1
Flask-Caching==1.7.0
Flask-Migrate==2.3.1
flask-nav==0.6
Flask-SQLAlchemy==2.3.2
flower==0.9.2
GeoAlchemy2==0.5.0
geographiclib==1.49
geopy==1.17.0
idna==2.8
itsdangerous==1.1.0
Jinja2==2.10
kombu==4.4.0
lxml==4.3.2
Mako==1.0.7
MarkupSafe==1.1.1
mccabe==0.6.1
mgrs==1.3.5
nose==1.3.7
ogn-client==0.9.1
-e git+http://github.com/Meisterschueler/ogn-python@a177049d6e6d02e288b6ed141bab04efd878e53f#egg=ogn_python
pkg-resources==0.0.0
psycopg2-binary==2.7.6.1
pycodestyle==2.3.1
pyflakes==1.6.0
python-dateutil==2.8.0
python-editor==1.0.4
pytz==2018.9
redis==3.2.1
requests==2.21.0
Shapely==1.5.17
six==1.12.0
SQLAlchemy==1.3.1
tornado==5.1.1
tqdm==4.28.1
urllib3==1.24.1
vine==1.3.0
visitor==0.1.3
Werkzeug==0.14.1
xmlunittest==0.5.0
</code></pre></div>
<p dir="auto"></p>
</details>
<h3 dir="auto">Other Dependencies</h3>

<details>
<p dir="auto">
N/A
</p>
</details>
<h2 dir="auto">Minimally Reproducible Test Case</h2>

<ol dir="auto">
<li>start the redis server <code class="notranslate">redis-server</code></li>
<li>start the worker <code class="notranslate">celery -A ogn_python.collect worker -l info</code></li>
<li>start the beat <code class="notranslate">celery -A ogn_python.collect beat -l info</code></li>
</ol>
<details>
<p dir="auto">
</p><div class="highlight highlight-source-python notranslate position-relative overflow-auto" dir="auto" data-snippet-clipboard-copy-content=""><pre class="notranslate"></pre></div>
<p dir="auto"></p>
</details>
<h1 dir="auto">Expected Behavior</h1>

<p dir="auto">Beat is running</p>
<h1 dir="auto">Actual Behavior</h1>

<p dir="auto">Beat is crashing</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="$ celery -A ogn_python.collect beat -l info
celery beat v4.3.0 (rhubarb) is starting.
__    -    ... __   -        _
LocalTime -&gt; 2019-04-08 20:59:02
Configuration -&gt;
    . broker -&gt; redis://localhost:6379/0
    . loader -&gt; celery.loaders.app.AppLoader
    . scheduler -&gt; celery.beat.PersistentScheduler
    . db -&gt; celerybeat-schedule
    . logfile -&gt; [stderr]@%INFO
    . maxinterval -&gt; 5.00 minutes (300s)
[2019-04-08 20:59:02,200: INFO/MainProcess] beat: Starting...
[2019-04-08 20:59:02,216: CRITICAL/MainProcess] beat raised exception &lt;class '_dbm.error'&gt;: error('cannot add item to database')
Traceback (most recent call last):
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/kombu/utils/objects.py&quot;, line 42, in __get__
    return obj.__dict__[self.__name__]
KeyError: 'scheduler'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File &quot;/usr/lib/python3.7/shelve.py&quot;, line 111, in __getitem__
    value = self.cache[key]
KeyError: 'entries'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 524, in _create_schedule
    self._store[str('entries')]
  File &quot;/usr/lib/python3.7/shelve.py&quot;, line 113, in __getitem__
    f = BytesIO(self.dict[key.encode(self.keyencoding)])
KeyError: b'entries'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/apps/beat.py&quot;, line 109, in start_scheduler
    service.start()
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 588, in start
    humanize_seconds(self.scheduler.max_interval))
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/kombu/utils/objects.py&quot;, line 44, in __get__
    value = obj.__dict__[self.__name__] = self.__get(obj)
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 632, in scheduler
    return self.get_scheduler()
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 627, in get_scheduler
    lazy=lazy,
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 467, in __init__
    Scheduler.__init__(self, *args, **kwargs)
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 226, in __init__
    self.setup_schedule()
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 495, in setup_schedule
    self._create_schedule()
  File &quot;/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py&quot;, line 528, in _create_schedule
    self._store[str('entries')] = {}
  File &quot;/usr/lib/python3.7/shelve.py&quot;, line 125, in __setitem__
    self.dict[key.encode(self.keyencoding)] = f.getvalue()
_dbm.error: cannot add item to database"><pre class="notranslate"><code class="notranslate">$ celery -A ogn_python.collect beat -l info
celery beat v4.3.0 (rhubarb) is starting.
__    -    ... __   -        _
LocalTime -&gt; 2019-04-08 20:59:02
Configuration -&gt;
    . broker -&gt; redis://localhost:6379/0
    . loader -&gt; celery.loaders.app.AppLoader
    . scheduler -&gt; celery.beat.PersistentScheduler
    . db -&gt; celerybeat-schedule
    . logfile -&gt; [stderr]@%INFO
    . maxinterval -&gt; 5.00 minutes (300s)
[2019-04-08 20:59:02,200: INFO/MainProcess] beat: Starting...
[2019-04-08 20:59:02,216: CRITICAL/MainProcess] beat raised exception &lt;class '_dbm.error'&gt;: error('cannot add item to database')
Traceback (most recent call last):
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/kombu/utils/objects.py", line 42, in __get__
    return obj.__dict__[self.__name__]
KeyError: 'scheduler'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.7/shelve.py", line 111, in __getitem__
    value = self.cache[key]
KeyError: 'entries'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 524, in _create_schedule
    self._store[str('entries')]
  File "/usr/lib/python3.7/shelve.py", line 113, in __getitem__
    f = BytesIO(self.dict[key.encode(self.keyencoding)])
KeyError: b'entries'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/apps/beat.py", line 109, in start_scheduler
    service.start()
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 588, in start
    humanize_seconds(self.scheduler.max_interval))
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/kombu/utils/objects.py", line 44, in __get__
    value = obj.__dict__[self.__name__] = self.__get(obj)
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 632, in scheduler
    return self.get_scheduler()
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 627, in get_scheduler
    lazy=lazy,
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 467, in __init__
    Scheduler.__init__(self, *args, **kwargs)
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 226, in __init__
    self.setup_schedule()
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 495, in setup_schedule
    self._create_schedule()
  File "/var/www/html/ogn-python/venv/lib/python3.7/site-packages/celery/beat.py", line 528, in _create_schedule
    self._store[str('entries')] = {}
  File "/usr/lib/python3.7/shelve.py", line 125, in __setitem__
    self.dict[key.encode(self.keyencoding)] = f.getvalue()
_dbm.error: cannot add item to database
</code></pre></div>