<h1 dir="auto">Checklist</h1>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/issues?utf8=%E2%9C%93&amp;q=is%3Aissue+label%3A%22Category%3A+Documentation%22+">issues list</a><br>
for similar or identical bug reports.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/pulls?q=is%3Apr+label%3A%22Category%3A+Documentation%22">pull requests list</a><br>
for existing proposed fixes.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have checked the <a href="https://github.com/celery/celery/commits/master">commit log</a><br>
to find out if the bug was already fixed in the master branch.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox" checked=""> I have included all related issues and possible duplicate issues in this issue<br>
(If there are none, check this box anyway).</li>
</ul>
<h2 dir="auto">Related Issues and Possible Duplicates</h2>

<h1 dir="auto">Description</h1>
<p dir="auto"><a href="https://docs.celeryproject.org/en/stable/userguide/extending.html#extending-commandoptions" rel="nofollow">https://docs.celeryproject.org/en/stable/userguide/extending.html#extending-commandoptions</a></p>
<p dir="auto">The described code no longer works in celery 5+</p>
<p dir="auto">Looking at celery's source code, 'user_options' are now expected to be a set(). In fact they are initialized to a defaultdict(set())</p>
<p dir="auto">I believe that one should provide a click.option, but when i tried that things still fell apart as click is later accessing whatever is provided.opts</p>
<h1 dir="auto">Suggestions</h1>

<p dir="auto">Upgrade the documentation to support click or modify the code to allow the above example to work</p>
<p dir="auto">Use case Scenario: Process Millions of files from S3</p>
<p dir="auto">Approach:</p>
<ul dir="auto">
<li>List S3 Inventory (Task)<br>
** Split small chunks (Task)<br>
** Each chunk, read n(1000s) of files and process it (Long running Task)</li>
</ul>
<p dir="auto">My issue is with the <code class="notranslate">int</code> math of pre_fetch_count = concurrency * prefetch limit where I have to only one option, if my concurrency increases, so will my prefetch limit.</p>
<p dir="auto">Is there a way to directly affect the number of Prefetch count after the math ? or is there a workaround ?</p>
<p dir="auto">I want to use Gevent/Eventlet for fetching S3 objects but do not want to pre-fetch more than 1 task at the time.</p>

<h1 dir="auto">Checklist</h1>

<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have checked the <a href="https://github.com/celery/celery/issues?utf8=%E2%9C%93&amp;q=is%3Aissue+label%3A%22Category%3A+Documentation%22+">issues list</a><br>
for similar or identical bug reports.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have checked the <a href="https://github.com/celery/celery/pulls?q=is%3Apr+label%3A%22Category%3A+Documentation%22">pull requests list</a><br>
for existing proposed fixes.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have checked the <a href="https://github.com/celery/celery/commits/master">commit log</a><br>
to find out if the bug was already fixed in the master branch.</li>
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> I have included all related issues and possible duplicate issues in this issue<br>
(If there are none, check this box anyway).</li>
</ul>
<h2 dir="auto">Related Issues and Possible Duplicates</h2>

<h4 dir="auto">Related Issues</h4>
<ul dir="auto">
<li>None</li>
</ul>
<h4 dir="auto">Possible Duplicates</h4>
<ul dir="auto">
<li>None</li>
</ul>
<h1 dir="auto">Description</h1>

<h1 dir="auto">Suggestions</h1>