<h3 dir="auto">Feature request</h3>
<p dir="auto">Whisper speech recognition without conditioning on previous text.<br>
As in <a href="https://github.com/openai/whisper/blob/7858aa9c08d98f75575035ecd6481f462d66ca27/whisper/transcribe.py#L278">https://github.com/openai/whisper/blob/7858aa9c08d98f75575035ecd6481f462d66ca27/whisper/transcribe.py#L278</a></p>
<h3 dir="auto">Motivation</h3>
<p dir="auto">Whisper implementation is great however conditioning the decoding on previous text can cause significant hallucination and repetitive text, e.g.:</p>
<blockquote>
<p dir="auto">"Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice? Do you have malpractice?"</p>
</blockquote>
<p dir="auto">Running openai's model with <code class="notranslate">--condition_on_previous_text False</code> drastically reduces hallucination</p>
<p dir="auto"><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ArthurZucker/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ArthurZucker">@ArthurZucker</a></p>
<p dir="auto">Hello,<br>
I tried to import this:</p>
<p dir="auto"><code class="notranslate">from transformers import AdamW, get_linear_schedule_with_warmup</code><br>
but got error : model not found<br>
but when i did this, it worked:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="from transformers import AdamW
from transformers import WarmupLinearSchedule as get_linear_schedule_with_warmup"><pre class="notranslate"><code class="notranslate">from transformers import AdamW
from transformers import WarmupLinearSchedule as get_linear_schedule_with_warmup
</code></pre></div>
<p dir="auto">however when I set the scheduler like this :</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="scheduler = get_linear_schedule_with_warmup(optimizer, num_warmup_steps=args.warmup_steps, num_training_steps=t_total) "><pre class="notranslate"><code class="notranslate">scheduler = get_linear_schedule_with_warmup(optimizer, num_warmup_steps=args.warmup_steps, num_training_steps=t_total) 
</code></pre></div>
<p dir="auto">I got this error :</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="__init__() got an unexpected keyword argument 'num_warmup_steps'"><pre class="notranslate"><code class="notranslate">__init__() got an unexpected keyword argument 'num_warmup_steps'
</code></pre></div>