3.3.2 Application
Recent advancements in NLP which lead to a paradigm shift in the field are highly attributed to
the foundation models that are primarily a part of the transformers category, with self-attention
being a key ingredient [42]. The recent models have demonstrated human-level performance in
several professional and academic benchmarks. For instance, GPT4 scored within the top 10% of
test takers on a simulated version of the Uniform Bar Examination [405]. While speech processing
has not yet seen a shift in paradigm as in NLP owing to the capabilities of foundational models,
even so, transformers have significantly contributed to advancement in the field including but not
limited to the following tasks: automatic speech recognition, speech translation, speech synthesis,
and speech enhancement, most of which we discuss in detail in Section 5.
AReviewofDeepLearningTechniquesforSpeechProcessing