9http://www.voxforge.org/

62

Mehrish et al.

conventional cascade system, the feasibility of the end-to-end direct speech-to-speech translation
was demonstrated [219].

In a recent publication from 2020, researchers presented a study on an end-to-end speech
translation system. This system incorporates pre-trained models such as Wav2Vec 2.0 and mBART,
along with coupling modules between the encoder and decoder. The study also introduces an
efficient fine-tuning technique, which selectively trains only 20% of the total parameters [622]. The
system developed by the UPC Machine Translation group actively participated in the IWSLT 2021
offline speech translation task, which aimed to develop a system capable of translating English
audio recordings from TED talks into German text.
AReviewofDeepLearningTechniquesforSpeechProcessing