title: E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
summary: This paper introduces Embarrassingly Easy Text-to-Speech (E2 TTS), a fully
  non-autoregressive zero-shot text-to-speech system that offers human-level
  naturalness and state-of-the-art speaker similarity and intelligibility. In the
  E2 TTS framework, the text input is converted into a character sequence with
  filler tokens. The flow-matching-based mel spectrogram generator is then
  trained based on the audio infilling task. Unlike many previous works, it does
  not require additional components (e.g., duration model, grapheme-to-phoneme)
  or complex techniques (e.g., monotonic alignment search). Despite its
  simplicity, E2 TTS achieves state-of-the-art zero-shot TTS capabilities that
  are comparable to or surpass previous works, including Voicebox and
  NaturalSpeech 3. The simplicity of E2 TTS also allows for flexibility in the
  input representation. We propose several variants of E2 TTS to improve
  usability during inference. See https://aka.ms/e2tts/ for demo samples.
paper_authors._id: 66835ca7e365c0f6665a5478
paper_authors.name: Sefik Emre Eskimez
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-08-15T10:12:38.419Z
paper_authors._id: 65cbadf9ab05dc46afbac58c
paper_authors.avatarUrl: /avatars/edf45a05c1dfafa35921a63d649573bd.svg
paper_authors.fullname: Sefik Emre Eskimez
paper_authors.type: user
paper_authors.user: emreeskimez
paper_authors._id: 66835ca7e365c0f6665a5479
paper_authors.name: Xiaofei Wang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-02T07:39:05.021Z
paper_authors._id: 64dc191bc307ee5369fbcb04
paper_authors.avatarUrl: /avatars/5a8a0db63a187e85d4ae2fff93a838f0.svg
paper_authors.fullname: Xiaofei Wang
paper_authors.type: user
paper_authors.user: xiaofei-wang
paper_authors._id: 66835ca7e365c0f6665a547a
paper_authors.name: Manthan Thakker
paper_authors._id: 66835ca7e365c0f6665a547b
paper_authors.name: Canrun Li
paper_authors._id: 66835ca7e365c0f6665a547c
paper_authors.name: Chung-Hsien Tsai
paper_authors._id: 66835ca7e365c0f6665a547d
paper_authors.name: Zhen Xiao
paper_authors._id: 66835ca7e365c0f6665a547e
paper_authors.name: Hemin Yang
paper_authors._id: 66835ca7e365c0f6665a547f
paper_authors.name: Zirun Zhu
paper_authors._id: 66835ca7e365c0f6665a5480
paper_authors.name: Min Tang
paper_authors._id: 66835ca7e365c0f6665a5481
paper_authors.name: Xu Tan
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-08-28T13:47:19.699Z
paper_authors._id: 5f1040b6e9d71719e3be71d2
paper_authors.avatarUrl: /avatars/a2f28940236ae625ed3810ad62e343ff.svg
paper_authors.fullname: Xu Tan
paper_authors.type: user
paper_authors.user: xutan
paper_authors._id: 66835ca7e365c0f6665a5482
paper_authors.name: Yanqing Liu
paper_authors._id: 66835ca7e365c0f6665a5483
paper_authors.name: Sheng Zhao
paper_authors._id: 66835ca7e365c0f6665a5484
paper_authors.name: Naoyuki Kanda
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-02T07:39:06.943Z
paper_authors._id: 64dbe5247f749b6e346663f5
paper_authors.avatarUrl: /avatars/d5c7f542c1fdb31eb49478afbb3dd08d.svg
paper_authors.fullname: Naoyuki Kanda
paper_authors.type: user
paper_authors.user: naoyuki82
paper_title: E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
paper_summary: This paper introduces Embarrassingly Easy Text-to-Speech (E2 TTS), a fully
  non-autoregressive zero-shot text-to-speech system that offers human-level
  naturalness and state-of-the-art speaker similarity and intelligibility. In the
  E2 TTS framework, the text input is converted into a character sequence with
  filler tokens. The flow-matching-based mel spectrogram generator is then
  trained based on the audio infilling task. Unlike many previous works, it does
  not require additional components (e.g., duration model, grapheme-to-phoneme)
  or complex techniques (e.g., monotonic alignment search). Despite its
  simplicity, E2 TTS achieves state-of-the-art zero-shot TTS capabilities that
  are comparable to or surpass previous works, including Voicebox and
  NaturalSpeech 3. The simplicity of E2 TTS also allows for flexibility in the
  input representation. We propose several variants of E2 TTS to improve
  usability during inference. See https://aka.ms/e2tts/ for demo samples.
paper_ai_keywords: non-autoregressive text-to-speech (TTS) character sequence filler tokens flow-matching-based mel spectrogram generator audio infilling task grapheme-to-phoneme monotonic alignment search state-of-the-art zero-shot TTS Voicebox Natural Voice 3 input Representation neural network inference