MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable
  Speaker Encoder
We introduce MiniMax-Speech, an autoregressive Transformer-based
Text-to-Speech (TTS) model that generates high-quality speech. A key innovation
is our learnable speaker encoder, which extracts timbre features from a
reference audio without requiring its transcription. This enables
MiniMax-Speech to produce highly expressive speech with timbre consistent with
the reference in a zero-shot manner, while also supporting one-shot voice
cloning with exceptionally high similarity to the reference voice. In addition,
the overall quality of the synthesized audio is enhanced through the proposed
Flow-VAE. Our model supports 32 languages and demonstrates excellent
performance across multiple objective and subjective evaluations metrics.
Notably, it achieves state-of-the-art (SOTA) results on objective voice cloning
metrics (Word Error Rate and Speaker Similarity) and has secured the top
position on the public TTS Arena leaderboard. Another key strength of
MiniMax-Speech, granted by the robust and disentangled representations from the
speaker encoder, is its extensibility without modifying the base model,
enabling various applications such as: arbitrary voice emotion control via
LoRA; text to voice (T2V) by synthesizing timbre features directly from text
description; and professional voice cloning (PVC) by fine-tuning timbre
features with additional data. We encourage readers to visit
https://minimax-ai.github.io/tts_tech_report for more examples.
68244ea3bfb1b25f60400efd
Bowen Zhang
68244ea3bfb1b25f60400efe
Congchao Guo
68244ea3bfb1b25f60400eff
Geng Yang
68244ea3bfb1b25f60400f00
Hang Yu
68244ea3bfb1b25f60400f01
Haozhe Zhang
68244ea3bfb1b25f60400f02
Heidi Lei
68244ea3bfb1b25f60400f03
Jialong Mai
68244ea3bfb1b25f60400f04
Junjie Yan
admin_assigned
2025-05-14T10:05:37.903Z
63390ce41718795719635b1e
/avatars/ad03a2b349f01c1ac1fedfb95d02d43e.svg
JunjieYan
user
JunjieYan
68244ea3bfb1b25f60400f05
Kaiyue Yang
68244ea3bfb1b25f60400f06
Mingqi Yang
admin_assigned
2025-05-14T10:05:51.310Z
65e29a93e142ecfc09bddf3a
/avatars/70168cae7aef1bb2c00392b926eabb18.svg
Mingqi Yang
user
mqyang1s
68244ea3bfb1b25f60400f07
Peikai Huang
68244ea3bfb1b25f60400f08
Ruiyang Jin
68244ea3bfb1b25f60400f09
Sitan Jiang
68244ea3bfb1b25f60400f0a
Weihua Cheng
68244ea3bfb1b25f60400f0b
Yawei Li
68244ea3bfb1b25f60400f0c
Yichen Xiao
68244ea3bfb1b25f60400f0d
Yiying Zhou
68244ea3bfb1b25f60400f0e
Yongmao Zhang
admin_assigned
2025-05-14T10:06:55.523Z
64b655c3f44a33a87e73b866
/avatars/3a2c58eb10d4cf7040f63ea15284c574.svg
yongmao zhang
user
ymzhang0519
68244ea3bfb1b25f60400f0f
Yuan Lu
68244ea3bfb1b25f60400f10
Yucen He
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable
  Speaker Encoder
We introduce MiniMax-Speech, an autoregressive Transformer-based
Text-to-Speech (TTS) model that generates high-quality speech. A key innovation
is our learnable speaker encoder, which extracts timbre features from a
reference audio without requiring its transcription. This enables
MiniMax-Speech to produce highly expressive speech with timbre consistent with
the reference in a zero-shot manner, while also supporting one-shot voice
cloning with exceptionally high similarity to the reference voice. In addition,
the overall quality of the synthesized audio is enhanced through the proposed
Flow-VAE. Our model supports 32 languages and demonstrates excellent
performance across multiple objective and subjective evaluations metrics.
Notably, it achieves state-of-the-art (SOTA) results on objective voice cloning
metrics (Word Error Rate and Speaker Similarity) and has secured the top
position on the public TTS Arena leaderboard. Another key strength of
MiniMax-Speech, granted by the robust and disentangled representations from the
speaker encoder, is its extensibility without modifying the base model,
enabling various applications such as: arbitrary voice emotion control via
LoRA; text to voice (T2V) by synthesizing timbre features directly from text
description; and professional voice cloning (PVC) by fine-tuning timbre
features with additional data. We encourage readers to visit
https://minimax-ai.github.io/tts_tech_report for more examples.
MiniMax-Speech, an autoregressive Transformer-based TTS model, generates high-quality speech with a learnable speaker encoder that extracts reference speaker features without transcription, achieving SOTA results in voice cloning and supporting various extensions.
autoregressive Transformer Text-to-Speech TTS learnable speaker encoder timbre features zero-shot one-shot voice cloning Flow-VAE disentangled representations LoRA text to voice T2V professional voice cloning PVC