WER

SIM-o

WER

SIM-o

sp

non-sp

sp

non-sp

sp

non-sp

sp

non-sp

SNR=-10dB, overlap=30%
26.7
20.5

0.202
0.247

24.9
19.7

0.238
0.247

SNR=10dB, overlap=30%
3.7
3.2

3.1
2.8

0.603
0.567

SNR=-10dB, overlap=50%
43.6
34.3

0.256
0.291

40.8
32.5

0.292
0.288

SNR=10dB, overlap=50%
4.5
3.8

3.8
3.3

0.649
0.613

SNR=-10dB, overlap=70%
60.0
49.5

0.260
0.293

56.0
45.4

0.303
0.294

SNR=10dB, overlap=70%
6.3
4.6

4.6
3.8

0.592
0.564

0.605
0.570
same as left
same as left

0.649
0.616
same as left
same as left

0.595
0.572
same as left
same as left

Noisy speech
Demucs
A3T
VB-En (α = 0.7)

Noisy speech
Demucs
A3T
VB-En (α = 0.7)

Noisy speech
Demucs
A3T
VB-En (α = 0.7)

7.5
2.2

11.5
2.0

16.6
2.0

B.3 Choice of audio model output features

The performance of our model is upper bounded by how well the chosen acoustic features can be
reconstructed to waveform. The reconstruction performance is determined jointly by the encoding

0.058
0.566

0.064
0.612

0.063
0.559

24
Voicebox-Text-GuidedMultilingual UniversalSpeechGenerationatScale