Table D11: Detailed configurations for the audio models used in our experiments.

VB-En

VB-Multi

Model Dimension
Number of Heads
Number of Layers
Feedforward Dimension
Attention Dropout
Activation Dropout
ConvPos Width
ConvPos Groups
ConvPos Depth
Skip Connections
Alibi Bias

Model Parameters
1024
16
24
4096
0.0
0.1
31
16
2
true
true
Training Parameters

1024
16
24
4096
0.0
0.1
31
16
2
true
true

Number of Iterations
Number of GPUs
Learning Rate (LR)
Gradient Clipping Value
LR Scheduler Warmup Steps
Loss Masking

500000
32
0.0001
0.2
5000
true
Data Parameters

Tokens per Batch
Conditional Dropout
Position Dependent Phones
Phoneme Mask Percent
Spectrogram Mask Percent
Spectrogram Drop Percentage
Chunk Length
Transform Type
Mean
Standard Deviation
Upsampling β

7500
0.2
true
0.0, 0.0
0.7, 1.0
0.3
1600
normalize
-5.884
2.261
-

750000
32
0.0001
0.2
5000
true

7500
0.2
true
0.0, 0.0
0.7, 1.0
0.3
1600
normalize
-5.884
2.261
0.25

31
Voicebox-Text-GuidedMultilingual UniversalSpeechGenerationatScale