y replaced, and l be the original duration. A user first constructs lctx (of the same length as ˆy) by
copying the lengths of phones that are not replaced from l, and set the lengths to 0 for new phones.
The duration of new phones ˆlmis is sampled given lctx and ˆy, and the new duration ˆl = ˆlmis + lctx.
The new frame-level transcript is constructed with ˆz = rep(ˆy, ˆl). Similarly, the audio context xctx
is of the same length as ˆz, and is created by filling frames mapped to unreplaced phones with the
corresponding frames in x, and leaving those for new phones with 0. The frames for the new phones
ˆxmis are sampled given ˆz and xctx. The edited speech is computed as ˆx = ˆxmis + xctx.
Voicebox-Text-GuidedMultilingual UniversalSpeechGenerationatScale