Lphn

(cid:16) ˜P t, P t(cid:17)
, St(cid:17)

St′

(cid:16)

p(cid:88)

i=1

=

1
P

(cid:16) ˜P t

CE

i , P t
i

.

(cid:17)
(cid:16) ˜P t, P t(cid:17)

,

L = Lspec

+ λdurLdur + λphnLphn

where λdur and λphn are the weights associated with the duration and phoneme auxiliary losses,
respectively.

The overall loss is given as

3.1 MUSE Embedding
Translatotron3