@g8a9 They seem to train a bilingual student encoder on parallel data and use MSE as loss against the original ENG text encoder outputs. More info in the paper 2.
If training is done directly in Italian, MSCOCO-it 2 is definitely an option!