For cc25. I am working with mostly german and some french and italian docs and if I don’t freeze embeds than mbart-large-cc25 does not fit into the 16GB V100 (which is the largest Google Cloud has for a single GPU). Not even with batch size 1. So I thought I try a smaller mBART. But yes, TPU would be even more awesome because I could experiment with a lot more then.