@nipunsadvilkar, mc4 2 is now available in HF datasets API as well… We can directly use it.
And we got access to TPU VM as well. I have created this channel #roberta-pretraining-marathi on the discord. Let’s talk more there.