Hi @Constantin, it’s possible that you’re getting allocated one of the K80 GPUs on Colab which probably doesn’t have enough RAM to handle xlm-roberta-large.
You can “cheat” you way to a better GPU (either Tesla T4 or P100) by selecting Runtime > Factory reset runtime in the settings:

Screen Shot 2021-03-11 at 8.58.12 pm2150×1364 316 KB

You can check what kind of GPU your notebook is running by executing the following in a code cell:
!nvidia-smi