@rgwatwormhill thanks for your response. For some reason, the issue randomly disappeared after a few hours. Since colab attributes GPUs randomly, maybe I was unlucky with the amount of RAM of the GPUs I had received (even after a factory reset).
I will try your suggestions if it reappears.