Could you try to reduce the batch size and rerun the code to eliminate the possibility that you are running out of memory and cublas is just reporting this unhelpful error?
I’m not sure, if there is a proper way to see the GPU memory in Colab, but this might be another way to check for the potential OOM issue.