I had the same problem. The main reason is that you try to load all your data into gpu.
A possible solution is to reduce the batch size and load into gpu only few data per time and finally after your computation to send from gpu to cpu your data .cpu(). (but it depends… i don’t know your code).
However, you should pay attention if your GPU is free (because is possible it is busy by another process). Let me know.