Hi everyone,
I got an issue and have tried out all possible solutions found online.
While training a retrained Pegasus Pytorch model on CUDA, I get this error in a couple of minutes when I run the command in the GCP instance.
“RuntimeError: CUDA out of memory. Tried to allocate 16.00 MiB (GPU 0; 7.43 GiB total capacity; 6.71 GiB already allocated; 6.81 MiB free; 6.72 GiB reserved in total by PyTorch)”
I use 5 samples for training and 5 samples for evaluating. The code is run successfully in a local machine without GPU.
Any help would be appreciated.