hi,
When I try to train a model using Pytorch 1.0.0 with 8GPUs, I get the error as below:
‘’’
RuntimeError: CUDA out of memory. Tried to allocate 30.38 MiB (GPU 0; 15.75 GiB total capacity; 7.41 GiB already allocated; 8.94 MiB free; 40.77 MiB cached)
‘’’
And it not always happens, sometimes it can successfully run, but sometimes it throws the CUDA out of memory error.
It seems there is enough memory(15.75 GiB total, only 7.41 GiB used, tried to allocate 30 MiB).
Do anyone know how to solve it?