I’m running into a similar issue. Here is the error.
RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 11.17 GiB total capacity; 199.97 MiB already allocated; 8.69 MiB free; 210.00 MiB reserved in total by PyTorch)
Clearly my GPU has enough memory to allocate 20.00 MiB. The limit seems to be set by the amount “reserved in total by PyTorch”. And this amount seems absurdly low to me.
@jon @david-macleod I’d be curious to hear your thoughts on whether this scenario is consistent with your interpretation of these memory specs. If so what would you recommend to fix it. Or if anyone else has an explanation or solution.