gphilip:

should


You think those other things could increase the memory burden roughly x20?
Regarding your Suggestions:
I have tried increasing the batch size slowly, it works with very small batch sizes like 10 I think.
And yes I’ve checked with nvidia-smi, I’m the only one using this machine and there are no zombie processes.
Extra Context:
Also I noticed there could be a memory leak in my code, in the sense that the mini batch tensor is reallocated at each update step & it may not be garbage collected quickly enough. Still I tried fixing this with a reusable mini-batch Tensor and it still didn’t work…