I’m experiencing severe memory leaks in my DDPG algorithm found here 1.
Even after the first couple episodes, my RAM usage goes up by almost a whole gb.
I’ve tried shutting off different parts of my code such as putting no_grad() wherever possible, limiting my replay buffer to only 500 entries which will definitely not reach the memory usages I am seeing, and just not training the agent at all and only doing inference.
I’ve also tried using other versions of torch such as 1.3 but the result is the same.
Please help, any direction is appreciated. I understand that this is not a debugging session, but I appreciate any help at all