Hi Guys,
I am experiencing memory leak in my PongDeterministicV4 PPO experiments. I can recreate the constant memory increasing issue with the half-way saved model easily, but I could not be able to locate the issue. With brand new start, the memory start to increase significantly after 100 episodes. I tried pympler tool and it looked to me that the memory used by other objects are ok.
If you run the training with half-way saved model, you will be able to get 10GB memory usage within 15 episodes.
The repository is here - https://github.com/weicheng113/PongPPO 8
I will paste the screenshots next. I spent a week trying to locate the issue, but have not got any luck yet. Thanks in advance.
Cheng