Just tried to train freshly and count different object increment. I can see the number of tensors increased significantly over time. The most use of tensors is in ppo_agent.py - https://github.com/weicheng113/PongPPO/blob/master/ppo_agent.py 4. It is a simple file, only containing a few lines of code. I could not see any suspicious mis-use of tensors.

image.jpg1326×1308 302 KB