I’ve met a similiar problem when training on kaggle kernel. The system memory will always increase step by step and epoch by epoch, I haved checked and compared the code in my notebook with others (that works fine) but I still can’t find a reason.
I think it’s better to reply here than open up a new thread. Here is the original post containing code source, wandb log information and more: stack overflow 39. I post it on stack overflow because I have also used pytorch lightning so maybe it’s not a pure pytorch problem. But it’s also great if I can know that pytorch is clean in this case. Thanks