What are the standard ways of profiling memory in pytorch?
I have a model, and I want to find out where the memory is spent during training. I can iterate over gc.get_objects, but only tensors are included there. I think, most of the memory is spent on backprop data. Is there any way to find out how much memory is consumed on backprop?
Thanks,
Kostya