Glad you like it!
I used to do these things line-by-line, manually printing the memory usage, printing the tensor size, etc. I think by building such a library I can save people’s time from adding and deleting logging codes for many scenarios.
There are some memories allocated by pytorch that I cannot touch using pure python. It requires some code changes to make it work natively with pytorch.