MasterScrat:

If yes, would there be a way to persist the computational graph to disk? In that case, we could measure the size from there.


No you cannot easily save that.

Is that still the case?

I’m afraid it is still the case right now.
We are working on trying to provide a hacky way to access these attributes here that would allow you to check all the saved Tensors and their size though: Codegen python bindings to access attributes of grad_fn by soulitzer · Pull Request #52451 · pytorch/pytorch · GitHub 16