stas:

Fascinating - the larger the card the less overhead!


I don’t have access to the Xp now so I could remembered wrong :).



 stas:

But the only way to measure the consumed memory by the same code


What do you mean by “measure the consumed memory by code”? If you are looking for how large are the new tensors created by running this segment of code, can’t you just look at the difference of memory_allocated?