Hi, I was playing with pytorch trying to find how much space some things occupy in VRAM using this script 2 and found that when I first send anything to the GPU, I get a fixed memory usage (seen through nvidia-smi) of around 1284MB 2.
Was wondering what it is due to? I would’ve guessed the cuda runtime sits in normal RAM, but it seems to also occupy space in VRAM? Though I am not understanding how that would work.
Thanks!