Hello t.g,
I am facing the same problem now, i.e., “Torch (in version 0.4.0) takes about 2GB CPU RAM upfront when the first cuda/GPU tensor is allocated”.
Therefore, I am kindly asking you how you manage to solve this problem?  b.t.w, what do you mean by “misled by the initial 2GB unaccounted memory”?

image.png758×310 23.1 KB

Looking forward to your reply.
Best,
Changgong