I have the exact same question. I can not seem to locate any documentation on how pytorch reserves memory and the general information regarding memory allocation seems pretty scant.
I’m also experiencing Cuda Out of Memory errors when only half my GPU memory is being utilised (“reserved”).