Hi,
the VRAM usage reported by nvidia-smi includes memory occupied by the pytorch caching allocator. Is it possible to disable the caching allocator to get the actual memory usage without caching?
Thanks,
Stefan