pritamdamania87:

hat is the 2GB additional overhead in comparison


Its a lot higher when compared to another HPC server I use (which usually is at 980 MB overhead), but it is using a different CUDA version, and more importantly an unoptimized version of PyTorch which is the likely culprit.
Should it not be reduced with gradient_as_bucket_view? Or am I just confused with the parameter?