Solved by ptrblck in post #2 
              
              
                A memory usage of ~10GB would be expected for a ResNet50 with the specified input shape. 
Note that the input itself, all parameters, and especially the intermediate forward activations will use device memory. 
While the former two might be small the intermediates (which are needed for the gradient …