Solved by Kushaj in post #2 
              
              
                When it says the input sizes for your network must be same, it means that the images that you input to your model say Resnet should be of same size at every iteration for maximum performance. 
When you enable cudnn benchmark, what it does is, before beginning the training of your model it optimizes …