Solved by raoashish10 in post #2 
              
              
                I understood my mistakes with some help from stackoverflow (https://stackoverflow.com/questions/61901144/resnet50-torchvision-implementation-gives-low-accuracy-on-cifar-10) and I am posting a solution which can also be considered as a checklist to check if someone else comes across the same problem …