I know, I was facing similar problems too. So after i was done, I wrote this tutorial on fine tuning a pretrained model.
https://github.com/Spandan-Madan/Pytorch_fine_tuning_Tutorial 1.9k
Hope this helps!