And can you please specify which one https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html 22 is using? Thanks for the response. I assume the link I am sharing is using finetuning and is not backproping the result of new last layers classification through the entire pre-trained resnet. Also, from what 1) says, it seems the link is not doing a good job? because we have small dataset and we are fine-tuning a convnet? The PyTorch tutorial on transfer learning and 1) now seems contradictory to me. Can you please explain if I am wrong?