Deep Learning, Pytorch, Fine Tuning, Computer Vision, Transfer Learning.
help preserve the learned representations, preventing them from being overwritten. In this case, only the model’s head is modified and trained from scratch. On the other hand, freezing only a portion of the network can be useful when the pre-trained model’s lower layers capture general features