I tried to fine-tune VGG16 by only training the last FC layer. When i use requires _grad = False for previous layers, it converges and output reasonable results. But when i set learning rates of previous layers to 0 and keep the same learning rate for the last layer, it fails to converge.
Any difference between these two ways?