Hi did lower the learning rate for the last layer but it didn’t perform much better. If I unfreeze the layers and set a very low learning rate the model performs much better. In terms of transformations I simply did normalization and toTensor.