I share the following link to Colab environment (pytorch1.10 Nvidia k80): https://colab.research.google.com/drive/15VNZZP1uPdrY4hH0cYbBYdVT_nxWbJVa?usp=sharing 1
you can see the logs with the first and second approach. In the first approach the accuracy is stagnant, however in the second approach, it got improved with the epochs. (in the same way I attach a script to run https://drive.google.com/file/d/1Fb4qc_ksMp-8jeWrb0H8SIDDdiFpwBQ5/view?usp=sharing).
Thanks!