I am having another problem now. I am training the model but the loss is going up and down repeatedly. It’s not decreasing or converging. I tried to decrease the learning rate but it didn’t work.
Here’s the loss plot at lr = 1e-3 for 30 epochs:-

Here’s the loss plot at lr = 1e-6 for 30 epochs:-

Here’s the loss plot at lr = 1e-9 for 30 epochs:-