I’m running an embedding model. I have a embedding model that I am trying to train where the training loss and validation loss does not go down but remain the same during the whole training of 1000 epoch. while i’m also using: lr = 0.001,  optimizer=SGD.

2019-09-20_0935.png353×640 8.93 KB