Hi, I load the Roberta pre-trained model from the transformers library and use it for the sentence-pair classification task. The loss function used to decrease during the training per epoch until the last week, but now even though all of the parameters, including the batch size and the learning rate have the same value, when I train my model the value of the loss function is not decreasing. I am a little bit confused and I have trained my model using various parameters and also I utilized another code in PyTorch, but still, the loss function is not decreasing. Can anyone help me to figure out the problem?
here is the link to my code:

  
      
      colab.research.google.com
  
  
    

Google Colaboratory 42



  
  
    
    
  
  


and the dataset:

  
      
      drive.google.com
  
  
    

wiki - Google Drive 4