I have attached a Colab notebook which uses a different preprocessing method. I am using the same preprocessing of SQuAD as given in the huggingface documentation. The model architecture remains unchanged. I am facing the same issue though.

  
      
      colab.research.google.com
  
  
    

Google Colaboratory 48