I have a TF1.14 text classification problem, where each text is short since they are from social media. It uses a standard Transformer architecture from the Bert github:

  
      

      github.com
  

  
    

GitHub - google-research/bert: TensorFlow code and pre-trained models for BERT 3


  TensorFlow code and pre-trained models for BERT. Contribute to google-research/bert development by creating an account on GitHub.

  

  
    
    
  

  


In predictions, some text takes up to 70 ms, and most takes around 20 ms. I am running the predictions for each single example.
Is this normal for Bert’s prediction for a typical text classificsation?