Just to add to Ekaterina’s answer, this tutorial might also be helpful:

  
      

      TensorFlow
  

  
    

Transformer model for language understanding  |  Text  | ... 1



  

  
    
    
  

  


@markdaoust can you share any insight here?