This repository looks very promising.

  
      
      github.com
  
  
    

legacyai/tf-transformers 7


  State of the art faster Natural Language Processing in Tensorflow 2.0 .

  
  
    
    
  
  


Benchmarks shows very huge speed up gains in Tensorflow 2.0.
And tons of tutorials to start with. Models are keras fit compatible too.
And Glue score on Albert joint loss also looks good. Some other useful features too.
tf transformer 7