These two blog posts might help

  
      
      Medium – 17 Jun 20
  
  
    

Accelerate your NLP pipelines using Hugging Face Transformers and ONNX Runtime 25

This post was written by Morgan Funtowicz from Hugging Face and Tianlei Wu from Microsoft

  Reading time: 6 min read
    

  
  
    
    
  
  



  
      
      Medium – 31 Aug 20
  
  
    

Faster and smaller quantized NLP with Hugging Face and ONNX Runtime 37

Popular Hugging Face Transformer models (BERT, GPT-2, etc) can be shrunk and accelerated with ONNX Runtime quantization without retraining.

  Reading time: 6 min read