license: mit | |
language: | |
- en | |
tags: | |
- onnx | |
- quantization | |
This repository contains quantized T5-large model. This model is 5x lesser than the T5-large model and also the inference time has been reduced by 3x on CPU, whilst giving impressive results. |