We currently do not fully support converting a pytorch quantized model to ONNX format. The current support is limited to running a subset of operators in Caffe2 via ONNX (converted from PT).
You could try checking out quantization in the ONNX framework, maybe they have ways to convert a quantized PT model to ONNX format.