Solved by supriyar in post #18 
              
              
                How are you exporting the quantized model to ONNX? Like previously mentioned we only currently support a custom conversion flow through ONNX to Caffe2 for quantized models. The models aren’t represented in native ONNX format, but a format specific to Caffe2. 
If you wish to export model to caffe2, y…