Converting quantized model to ONNX, isn’t supported fully yet. I believe it’s an experimental feature??
It could be a few things, but I’d have suggest you test the PyTorch, then ONNX, and finally the CoreML. Pin down the problem.
Can you share the Jupiter notebook on the left?
I want to try it to make sure it’s not an issue related to the size of your input dummy variable.