Hey, i’ve changed qconfig to torch.quantization.get_default_qconfig(‘qnnpack’) and error RuntimeError: self.qscheme() == at::kPerTensorAffine INTERNAL ASSERT FAILED is not an issue any more. This is just workaround.
Now i have an error KeyError: ‘conv2d_relu’ after small changed.
I fused layers for static quantization and it seems onnx doesn’t support fused layers in this format.  https://github.com/onnx/onnx/blob/master/docs/Operators.md#Conv 8
This key doesn’t exist in symbolic_opset (any) so i don’t expect it would work.