fbgemm does have a reduce_range config: pytorch/qconfig.py at master · pytorch/pytorch · GitHub, so if you are using qnnpack qconfig and run on fbgemm backends (which is the default backend) I think, it will have overflows. But I’m not sure why setting backend to qnnpack would result in error, did you set the qengine before convert?