depends on which qconfig you are using when you quantize the model, are you suing get_default_qconfig(“fbgemm”) or get_default_qconfig(“qnnpack”)?
If you are using the qnnpack qconfig, then you should only run with qnnpack backend, because fbgemm backend would have overflows.
If you are using fbgemm config, then you can run on both backends.