pintonos:

Is this a bug? Shouldn’t fbgemm outperform qnnpack an a x86 system?


Yes, sounds like it could be a bug.  Would you be able to share the per-op profiling results for the model you are seeing this for using https://pytorch.org/docs/stable/autograd.html#profiler 5 on both fbgemm and qnnpack on your machine?  Qnnpack only has fast kernels on ARM, on x86 it is taking the slow fallback path.