@supriyar 1x1 should be performant using fbgemm backend. Also in the reply by Singularity I do see that quantization improves time.



 singularity:

So it seems that quantization is indeed working as Desktop CPU time decreases from 134ms to 77ms.