Solved by Vasiliy_Kuznetsov in post #2 
              
              
                Hi @fred107, the reason it is not working is because model_fp32.quant does not have a qconfig specified.  The quantization convert API only swaps modules with qconfig defined.  You could fix this by doing something like model_fp32.quant.qconfig = torch.quantization.get_default_qconfig('fbgemm') befo…