Solved by Vasiliy_Kuznetsov in post #2 
              
              
                Hi @crook52 , with Eager mode quantization the user needs to place quants and dequants at every place in the model where tensors need to convert from fp32 to int8, and vice versa.  If it’s not working for you if you wrap the model with quant/dequant, that likely means that there are places inside yo…