Solved by jerryzh168 in post #3 
              
              
                the error message shows that the weight is already a quantized weight, it’s just numpy operation is not supported in quantized weight, so if you remove the numpy() call it should work.