Hi @KURI, thanks for reporting, your code to call the quantization APIs looks good, and that sounds like a bug somewhere in PyTorch.  Is your model architecture shareable?  If it is, could you file a github issue with a repro and a description of your environment?  Then we could get someone on the fbgemm team to take a look.