Solved by jerryzh168 in post #2 
              
              
                I think this might be a bug, thanks for reporting, opened an issue here: quantized batchnorm parameters/buffers not saved in state_dict · Issue #69808 · pytorch/pytorch · GitHub