onesnow123q:

I know how to save a normal fp32 model, but I don’t know how to save it during quantization ware training.Because the model which saved during QAT has some params such as scale , zero_points and so on.I want these params disappear in the model.But I don’t know how to change code to achieve it.


why do you want these params to disappear? we need to save scale/zero_point of qat model since it’s part of the state of the model