hi @Vasiliy_Kuznetsov thanks for your response. Please check the code.
I am loading quantized bert model in a similar way as we load the pre-trained bert model. When I convert model to quantization and determine the accuracy it is pretty much similar to without quantized model. However, when I load the quantized model, after saving it, then there is lot of variation in the results.
@Vasiliy_Kuznetsov I have updated the github issues link too, many people are facing similar issue.