Abdulaziz_Gaybulayev:

When I tried to quantize, model size is increasing twice and inferencing time is same with FP32 model.


can you print the model after quantize_dynamic? also I think we do not support dynamic quantization for torch.nn.Conv2d right now.