text: Title: Exported quantized model wasn’t reduced in model size
  Body: # Ask a Question
  I have a model from sentence- transformers/all-mini-L6-v2 and I have applied dynamic quantization on it that reduces the model size by 75% 
  Initially 90 MB
  After Quantization: 25 MB
  But when I convert the model to onnx format using torch.onnx.export it is giving same size as the non quantized model in onnx format 
  ### Question
  <!-- Explain your question here. -->
  Does onnx format effectively represents quantization 
  ### Further information
  - Relevant Area: <!--e.g., model usage, backend, best practices, converters, shape_inference, version_converter, training, test, operators, IR, ONNX Hub, data preprocessing, CI pipelines. -->
  
  - Is this issue related to a specific model?
  **Model name**: <!-- *e.g. mnist* --> sentence- transformers/ all-mini-L6-v2 
  **Model opset**: <!-- *e.g. 17* --> 14
  
  ### Notes
  <!-- Any additional information, code snippets. -->
  