Exporting ALBERT model to onnx increases model size by 7x
I'm trying to export `albert-base-v2` model to onnx using

`python -m transformers.convert_graph_to_onnx --framework pt --model albert-base-v2 --quantize albert.onnx --opset 12`

The original pytorch model size is around 45 MB (https://huggingface.co/albert-base-v2), but the exported model size is around 340 MB.

How do I keep the model's size same?
@mfuntowicz might have an idea. I'm guessing that what it does is copy each layer, while all the layers have shared weights and should point to the same tensor.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.