Make model tiny (172M -> 4.5M params)
#2
by
lewtun
HF staff
- opened
No description provided.
ydshieh
changed pull request status to
merged
Hi Lewis, are these updates already merged? I still saw from the main branch the original large model that I previously uploaded for test purposes.
Thanks
@ydshieh
! Is hf-internal-testing/tiny-random-onnx-mt5
the new real tiny one for mt5?
I would say yes. It is copied from
@lewtun
work described in https://github.com/huggingface/transformers/pull/18924.
However, I would suggest to have a discussion with him to make sure. The plan seems to change.
(But you can test with hf-internal-testing/tiny-random-onnx-mt5
if you want :-) )