thanks for the advice @joeddav and also thanks to @valhalla for amazing project about distiled model
distiled model seems interesting…will try to look for it,
and it would be great if its support more model,such as xlm-roberta
anyway
i’m trying to train/reproduce your xlm-model 5
but using base-model instead of large one to improve inference speed.
will try use this step 14 maybe
using xlm-r because it support more languages
any tips that i should aware of ?
thanks again