https://github.com/mbzuai-nlp/LaMini-LM

Figure 1: Overview of LaMini-LM

Moreover, the accessibility of large models is a real
concern for many NLP practitioners due to lim-
ited access to computing resources (Nityasya et al.,
2020).
LaMini-LM- A Diverse Herd of Distilled Models from Large-Scale Instructions