LaMini-LM: A Diverse Herd of Distilled Models

from Large-Scale Instructions

Minghao Wu1,2∗Abdul Waheed1 Chiyu Zhang1,3 Muhammad Abdul-Mageed1,3 Alham Fikri Aji1

1Mohamed bin Zayed University of Artiﬁcial Intelligence

2Monash University

3The University of British Columbia

{minghao.wu,abdul.waheed,chiyu.zhang,muhammad.mageed,alham.fikri}@mbzuai.ac.ae

3
2
0
2

 
r
p
A
7
2

 

 
 
]
L
C
.
s
c
[
 
 

1
v
2
0
4
4
1

.

4
0
3
2
:
v
i
X
r
a

Abstract
LaMini-LM- A Diverse Herd of Distilled Models from Large-Scale Instructions