resources, by a substantial margin across all four benchmarks. However, it is important to ac-
knowledge the considerable performance gap that persists between the largest FLAN-PALM540B and
FLAN-ST32B models.
Mixture-of-Experts