Eight Things to Know about Large Language Models

Figure 3. Adapted from a ﬁgure by Jason Wei based on data from Wei et al. (2022a): The 202 tasks evaluated in the language-technology
benchmark BIG-Bench (Srivastava et al., 2022) tend to show improved performance with scale overall, but individually they can improve
gradually, improve abruptly, stay level, get worse, or vacillate, making it impossible to extrapolate the performance of some future system
conﬁdently.
Eight Things to Know about Large Language Models