In recent years, signiﬁcant research eﬀorts have been dedicated to developing and
applying resource-eﬃcient LLMs to address the challenges referenced earlier. There
has been a wave of research proposing and deploying new strategies across various
ﬁelds, although the concept of resource-eﬃcient LLMs is relatively nascent. Most exist-
ing LLM approaches have been tailored for speciﬁc application domains; however,
the underlying principles are often adaptable enough to be utilized in other areas.
Nevertheless, it remains challenging to compare these resource-eﬃcient strategies
across diﬀerent domains that cater to distinct communities. Furthermore, assessing
the performance of resource-eﬃcient LLMs demands intricate and specialized eval-
uation strategies due to their distinctive attributes, such as their multi-dimensional
eﬃciency (e.g., computational, energy, memory usage) and the diverse outcomes they
produce. To date, there is a deﬁciency in systematic standardization and a compre-
Beyond Efficiency