9

• Money: Financial resources are a crucial consideration, especially for smaller
organizations and researchers. This includes the cost of hardware acquisition, elec-
tricity for running the models, and potential cloud computing expenses. Finding
ways to make LLMs accessible and viable for a broader range of users without
signiﬁcant ﬁnancial investment is another key challenge.

• Network communication: For distributed training and cloud-based deploy-
ment, network bandwidth and latency become signiﬁcant. Eﬃcient network
communication means reducing the amount of data that needs to be transferred
between nodes in a distributed system or between the cloud and end-users, which
can greatly aﬀect training time and responsiveness in real-time applications.

2.2.2 Taxonomy of techniques for resource-eﬃcient LLMs
Beyond Efficiency