Table 2 summarizes the carbon emission for pretraining the Llama 2 family of models. A cumulative of
3.3M GPU hours of computation was performed on hardware of type A100-80GB (TDP of 400W or 350W).
We estimate the total emissions for training to be 539 tCO2eq, of which 100% were directly offset by Meta’s
sustainability program.∗∗ Our open release strategy also means that these pretraining costs will not need to
be incurred by other companies, saving more global resources.
Llama2