oddsidemarginhasbeenaltered.headheighthasbeenaltered.textheighthasbeenaltered.footskiphasbeenaltered.topmarginhasbeenaltered.headsephasbeenaltered.textwidthhasbeenaltered.ThepagelayoutviolatestheICMLstyle.Pleasedonotchangethepagelayout,orincludepackageslikegeometry,savetrees,orfullpage,whichchangeitforyou.We’renotabletoreliablyundoarbitrarychangestothestyle.Pleaseremovetheoffendingpackage(s),orlayout-changingcommandsandtryagain.101010110.00.20.40.60.81.0TokensAccuracy70M160M410M1.0B1.4B2.8B6.9B12Boddsidemarginhasbeenaltered.headheighthasbeenaltered.textheighthasbeenaltered.footskiphasbeenaltered.topmarginhasbeenaltered.headsephasbeenaltered.textwidthhasbeenaltered.ThepagelayoutviolatestheICMLstyle.Pleasedonotchangethepagelayout,orincludepackageslikegeometry,savetrees,orfullpage,whichchangeitforyou.We’renotabletoreliablyundoarbitrarychangestothestyle.Pleaseremovetheoffendingpackage(s),orlayout-changingcommandsandtryagain.101010110.00.20.40.60.81.0Epoch1Epoch2TokensAccuracy70M160M410M1.0
Pythia- A Suite for Analyzing Large Language Models Across Training and Scaling