Llm, Machine Learning, Fine Tuning.
above. Once all of this filtering was completed, they were left with roughly 6 billion tokens in the dataset. To put into context how small this is, LLaMa 2 was trained on roughly 2 trillion tokens (or about 3 orders of magnitude more data)! Data Set 2 and Generating Good Examples An example of a