Llm, Machine Learning, Fine Tuning.
thrown off by a different vocabulary. In the LLM world, this can cause hallucination, so to avoid this they wanted to have as many different ways to frame topics as possible in the dataset. To get this right, they had to prompt GPT-3.5 in many different ways. This ended up being roughly 1 billion