Llm, Machine Learning, Fine Tuning.
prompted. Phi-1 has 1.3B billion parameters and was trained on about 7 billion tokens. To put that into context, most small models have about 5x more parameters and nearly 100x more training tokens. Nevertheless, Phi-1 performs well. Take a look at the following interaction from the paper: Student: