Alpaca: A strong open-source instruction-following model
This is why I think we're seeing a Stable Diffusion moment for LLMs: <a href="https://simonwillison.net/2023/Mar/11/llama/" rel="nofollow">https://simonwillison.net/2023/Mar/11/llama/</a><p>Look at the timeline:<p>24th February 2023: LLaMA is announced, starts being shared with academic partners: <a href="https://research.facebook.com/publications/llama-open-and-efficient-foundation-language-models/" rel="nofollow">https://research.facebook.com/publications/llama-open-and-ef...</a><p>2nd March: Someone posts a PR with a BitTorrent link to the models: <a href="https://github.com/facebookresearch/llama/pull/73">https://github.com/facebookresearch/llama/pull/73</a><p>10th March: First commit to llama.cpp by Georgi Gerganov: <a href="https://github.com/ggerganov/llama.cpp/commit/26c084662903ddaca19bef982831bfb0856e8257">https://github.com/ggerganov/llama.cpp/commit/26c084662903dd...</a><p>11th March: llama.cpp now runs the 7B model on a 4GB RaspberryPi: <a href="https://twitter.com/miolini/status/1634982361757790209" rel="nofollow">https://twitter.com/miolini/status/1634982361757790209</a><p>12th March: npx dalai llama: <a href="https://cocktailpeanut.github.io/dalai/" rel="nofollow">https://cocktailpeanut.github.io/dalai/</a><p>13th March (today): llama.cpp on a Pixel 6 phone: <a href="https://twitter.com/thiteanish/status/1635188333705043969" rel="nofollow">https://twitter.com/thiteanish/status/1635188333705043969</a><p>And now, Alpaca. It's not even lunchtime yet!<p>Turned this into a blog post: <a href="https://simonwillison.net/2023/Mar/13/alpaca/" rel="nofollow">https://simonwillison.net/2023/Mar/13/alpaca/</a>