Large language models are having their Stable Diffusion moment
Currently right now there's too many caveats to run even the 7B model per the workflows mentioned in the article.<p>The big difference between it and Stable Diffusion which caused the latter to go megaviral is a) it can run on a typical GPU that gamers likely already have without hitting a perf ceiling and b) it can run easily in a free Colab GPU. Although Hugging Face transformers can run a 7B model on a T4 GPU w/ 8-bit loading, but with its own caveats too.<p>There's a big difference between "can run" and "can run <i>well</i>". VQGAN + CLIP had a lot of friction too and that's partially why AI image generation didn't go megaviral then.