MLC-LLM: GPT/Llama on consumer-class GPUs and phones
Nobody wants to run Google on their PCs, why should LLMs be different?  I'd expect GPT models to be updated regularly fairly soon, and in much the same way that I wouldn't want to host a personal out-dated web index + search engine, LLMs seem a perfect fit for server-side services given their requirements.  Barely anyone even hosts their blogs or mail.  What's the excitement about getting it almost running on a phone about?