Could you train a ChatGPT-beating model for $85k and run it in a browser?
I guess companies like OpenAI and Google have no incentives to make models use less resources. The compute required, and of course also their training data, is their moat.<p>If you accept that your model knows less about the world - it doesn&#x27;t have to know about every restaurant in mexico city or the biography of every soccer player around the world - then you can get away with much fewer parameters and much less training data. Then you can&#x27;t query it like an oracle about random things anymore, but you shouldn&#x27;t do that anyway. But it should still be able to do tasks like reformulating texts, judging simularity (by embedding distance), and so on.<p>And TFA mentions it also, you could hook up your simple language model with something like ReAct to get really good results. I don&#x27;t see it running in the browser, but if you had a license-wise clean model that you can run on premises on one or two GPUs, that would be huge for a lot of people!