Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
This type of article (or press release, or whatever you want to call it) is exactly what makes the future so interesting.<p>The cat is out of the bag, the genie is out of the bottle, the confetti has left the cannon[0].<p>It's tempting to see a world dominated by Google Bard, ChatGPT, Bing Search, etc. And no doubt, they will be huge players, with services that are far more powerful than anything that can be run on the edge.<p>But. BUT. The things that we can do on the edge are <i>incredible</i> now. Just imagine a year from now, or two. These earth-shattering models, which seem to be upending a whole industry, will soon have equivalents that run on the edge. Without services spying on your data. Without censorship on what the model can/cannot say. Because it's all local.<p>When was the last time this happened? There <i>will</i> be players who publish weights for models that are free to use. The moment that torrent magnet link is published, it's out in the wild. And smart people <i>will</i> package them as "one click installers" for people who aren't tech-savvy. This is already happening.<p>So every time you're amazed by something chat-gpt4 says, remember that soon this will be in your pocket.<p>[0] the "confetti" idiom brought to you by chat-gpt4.