Sam Altman: OpenAI is not training GPT-5 and "won't for some time"
Left unsaid in this piece is that OpenAI likely would have to increase parameters and compute by an order of magnitude (~10x) to train a new model that offers noticeable improvements over GPT-4, due to the diminishing returns seen in "transformer scaling laws."<p>Also, it's possible that OpenAI is <i>still</i> training GPT-4, perhaps with additional modalities, and will make future snapshots available as public releases.