OpenAI’s policies hinder reproducible research on language models
If you came here after only reading the headline, you missed what the complaint is actually about:<p>It&#x27;s not that GPT-4 is closed source.  It&#x27;s that access to `codex` model was pulled with only three days notice, and the model itself was not open-sourced.  Since apparently a large number of researchers were writing papers which used that particular model, that means all of those research papers are now non-reproducible.<p>An obvious thing to do would be to either open-source older models (including the weights) when retiring them; or possibly transfer them to an institution who see their role specifically as serving as an archive &#x2F; reference for this type of purpose.  Open-sourcing older models shouldn&#x27;t result in too much of a risk, either from an &quot;AI Safety&quot; perspective, or from a competitive perspective.