OpenGPT-2: We Replicated GPT-2 Because You Can Too
It sounds like all the drama OpenAI made about not releasing the model was all just marketing. $50,000 is nothing for a nation-state or even just a motivated third party. I had always assumed OpenAI had spent well into the 6 or even 7 figures to train the full model.MSFT has sort of invested $1 billion into OpenAI so I guess it worked!