OpenAI releases larger GPT-2 model
Notably, the 345M model (1.5 GB on disk) is big enough that it's pushing the limits of conventional GPUs, and an alternative method of finetuning the model (<a href="https://github.com/nshepperd/gpt-2/commit/47df6da611716b4826e3397cd68d711c6951c8e5" rel="nofollow">https://github.com/nshepperd/gpt-2/commit/47df6da611716b4826...</a>) has to be used to prevent the GPU from going OOM.<p>I'm working on tools to streamline GPT-2 text generation: I'm currently porting the code above to gpt-2-simple (<a href="https://github.com/minimaxir/gpt-2-simple" rel="nofollow">https://github.com/minimaxir/gpt-2-simple</a>) to allow easy finetuning/generation, and am also working on a way to quickly build an API/client for easily deploying GPT-2 to production and generating text at scale and cost effectively. Even the 117M model, managing CPU and RAM performance is tricky.<p>But given the incredible results of just the 117M model (e.g. Hacker News titles from a retrained 117M model: <a href="https://github.com/minimaxir/hacker-news-gpt-2" rel="nofollow">https://github.com/minimaxir/hacker-news-gpt-2</a>), I'm eager to put the 345M model through its paces.