GPT-J: GPT-3 Democratized
I run GPT-J on a Titan RTX where I am writing a novel with it. To make it generate about 20k tokens or two pages of content takes a few minutes . I would say the output is comparable to other language models quality and so forth.<p>Note that refinement or transfer learning doesn’t apply anymore it’s more like using a zero shot classifier or in other words you have to craft the input like Siri or wolfram alpha but expect text back instead<p>It runs on about 15gb of VRAM and <a href="https:&#x2F;&#x2F;www.eleuther.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.eleuther.ai&#x2F;</a> released it under the Apache license.<p>I use this endpoint written by kinoc using FastAPI <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;kinoc&#x2F;f3225092092e07b843e3a2798f7b3986" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;kinoc&#x2F;f3225092092e07b843e3a2798f7b39...</a> which is released under the MIT licence.