GPT-Neo – Building a GPT-3-sized model, open source and free
It&#x27;s a shame that it has turned out to be necessary to externally re-make and re-train a model that has come out of company called `OPEN`AI. Wasn&#x27;t one of the founding principles of it that all of the research would be available to the public? Isn&#x27;t that the premise on which the initial funding was secured? Best of luck to Eleuther.