The makers of Eleuther hope it will be an open source alternative to GPT-3
I don&#x27;t know why the eleuther project riles me up so much. Their work on the pile gets to me because they&#x27;re so cavalier about copyright (while I defend myself by training on similarly pirated text datasets, but feel different because I don&#x27;t redistribute them and am honest that it&#x27;s pirated. to be clear, i&#x27;m rolling my eyes at my rationalization right here). Their work on gpt-neo riles me up because they do such a weak job comparing it to the models whose hype they&#x27;re riding. It also riles me up because so many people just eat it up uncritically.<p>But it&#x27;s all out of proportion. I think it&#x27;s that last part (the uncritical reaction) that makes me blow this out of proportion.