GitHub releases an ImageNet for code and a CodeSearchNet challenge
Shawn from Weights &amp; Biases here. We&#x27;ve been working with Github and Microsoft Research on this for just about a year now and we&#x27;re super excited to launch it today.<p>We&#x27;ve seen huge advances in human language modeling and translation due to the success of deep learning. Often new directions start with a really motivated team producing a new kind of dataset. Who better to do that for code as language than Github!<p>This started as a grassroots effort inside of Github, and went through many iterations. When it was presented to Github&#x27;s CEO six months ago, he correctly pointed out that we needed to go back and include Github&#x27;s most popular language (javascript). As the project went on many smart people chipped in, and we produced something that we think is truly useful.<p>Check out the paper here: <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1909.09436" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1909.09436</a><p>We overcame plenty of challenges to pull this off. For example: how do you clean this data? how do you label it? We&#x27;ve got folks from Github, Microsoft Research and Weights &amp; Biases here to answer any and all questions you might have. Can&#x27;t wait to see where this goes!