Answers.Body: <p>Accompanying ML/AI (and computer science, in general) papers with the relevant code is much desirable, both for reproducibility of the paper results as well as for faster integration of these results into applications.</p>
  <p>Some researchers do so by themselves; but this has lately become also a community job, where a third, independent individual or team, not affiliated with the paper author(s), offers a code implementation starting from the paper.</p>
  <p>A good, very recent case is the reproduction of the <a href="https://arxiv.org/abs/1803.10122" rel="nofollow noreferrer">World Models</a> paper (<a href="https://medium.com/applied-data-science/how-to-build-your-own-world-model-using-python-and-keras-64fb388ba459" rel="nofollow noreferrer">blog post</a>, <a href="https://github.com/AppliedDataSciencePartners/WorldModels" rel="nofollow noreferrer">Github repo</a>). Many of the implementations available at <a href="https://paperswithcode.com" rel="nofollow noreferrer">Papers with Code</a> are indeed provided by the community.</p>
  <p>A great write-up of such an effort, containing many lessons learned, made big raves recently: <a href="http://amid.fish/reproducing-deep-rl" rel="nofollow noreferrer">Lessons Learned Reproducing a Deep Reinforcement Learning Paper</a>.</p>
  <p>Understandably, individuals that have such efforts in their CV are a good recruiting option...</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-18T19:13:55.573Z
Answers.Text: In addition to this, do you find the stated "statement (Open-source reimplementations of deep learning algorithms)" demanding for reimplementation of some Machine Learning Model's based on some paper or the reimplementation of the very learning techniques themselves (e.g. back-propagation)?
Answers.UserDisplayName: Shoaib Anwar
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-18T19:17:52.417Z
Answers.Text: @ShoaibAnwar probably the former; a re-implementation of BP is not of any particular value, apart from a purely educational perspective, and such efforts abound
Answers.UserDisplayName: desertnaut
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-04-18T19:03:46.427Z
Answers.LastActivityDate: 2020-11-15T16:33:41.437Z
Answers.LastEditDate: 2020-11-15T16:33:41.437Z
Answers.UserDisplayName: desertnaut
Answers.Body: <p>I believe that this:</p>
  
  <ul>
  <li><strong>"reimplementations of deep learning algorithms"</strong>
  He is asking that they are looking for people who have made and completed an AI that perform similarly or exactly as those given in papers (IDK which papers)</li>
  <li><strong>"Open-source"</strong> The Fellow wants to be able to see the source code of the project.</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-18T18:30:34.860Z
Answers.LastActivityDate: 2018-04-18T18:30:34.860Z
Answers.UserDisplayName: FreezePhoenix
Body: <p>In the <a href="https://startup.jobs/3993-machine-learning-fellow-at-openai" rel="nofollow noreferrer">OpenAI's Machine Learning Fellow position</a>, it is written</p>
  <blockquote>
  <p>We look for candidates with one or more of the following credentials:</p>
  <ul>
  <li>...</li>
  <li>Open-source reimplementations of deep learning algorithms which replicate performance from the papers</li>
  </ul>
  </blockquote>
  <p>What exactly do they mean by this? Do they want us to implement the algorithms exactly as described in the papers (i.e. with the same hyper-parameters, weights, etc.)?</p>
  
Tags: <neural-networks><deep-learning><papers><research><implementation>
Title: What does "reimplementations of deep learning algorithms which replicate performance from the papers" mean?
UserDisplayName: Shoaib Anwar
ThreadText: # What does "reimplementations of deep learning algorithms which replicate performance from the papers" mean?
  
  (Asked by: username_0 on 2018-04-18)
  
  In the [OpenAI's Machine Learning Fellow position](https://startup.jobs/3993-machine-learning-fellow-at-openai), it is written
  
  > We look for candidates with one or more of the following credentials:
  >
  > * ...
  > * Open-source reimplementations of deep learning algorithms which replicate performance from the papers
  
  What exactly do they mean by this? Do they want us to implement the algorithms exactly as described in the papers (i.e. with the same hyper-parameters, weights, etc.)?
  
  **Tags:** neural-networks, deep-learning, papers, research, implementation
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2018-04-18. Score: 1 | Accepted answer
  
  Accompanying ML/AI (and computer science, in general) papers with the relevant code is much desirable, both for reproducibility of the paper results as well as for faster integration of these results into applications.
  
  Some researchers do so by themselves; but this has lately become also a community job, where a third, independent individual or team, not affiliated with the paper author(s), offers a code implementation starting from the paper.
  
  A good, very recent case is the reproduction of the [World Models](https://arxiv.org/abs/1803.10122) paper ([blog post](https://medium.com/applied-data-science/how-to-build-your-own-world-model-using-python-and-keras-64fb388ba459), [Github repo](https://github.com/AppliedDataSciencePartners/WorldModels)). Many of the implementations available at [Papers with Code](https://paperswithcode.com) are indeed provided by the community.
  
  A great write-up of such an effort, containing many lessons learned, made big raves recently: [Lessons Learned Reproducing a Deep Reinforcement Learning Paper](http://amid.fish/reproducing-deep-rl).
  
  Understandably, individuals that have such efforts in their CV are a good recruiting option...
  
  > **Comments:**
  > **username_0**: In addition to this, do you find the stated "statement (Open-source reimplementations of deep learning algorithms)" demanding for reimplementation of some Machine Learning Model's based on some paper or the reimplementation of the very learning techniques themselves (e.g. back-propagation)?  
  > **username_1**: @ShoaibAnwar probably the former; a re-implementation of BP is not of any particular value, apart from a purely educational perspective, and such efforts abound  
  
  ---
  
  ### Answer by username_2 on 2018-04-18. Score: 1
  
  I believe that this:
  
  * **"reimplementations of deep learning algorithms"**
    He is asking that they are looking for people who have made and completed an AI that perform similarly or exactly as those given in papers (IDK which papers)
  * **"Open-source"** The Fellow wants to be able to see the source code of the project.
  
  
  ---
  
  