The differences between tinkering and research (2016)
OP, Togelius, is quite wrong in 1 point at least.<p>tl;dr Seth Bling directly references NEAT and his links[Show More [1]] link to 2 Togelius papers[13][14] among many others !<p>To wit, in OP, Togelius mentions Seth Bling&#x27;s MarI&#x2F;O[1] as lacking scholarship because he didn&#x27;t mention Togelius:<p>&quot;
<i>seen as research, it is atrocious because of the complete lack of scholarship. The guy didn&#x27;t even know he was reinventing the wheel, and didn&#x27;t care to look it up.</i>
&quot;<p>Rather disdaignfully (sadly&#x2F; ironically&#x2F; poigniantly) Togelius refers to Seth not by name but only as &quot; <i>some guy</i> &quot;.<p>Yet Seth Bling[2] in his short video, mentions and explains NEAT and directly links  Ken Stanley&#x27;s and Risto Miikkulainen&#x27;s foundational NEAT paper[10] at U.texas which  Togelius builds on [hint: click SHOW MORE under Seth&#x27;s video]<p>And much more,  i.e.: ---- the innovative toolchain Seth uses: Bizhawk to script SNES emulators in Lua [12]!<p>---- Seth links the wikipedia page on Neuroevolution[11] which directly references 2 of Togelius&#x27;s own papers[13][14]<p>Seth&#x27;s [Show More] Links on the MarI&#x2F;O video[1] are very very comprehensive and (IMHO) indeed a great example of scholarship !<p>Togelius is a top flight scholar, and publishes in the field of AI game players and level generators[15] so I hope he will welcome some random <i>tinkerer</i> pointing out his error.<p>[full disclosure: I am a Togelius fan]<p>To give Togelius his due he does at least link to Seth&#x27;s MarI&#x2F;O video.<p>Perhaps Togelius failed to click &#x2F; read the Show More links ? The charitable benefit of doubt principle is accidental oversight.<p>Seth Bling is primarily a Twitch Streamer[2] and Speed Runner[3] who often popularises complex programming[4], math and academic ideas[5] to a primarily young audience using Mario and Minecraft[6] and takes requests via his subreddit[7]<p>Seth&#x27;s very popular Youtube video MarI&#x2F;O which uses NEAT (Neuro Evolution of Augmenting Topologies] to learn and play Super Mario World, has led to a huge number of streamers on twitch playing other MarI&#x2F;O levels[16], using RNNs, LSTMs, and other SMW levels and SNES games, like RNN multiplayer x4 Mario Karts[17].<p>The OP article is great, academic rigor and bibliographic scholarship might <i>sometimes</i> differentiate the full time university scholar from the amateur researcher, enthusiast or tinkerer.<p>Seth and his many followers may not be &#x27;scholars&#x27; as in academic research but it is an amateur community of mostly youngsters doing their own research by having fun and sharing ideas, mostly undocumented outside their own transient twitch streams.<p>Compare this to the well respected amateur astronomy community and perhaps a responsible academic approach is to try to reach out and tap in rather than adding to the distance.<p>By his own OP standards of Togelius is lacking in that hasn&#x27;t discovered&#x2F; mentioned the work done by the Twitch&#x2F; Bizhawk community - it is not entirely undocumented [16].<p>Togelius your AI Mario competition[8] is legendary in academic AI circles but not necessarily widely known by youngsters playing Mario ( and to be fair AFAIK you don&#x27;t publish in their forums like twitch) although the code Infinite Mario[9] you base your work on is by Marcus Persson[10].<p>Though Persson is better known as Notch [10] ( author of Minecraft ) who is more famous than perhaps even Alan Turing , Yann le Cun, Jurgen Schmidhuber, or Geoff Hinton to the under 16 crowd.<p>Perhaps Togelius could mashup some of his work and do a crossover episode with Seth or relaunch the Infinite Mario competition[8] &#x2F; benchmarks to this new younger crowd evolving Neural Topologies to play Mario games - or even help document some of their fun.<p>As public servants funded by tax dollars it is perhaps the responsibility of the academic to reach out rather than blaming fun loving amateurs popularising and doing research &#x2F; &#x27;tinkering&#x27; for not putting in the due diligence of scrupulously mentioning every source.<p>[IMHO] I agree amateurs don&#x27;t always do full and proper scholarship and links are food for hungry minds - but they aren&#x27;t publicly funded researchers but amateurs working for love of the subject in their spare time, for free, or for streaming donations and youtube hits, using transitory, live media and whose audience must be constantly engaged and may have shorter attention spans than the average academic.<p>[full disclosure I am an amatuer neural net nerd]<p>[1]Seth Bling&#x27;s MarI&#x2F;O <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=qv6UVOQ0F44" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=qv6UVOQ0F44</a><p>[2]<a href="https:&#x2F;&#x2F;www.twitch.tv&#x2F;sethbling" rel="nofollow">https:&#x2F;&#x2F;www.twitch.tv&#x2F;sethbling</a><p>[3]<a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=-spFoon7klA" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=-spFoon7klA</a> sub 1 min SMW via credits warp<p>[4]Bling&#x27;s arranging shells in SMW to human inject Flappy Bird code into SNES <a href="https:&#x2F;&#x2F;www.twitch.tv&#x2F;videos&#x2F;57032858" rel="nofollow">https:&#x2F;&#x2F;www.twitch.tv&#x2F;videos&#x2F;57032858</a><p>[4]Bling&#x27;s Atari 2600 emulator built in Minecraft <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=5nViIUfDMJg" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=5nViIUfDMJg</a><p>[5]Seth Bling&#x27;s RNN Mario Cart race <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Ipi40cb_RsI" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Ipi40cb_RsI</a><p>[6]Bling&#x27;s Minecraft Redstone tutorials <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=DzSpuMDtyUU&amp;list=PL2Qvl4gaBge1kABr3aBCrMSb94HFLIjbn" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=DzSpuMDtyUU&amp;list=PL2Qvl4gaBg...</a><p>[7]<a href="https:&#x2F;&#x2F;sethbling.reddit.com" rel="nofollow">https:&#x2F;&#x2F;sethbling.reddit.com</a><p>[8]Togelius 2009 Infinite Mario AI competition <a href="http:&#x2F;&#x2F;julian.togelius.com&#x2F;mariocompetition2009&#x2F;" rel="nofollow">http:&#x2F;&#x2F;julian.togelius.com&#x2F;mariocompetition2009&#x2F;</a><p>[9]<a href="https:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20080423023424&#x2F;http:&#x2F;&#x2F;www.mojang.com&#x2F;notch&#x2F;mario&#x2F;" rel="nofollow">https:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20080423023424&#x2F;http:&#x2F;&#x2F;www.mojang...</a><p>[10]Stanley Miikkulainen NEAT paper <a href="http:&#x2F;&#x2F;nn.cs.utexas.edu&#x2F;?stanley:ec02" rel="nofollow">http:&#x2F;&#x2F;nn.cs.utexas.edu&#x2F;?stanley:ec02</a><p>[11] <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Neuroevolution" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Neuroevolution</a><p>[12] Scripting Lua in Bizhawk Emulator <a href="http:&#x2F;&#x2F;tasvideos.org&#x2F;Bizhawk&#x2F;LuaFunctions.html" rel="nofollow">http:&#x2F;&#x2F;tasvideos.org&#x2F;Bizhawk&#x2F;LuaFunctions.html</a><p>[13] Risi, Sebastian; Togelius, Julian (2017). &quot;Neuroevolution in Games: State of the Art and Open Challenges&quot; (PDF). IEEE Transactions on Computational Intelligence and AI in Games.<a href="https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1410.7326v3.pdf" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1410.7326v3.pdf</a><p>[14] Togelius, Julian; Schaul, Tom; Schmidhuber, Jurgen; Gomez, Faustino (2008), &quot;Countering poisonous inputs with memetic neuroevolution&quot; (PDF), Parallel Problem Solving from Nature <a href="https:&#x2F;&#x2F;www.academia.edu&#x2F;download&#x2F;30945872&#x2F;poison.pdf" rel="nofollow">https:&#x2F;&#x2F;www.academia.edu&#x2F;download&#x2F;30945872&#x2F;poison.pdf</a><p>[15] Togelius&#x27; Game AI book <a href="http:&#x2F;&#x2F;gameaibook.org&#x2F;" rel="nofollow">http:&#x2F;&#x2F;gameaibook.org&#x2F;</a><p>[16] <a href="https:&#x2F;&#x2F;clips.twitch.tv&#x2F;CourteousEmpathicTruffleCeilingCat" rel="nofollow">https:&#x2F;&#x2F;clips.twitch.tv&#x2F;CourteousEmpathicTruffleCeilingCat</a><p>[16] <a href="https:&#x2F;&#x2F;thenextweb.com&#x2F;artificial-intelligence&#x2F;2018&#x2F;01&#x2F;03&#x2F;this-live-stream-of-ai-learning-to-play-super-mario-bros-is-awesome&#x2F;" rel="nofollow">https:&#x2F;&#x2F;thenextweb.com&#x2F;artificial-intelligence&#x2F;2018&#x2F;01&#x2F;03&#x2F;th...</a><p>[17] <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=S9Y_I9vY8Qw" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=S9Y_I9vY8Qw</a>