I&#x27;ve been trying to read a paper a day since midsummer. These are a few of the interesting, for me personally,  since then:<p>Generating Sequences With Recurrent Neural Networks - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1308.0850" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1308.0850</a> 
Older one, but important to understand deeply since other recent ideas have come from this!<p>Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.06434" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.06434</a><p>Unitary Evolution Recurrent Neural Networks - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.06464" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.06464</a><p>State of the Art Control of Atari Games Using Shallow Reinforcement Learning - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1512.01563" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1512.01563</a> 
Interesting discussion in section 6.1 on the shortcomings&#x2F;issues of DQN done by Deepmind<p>Spectral Representations for Convolutional Neural Networks - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1506.03767" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1506.03767</a><p>Deep Residual Learning for Image Recognition - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1512.03385" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1512.03385</a><p>Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.07289" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.07289</a>
I wish they did more comparisons between similar network architecture with only the units swapped out. Eg. Alexnet, Relu vs Alexnet, Elu.<p>On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models - <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.09249" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1511.09249</a><p>Just a few from my list :)