This series has a lot of good stuff. 
If you want to clear the hump between &quot;someone who knows what neural networks are&quot; and &quot;someone who can use neural nets in practice&quot;, there are introductions to the basic theory and foundational ideas.<p>If you already use neural nets and want to get better with them, Hugo Larochelle and Adam Coates have worthwhile videos. Larochelle&#x27;s lecture describes the various sorts of optimization techniques you can try out, while Coates&#x27; goes into how to analyze training efficiency in terms of the model you&#x27;ve chosen and the hardware you have available.<p>Finally, there&#x27;s some really neat stuff that&#x27;s perhaps a bit more &quot;cutting edge&quot;; I particularly enjoyed Goodfellow&#x27;s talk about adversarial networks.