Neural Networks from Scratch
Each time I teach neural nets to an engineer, there's only a 50% chance they can write down the chain rule. Colah's blog on backprop used to be my favorite resource to leave them with (<a href="https://colah.github.io/posts/2015-08-Backprop" rel="nofollow">https://colah.github.io/posts/2015-08-Backprop</a>).<p>The explanation of the calculus in this tool is equally fantastic. And the art is very cute.<p>There are many ways to skin a cat, of course, but this is as good a tutorial as I've seen for getting you through backprop as fast as possible.