What is backpropagation and what is it doing? [video]
In 1988 Teuvo Kohonen had an "animation" with rotating disks how the perceptron learns https://youtu.be/Qy3h7kT3P5I?t=42m24s. Did not help comprehension much.