Why does deep and cheap learning work so well?
Here's a related 2016 talk by Max Tegmark (second author) on connections between deep learning and physics:https://www.youtube.com/watch?v=5MdSE-N0bxsThe gist of it is that physical data tends to have symmetries, and these symmetries make descriptions of the data very compressible into relatively small neural circuits. Random data does not have this property, and cannot be learned easily. Super fascinating.