What are the limits of deep learning?
I think the current critique of Deep Learning as a technique is a dead end. Now I&#x27;m only a semi-professional in a sea of recent development and research, but if you ask me, the technique itself can take us all the way to General Intelligence and more.<p>What&#x27;s missing from this discussion is how we humans don&#x27;t just use a single, vision based &quot;deep net&quot; in order to identify the banana, we use lots of very different deep nets that run in parallel and cross-validate each other.<p>We have a vision net like computers that can be fooled with the same tricks (just google &quot;optical illusion&quot;).<p>But a second net does three-dimensional inference of the banana shape from stereo vision and cross-validates that with a toaster. If in doubt, unnoticed parallax movement will be commanded to our body in order to get a better shape estimation.<p>Another net parses the content. A banana in a jungle or on a table would be highly plausible. A banana in an operating room or on a roller coaster would be implausible.<p>Another net parses context and timeline. If no banana was there and no banana has been incoming through our continuous estimated 3d space, there is probably no banana there.<p>There&#x27;s smell, taste, all kinds of things running in parallel that continuously cross-validate our perception of this being a banana, probably a lot of different models just from vision alone that feed back into the main classification thread.<p>We&#x27;ll even happily do looped cross validation if our eyes rest on a scene. Our memory will fetch reference data for all first order predictions and start subconciously processing this into the main prediction. It will predict how a banana feels, how soft it is, how warm. If we see a banana on lava that is not burning, our logic and reasoning will challenge the prediction. All of this happens subconciously, and there&#x27;s no magic behind.<p>If you ask me, there are no limits of deep learning. There&#x27;s just still a limit of imagination in feature extraction and processing.