True. The cases where this would be useful (extremely low training data) there are machine learning methods that are much much better than deep learning, which is a glutton for data comparatively. E.g. handwriting recognition or signature recognition (where you would have only a few samples).<p><a href="http:&#x2F;&#x2F;www.sciencemag.org&#x2F;content&#x2F;350&#x2F;6266&#x2F;1332.abstract" rel="nofollow">http:&#x2F;&#x2F;www.sciencemag.org&#x2F;content&#x2F;350&#x2F;6266&#x2F;1332.abstract</a>