Answers.Body: <p>Answer is <em>quite yes</em>, please have a look what Google did around this:</p>
  
  <blockquote>
    <p>Google Cloud Video Intelligence makes videos searchable, and discoverable, by extracting metadata with an easy to use REST API. You can now search every moment of every video file in your catalog. It quickly annotates videos stored in Google Cloud Storage, and helps you identify key entities (nouns) within your video; and when they occur within the video.</p>
  </blockquote>
  
  <p><a href="https://cloud.google.com/video-intelligence/" rel="nofollow noreferrer">https://cloud.google.com/video-intelligence/</a></p>
  
  <p>So, Google does recognize all kinds of data from the video: it classifies the whole content of it to tags.</p>
  
  <p>What about Humanoid Robot Sophia?</p>
  
  <blockquote>
    <p>Cameras within Sophia's eyes combined with computer algorithms allow her to see. She can follow faces, sustain eye contact, and recognize individuals. She is able to process speech and have conversations using a natural language subsystem. </p>
  </blockquote>
  
  <p><a href="https://en.wikipedia.org/wiki/Sophia_(robot)" rel="nofollow noreferrer">https://en.wikipedia.org/wiki/Sophia_(robot)</a></p>
  
  <p>These intent to the direction to understand (Google) and produce (Sophia) language from sounds and images. To learn think by themselves, machines are still not ready. If you get into these two cases more you would see that these are quite mechanical and manual (requiring human pre-effort) things still.</p>
  
  <p>It is said that machines are now on a phases of toddler who can ask names for things around her and name them. Take some years more, maybe the abilities are more advanced ;)</p>
  
  <p><strong>edit:</strong></p>
  
  <p>You asked about unsupervised learning. There is a <a href="https://youtu.be/Q6nYgeH8Krs" rel="nofollow noreferrer">video</a> about speech of MIT researcher, who made experiments on text and images and in final notes he denoted that it would be nice to make the same with videos, actually with the same reasoning you had: to learn a language. He promised to keep that in mind with his colleagues, maybe some of them already work on that.</p>
  
  <p><strong>edit2:</strong></p>
  
  <p>Interesting research paper on the topic was on this <a href="https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Alayrac_Unsupervised_Learning_From_CVPR_2016_paper.pdf" rel="nofollow noreferrer">link</a> :</p>
  
  <blockquote>
    <p>We address the problem of automatically learning the
    main steps to complete a certain task, such as changing a
    car tire, from a set of narrated instruction videos. The con-
    tributions of this paper are three-fold. [..] Third, we experimentally demonstrate that the proposed method can automatically discover, in an unsupervised manner, the main steps to achieve the task and locate the steps in the input videos.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-14T14:11:27.383Z
Answers.Text: Also Microsoft has much development on this area: look slide https://youtu.be/E3kFkzeaynw at 2:01 minutes in video.
Answers.UserDisplayName: mico
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-14T15:49:46.737Z
Answers.Text: Thanks! Were these systems trained in an unsupervised way?
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-14T16:53:50.410Z
Answers.Text: Well, I found another project that does! Look my edit.
Answers.UserDisplayName: mico
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-14T17:07:42.887Z
Answers.Text: .. and yet another. There are many aspects, that can be learned from video and speech.
Answers.UserDisplayName: mico
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T19:41:39.210Z
Answers.LastActivityDate: 2018-04-14T17:25:29.470Z
Answers.LastEditDate: 2018-04-14T17:25:29.470Z
Answers.UserDisplayName: mico
Answers.Body: <p>Yes! Unsupervised machine learning has absolutely been applied to youtube videos... To recognize cats!</p>
  
  <p>Here's an article about it in <a href="https://www.wired.com/2012/06/google-x-neural-network/" rel="nofollow noreferrer">wired</a>. One of the leading ML researchers was <a href="http://www.andrewng.org/about/" rel="nofollow noreferrer">Andrew Ng.</a></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T13:26:29.187Z
Answers.Text: I know about this one, and it not  what I have asked (it does not label images in any way)Thanks for your answer, though!
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T20:27:07.690Z
Answers.Text: Ah, sorry, I jumped the gun and answered the title question!
Answers.UserDisplayName: Charles
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T04:05:43.377Z
Answers.LastActivityDate: 2018-04-13T04:05:43.377Z
Answers.UserDisplayName: Charles
Answers.Body: <p>Yes, it is possible, and yes, it probably has been done before. Odds are, however, the person(s) who tried were disappointed with the results and forgot to tell others. </p>
  
  <p>The reasons they might be disappointed could be any of the following:</p>
  
  <ul>
  <li>Took to long to train</li>
  <li>Even when fully trained, (or appeared to be), it did not give the expected output</li>
  <li>Too sensitive to variations in the input</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T13:28:22.997Z
Answers.Text: Thanks, I thought this would be the case, but this is not an answer, rather an opinion
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T13:55:36.723Z
Answers.Text: @HughMungus will reword it.
Answers.UserDisplayName: FreezePhoenix
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T15:33:01.290Z
Answers.Text: Perhaps I should reword the question: if there is any specific reason of why this cannot be implemented, but specific to this idea, rather than what can go wrong with deep learning  in general
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T15:47:50.010Z
Answers.Text: @HughMungus you giving up, not being able to feed it a video, etc. Mostly data conversion.
Answers.UserDisplayName: FreezePhoenix
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-13T16:48:10.960Z
Answers.Text: well , if you see it that way, I guess you should answer it, I have no problem in giving you the bounty if it gets two positive votes (and nobody else gives  a better answer)
Answers.UserDisplayName: Wolphram jonny
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-04-12T14:08:49.607Z
Answers.LastActivityDate: 2018-04-13T13:55:59.010Z
Answers.LastEditDate: 2018-04-13T13:55:59.010Z
Answers.UserDisplayName: FreezePhoenix
Body: <p>YouTube has a huge amount of videos, many of which also containing various spoken languages. This would presumably provide something like the data that a "challenged" baby would experience - "challenged" meaning a baby without arms or legs (unfortunately many people are born that way). </p>
  
  <p>Would this not allow unsupervised learning in a deep learning system that has both vision and audio capabilities? The neural network would presumably learn correlations between words and images, and could perhaps even learn rudimentary language skills, all without human supervision. I believe that the individual components to do this already exist.</p>
  
  <p>Has this been tried, and if not, why?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-09T22:57:31.690Z
Comments.Text: In this day and age, you can expect someone has already done what you want to do.
Comments.UserDisplayName: FreezePhoenix
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-10T20:18:23.337Z
Comments.Text: The underlying issue seems to be that integrated circuits aren't nearly as powerful as the human brain, and we're not even sure how the brain can store and correlate all of that data.  I usually recommend taking a quick look at computational complexity theory, to get a sense of the problems sizes for problems where all of the parameters are known and information is perfect and complete. Compare to nature, where this is not the case.  It's a very challenging problem. Good question, though.  Welcome to AI!
Comments.UserDisplayName: DukeZhou
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-14T00:50:42.580Z
Comments.Text: you should edit your question if your phrasing is not the way you intend it to be
Comments.UserDisplayName: k.c. sayz 'k.c sayz'
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-14T15:51:54.600Z
Comments.Text: @k.c.sayz'k.csayz' Feel free to edit it, I will reverse it only in case the edited meaning disagrees with the intended one
Comments.UserDisplayName: Wolphram jonny
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-07-16T16:42:04.043Z
Comments.Text: check https://arxiv.org/pdf/1112.6209.pdf
Comments.UserDisplayName: thecomplexitytheorist
Tags: <deep-learning><deep-neural-networks><computer-vision><unsupervised-learning><datasets>
Title: Has anybody tried unsupervised deep learning from youtube videos?
UserDisplayName: Wolphram jonny
ThreadText: # Has anybody tried unsupervised deep learning from youtube videos?
  
  (Asked by: username_0 on 2018-04-09)
  
  YouTube has a huge amount of videos, many of which also containing various spoken languages. This would presumably provide something like the data that a "challenged" baby would experience - "challenged" meaning a baby without arms or legs (unfortunately many people are born that way).
  
  Would this not allow unsupervised learning in a deep learning system that has both vision and audio capabilities? The neural network would presumably learn correlations between words and images, and could perhaps even learn rudimentary language skills, all without human supervision. I believe that the individual components to do this already exist.
  
  Has this been tried, and if not, why?
  
  **Tags:** deep-learning, deep-neural-networks, computer-vision, unsupervised-learning, datasets
  
  > **Comments:**
  > **username_1**: In this day and age, you can expect someone has already done what you want to do.  
  > **username_2**: The underlying issue seems to be that integrated circuits aren't nearly as powerful as the human brain, and we're not even sure how the brain can store and correlate all of that data.  I usually recommend taking a quick look at computational complexity theory, to get a sense of the problems sizes for problems where all of the parameters are known and information is perfect and complete. Compare to nature, where this is not the case.  It's a very challenging problem. Good question, though.  Welcome to AI!  
  > **username_3**: you should edit your question if your phrasing is not the way you intend it to be  
  > **username_0**: @username_3sayz'k.csayz' Feel free to edit it, I will reverse it only in case the edited meaning disagrees with the intended one  
  > **username_4**: check https://arxiv.org/pdf/1112.6209.pdf  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_5 on 2018-04-13. Score: 2 | Accepted answer
  
  Answer is *quite yes*, please have a look what Google did around this:
  
  > Google Cloud Video Intelligence makes videos searchable, and discoverable, by extracting metadata with an easy to use REST API. You can now search every moment of every video file in your catalog. It quickly annotates videos stored in Google Cloud Storage, and helps you identify key entities (nouns) within your video; and when they occur within the video.
  
  <https://cloud.google.com/video-intelligence/>
  
  So, Google does recognize all kinds of data from the video: it classifies the whole content of it to tags.
  
  What about Humanoid Robot Sophia?
  
  > Cameras within Sophia's eyes combined with computer algorithms allow her to see. She can follow faces, sustain eye contact, and recognize individuals. She is able to process speech and have conversations using a natural language subsystem.
  
  <https://en.wikipedia.org/wiki/Sophia_(robot)>
  
  These intent to the direction to understand (Google) and produce (Sophia) language from sounds and images. To learn think by themselves, machines are still not ready. If you get into these two cases more you would see that these are quite mechanical and manual (requiring human pre-effort) things still.
  
  It is said that machines are now on a phases of toddler who can ask names for things around her and name them. Take some years more, maybe the abilities are more advanced ;)
  
  **edit:**
  
  You asked about unsupervised learning. There is a [video](https://youtu.be/Q6nYgeH8Krs) about speech of MIT researcher, who made experiments on text and images and in final notes he denoted that it would be nice to make the same with videos, actually with the same reasoning you had: to learn a language. He promised to keep that in mind with his colleagues, maybe some of them already work on that.
  
  **edit2:**
  
  Interesting research paper on the topic was on this [link](https://www.cv-foundation.org/openaccess/content_cvpr_2016/papers/Alayrac_Unsupervised_Learning_From_CVPR_2016_paper.pdf) :
  
  > We address the problem of automatically learning the
  > main steps to complete a certain task, such as changing a
  > car tire, from a set of narrated instruction videos. The con-
  > tributions of this paper are three-fold. [..] Third, we experimentally demonstrate that the proposed method can automatically discover, in an unsupervised manner, the main steps to achieve the task and locate the steps in the input videos.
  
  > **Comments:**
  > **username_5**: Also Microsoft has much development on this area: look slide https://youtu.be/E3kFkzeaynw at 2:01 minutes in video.  
  > **username_0**: Thanks! Were these systems trained in an unsupervised way?  
  > **username_5**: Well, I found another project that does! Look my edit.  
  > **username_5**: .. and yet another. There are many aspects, that can be learned from video and speech.  
  
  ---
  
  ### Answer by username_6 on 2018-04-13. Score: 2
  
  Yes! Unsupervised machine learning has absolutely been applied to youtube videos... To recognize cats!
  
  Here's an article about it in [wired](https://www.wired.com/2012/06/google-x-neural-network/). One of the leading ML researchers was [Andrew Ng.](http://www.andrewng.org/about/)
  
  > **Comments:**
  > **username_0**: I know about this one, and it not  what I have asked (it does not label images in any way)Thanks for your answer, though!  
  > **username_6**: Ah, sorry, I jumped the gun and answered the title question!  
  
  ---
  
  ### Answer by username_1 on 2018-04-12. Score: 2
  
  Yes, it is possible, and yes, it probably has been done before. Odds are, however, the person(s) who tried were disappointed with the results and forgot to tell others.
  
  The reasons they might be disappointed could be any of the following:
  
  * Took to long to train
  * Even when fully trained, (or appeared to be), it did not give the expected output
  * Too sensitive to variations in the input
  
  > **Comments:**
  > **username_0**: Thanks, I thought this would be the case, but this is not an answer, rather an opinion  
  > **username_1**: @HughMungus will reword it.  
  > **username_0**: Perhaps I should reword the question: if there is any specific reason of why this cannot be implemented, but specific to this idea, rather than what can go wrong with deep learning  in general  
  > **username_1**: @HughMungus you giving up, not being able to feed it a video, etc. Mostly data conversion.  
  > **username_0**: well , if you see it that way, I guess you should answer it, I have no problem in giving you the bounty if it gets two positive votes (and nobody else gives  a better answer)  
  
  ---
  
  