 Dear Fellow Scholars, this is Two Minute Papers with Dr. Kato Jona Ifehir. Today we are going to see what Deep Mind's amazing AI can learn from humans doing silly things like playing the drums with a comb. Really, we have to do that. Well, okay, if you insist, there you go. Well, if it had seen enough of these instruction video pairs, hopefully it will be able to learn from it. And here comes the fundamental question we are here to answer today. If this AI does something, is this imitation, or is this learning? Imitation is not that impressive, but if it can learn general concepts from examples like this, now that would perhaps be a little spark of intelligence. That is what we are looking for. So, how much did it learn? Well, let's see it together. Nice! Look at that! If we ask it, it can now show us where a specific room is. And if we get a little lost, it even helps us with additional instructions to make sure we find our way into the bathroom. Now note that the layout of this virtual playhouse is randomized each time we start a new interaction, therefore it cannot just imitate the direction people go when they say bathroom. It doesn't work because next time it will be elsewhere. It actually has to understand what a bathroom is. Good job, little AI. It also understands that we are holding a bucket and it should put the grapes in that. Okay, so it learned from instructions and it can deal with instructions. But, if it had learned general concepts, it should be able to do other things too. You know what? Let's ask some questions. First, how many grapes are there in this scene? Two, yes, that is correct. Good job! Now, are they the same color or different? It says different. I like it. Because to answer this question, it has to remember what we just talked about. Very good. And now, hold on to your papers and check this out. We ask what color the grapes are on the floor. And what does it do? It understands what it needs to look for together the required information. Yes, it uses its little papers and answers the question. A little virtual assistant AI. I love it. But, it isn't just an assistant. Here come two of my favorite tasks from the paper. One, if we dreamed up a catchy tune and we just need a bandmate to make it happen. Well, say no more. This little AI is right there to help. So cool. And it gets better, get this, too, it even knows about its limitations. For instance, it knows that it can't flip the green box over. This can only arise from knowledge and experimentation with the physics of this virtual world. This will be fantastic for testing video games. So, yes, the learning is indeed thorough. Now, let's answer two more super important questions. One, how quickly does the AI learn? And is it as good as a human? So learning speed. Let's lock under the hood together and… Oh, yes, yes, yes, I am super happy. You are asking, Karoi, why are you super happy? I am super happy because learning is already happening by watching humans mingle for about 12 minutes. That is next to nothing. Amazing. And one more thing that makes me perhaps even happier, and that is that I don't see a sudden spike in the growth, I see a nice linear growth instead. Why is that important? Well, this means that there is a higher chance that the algorithm is slowly learning general concepts and starts understanding new things that we might ask it. And if it were a small spike, there would be a higher chance that it had seen something similar to a human clearing a table in the training set and suddenly started copying it. But with this kind of growth, there is less of a chance that it is just copying the teacher. I love it. And yes, this is the corner of the internet where we get unreasonably excited by a blue line. Welcome to 2 Minute Papers. Subscribe and hit the bell icon if you wish to see more amazing works like this. And if we look at the task of lifting a drum, oh yes. So nice linear growth, although at a slower pace than the previous task. Now let's look at how well it does its job. This is Team Human and MIA is Team AI. And it has an over 70% success rate. And remember, many of these tasks require not imitation, but learning. The AI sees some humans mingling with these scenes, but to be able to answer the questions, it needs to think beyond what it has seen. Once again, that might be perhaps a spark of intelligence. What a time to be alive. But actually, one more question. A virtual assistant is pretty cool, but why is this so important? What does this have to do with our lives? Well, have a look at how open AI trained the robot hand in a simulation to be able to rotate these ruby cubes. And then deployed the software onto a real robot hand and look. It can use the simulation knowledge and now it works in the real world too. But, seem to real as relevant to self-driving cars too. Look, Tesla is already working on creating virtual worlds and training their cars there. One of the advantages of that is that we can create really unlikely and potentially unsafe scenarios, but in these virtual worlds, the self-driving AI can train itself safely. And when they deploy them into the real world, they will have all this knowledge. Waymo is running similar experiments too. And I also wanted to thank you for watching this video. I truly love talking about these amazing research papers and I am really honored to have so many of you fellow scholars who are here every episode enjoying these incredible works with me. Thank you so much. So I think this one also has great potential for a seem to real situation. Looking to help humans in a virtual world and perhaps uploading the AI to a real robot assistant. So, what do you think? What else could this be useful for? What do you expect to happen? A couple more papers down the line? Please let me know in the comments below. I'd love to hear your thoughts. This episode has been supported by Lambda GPU Cloud. If you're looking for inexpensive Cloud GPUs for AI, check out Lambda GPU Cloud. Get this, they've recently launched an NVIDIA RTX 8000 with 48GB of memory. And hold onto your papers because Lambda GPU Cloud can cost less than half of AWS and Asia. And researchers at organizations like Apple, MIT and Caltech in using Lambda Cloud instances, workstations or servers. Make sure to go to LambdaLabs.com slash papers to sign up for one of their amazing GPU instances today. Our thanks to Lambda for their long-standing support and for helping us make better videos for you. Thanks for watching and for your generous support and I'll see you next time.