 Dear Fellow Scholars, this is Two Minute Papers with Dr. Karo Zsolnai-Fahir. Today, you will see an absolute banger paper. This is about how amazingly, and videos virtual characters can move around after they have trained for 10 years. 10 years? We don't have 10 years for a project? Well, luckily we don't have to wait for 10 years. Why is that? I will tell you exactly why in a moment. But believe me, these folks are not natural born warriors. They are AI agents that have to train for a long, long time to become so good. So, how does that work? Well, first, our candidates are fed a bunch of basic motions, and then are dropped into Nvidia's Isaac, which is a virtual gym where they can hone their skills. But, unfortunately, they have none. After a week of training, I expected that they would showcase some amazingly athletic warrior moves, but instead we got this. Oh my goodness. And well, let's be optimistic and say that they are practicing judo, where the first lesson is learning how to fall. Yes, let's say that. Then, after two months, oh, we can witness some improvement. Well, now they are not falling, and they can do some basic movement. But they still look like constipated warriors. After two years, we are starting to see something that resembles true fight moves. These are not there yet, but they have improved a great deal. Except this chap. This chap goes like, Sir, I've been training for two years. I've had enough, and now I shall leave. In style. I wonder what these will look like in eight more years of training. Well, hold onto your papers and let's see together. Oh my, that is absolutely amazing. Now that's what I call a bunch of real fighters. See, time is the answer. It even made our stylish chap take his training seriously. So, which one is your favorite from here? Did you find some interesting movements? Let me know in the comments below. Now, I promise that we will talk about the ten-year thing. So, these scientists at Nvidia start this paper in 2012. Well, not quite. This is ten years of training, but in a virtual world. However, a real-world computer simulates this virtual world, and it can do it much quicker than that. How much quicker? Well, the powerful machine can simulate these ten years, not in ten years, but in ten days. Oh, yes. Now that sounds much better. And we are not done yet, not even close. When reading this paper, I was so happy to find out that this new technique also has four more amazing features. One, it works with latent spaces. What is that? A latent space is a meta place where similar kinds of data are laid out to be close to each other. In our earlier paper, we used such a space to create beautiful virtual materials for virtual worlds. Nvidia here uses a latent space to switch between the motion types that the character now knows, and not only that, but the AI also learned how to weave these motions together, even if they were not combined together in the training data. That is incredible. Two, this is my favorite. It has to be. They not only learn to fall, but in those ten years, they also had plenty of opportunity to learn to get up. Do you know what this means? Of course, this means the favorite pastime of the computer graphics researcher, and there is throwing boxes at virtual characters. We like to say that we are testing whether the character can recover from random perturbations. That sounds a little more scientific. And these AI agents are passing with flying colors, or flying boxes, if you will. Wow! Three, also the controls are excellent. Look, this really has some amazing potential to be used in virtual worlds, because we can even have the character face one way, and move into a different direction at the same time. More detailed poses can also be specified. And what's more, with this, we can even enter a virtual environment and strike down these evil pillars with precision. Loving it. Four, these motions are synthesized adversarially. This means that we have a generator neural network creating these new kinds of motions. But we connected to another neural network called the discriminator that watches it and ensures that the generated motions are similar to the ones in the data set and seem real too. And as they battle each other, they also improve together, and in the end, we take only the motion types that are good enough to fall the discriminator. Hopefully, these are good enough to fall the human eye too. And as you see, the results speak for themselves. If we wouldn't be doing it this way, here is what we would get if we trained these agents from scratch. And yes, while we are talking about training, this did not start out well at all. Imagine if scientists at Nvidia quit after just one week of training, which is about 30 minutes in real time. These results are not too promising, are they? But they still kept going. And the result was this. That is excellent life advice right there, and also an excellent opportunity for us to invoke the third law of papers. Not the first, the third one. This says that a bad researcher fails 100% of the time, while a good one only fails 99% of the time. Hence, what you see here is always just 1% of the work that was done. And all this is done by Nvidia, so I am sure that we will see this deployed in real-world projects where these amazing agents will get democratized by putting it into the hands of all of us. What a time to be alive! So, as this gets your mind going, what would you use this for? Let me know in the comments below. What you see here is a report of this exact paper we have talked about, which was made by Wades and Biasis. I put a link to it in the description. Make sure to have a look, I think it helps you understand this paper better. Wades and Biasis provides tools to track your experiments in your deep learning projects. Using their system, you can create beautiful reports like this one to explain your findings to your colleagues better. It is used by many prestigious labs, including OpenAI, Toyota Research, GitHub, and more. And the best part is that Wades and Biasis is free for all individuals, academics, and open source projects. Make sure to visit them through wnb.com slash papers or just click the link in the video description and you can get a free demo today. Our thanks to Wades and Biasis for their long-standing support and for helping us make better videos for you. Thanks for watching it for your generous support and I'll see you next time.