DeepMind says reinforcement learning is ‘enough’ to reach general AI
The layman and the AI expert have both written off the possibility of creating AGI for the entirety of this latest AI spring. In the past decade I have basically never encountered anyone who thought that AGI was going to happen in our lifetimes or even anyone who believed that it would be a problem if it did.<p>One time I discussed AGI with a good friend. And I gently pressured him to play through the scenario of the advent of AGI. And he made a guilty confession to me. I could tell he was embarrassed to share his opinion. He said “can’t we just unplug it?” This is a microcosm of the entire issue. It’s something a child might say. For global warming, can’t we just turn on the air conditioning? No, we can’t just unplug it.<p>Here is how you can understand what is happening. An AI model is just a program. A program that is written by another program.<p>Consider a list of programs that contains every possible program. It is infinite. Make it finite by limiting the size of the programs based on some practical consideration. It’s still a very long list.<p>What is in this list? Pong. StyleGAN. AGI? Almost certainly. How small might AGI be? It probably appears more than once on the list — how many are there? But let’s ask the real question here and boil this down. How many items on the list are something we will regret having discovered? A great, great many.<p>Every day, people are exploring the list. They are using primitive methods to sift through all these programs and find the ones that have interesting behavior. The process of program discovery is automated with things called “training algorithms.” As our computers get faster and capital allocation grows larger we mine this list more and more quickly. The problem is that we keep finding things that surprise us. And that is the core and substance of the entire issue. We have demonstrated to ourselves over and over again that our own intuition about the contents of this list is completely wrong. Despite the mind-boggling level of mental gymnastics performed in the wake of GTP-3, enough to constitute a three ring circus, the fact of the matter is that GTP-3 and soon to be 4 is not supposed to exist according to every single AI expert. Compute is only getting cheaper and capital is only getting bigger and the list is only getting shorter and it’s not going to stop surprising everyone including the “experts.” Just because we don’t know how to make something we will truly regret doesn’t mean we aren’t capable of creating it.