AlphaGo shows its true strength in 3rd victory against Lee Sedol
How strong is AlphaGo?<p>DeepMind doesn&#x27;t generally comment on these sorts of things, but I think they knew it would be strong,  just not how strong.<p>It is hard to accurately gauge the playing strength of such a program for the following reasons:<p>* Go is not solved, it doesn&#x27;t really even admit a good heuristic for close games. 
In chess, given enough time, we can do a pretty good job of searching the possible outcomes from a given position, and even if we can&#x27;t evaluate all the possible endgames, evaluation functions exist that give us an idea of which side is ahead when we terminate the search.
Go has a much higher branching factor (more moves available at each turn, making the search more expensive) and short of a catastrophic blunder, it&#x27;s hard to quantify who is ahead at each point in time[1].
So we can&#x27;t (in general) quantify optimal play, and therefore cannot quantify how much AlphaGo (or anyone else) deviates from it.<p>* One known aspect of programs using Monte Carlo Tree Search is that they play to win, and are willing to sacrifice margin of victory to maintain or increase their odds of winning. 
According to some people I&#x27;ve talked to, this can be suboptimal, but there are methods of addressing this[2].
Note that you can&#x27;t just change the objective function from &quot;winning&quot; to &quot;win by as much as possible&quot; without potentially reducing AlphaGo&#x27;s strength.<p>* The value function learned by a deep net is hard to interpret, partly because it encodes information about the possible futures arising from a position, and partly because it involves a tremendous number of calculations to compute.
We do not know what it is representing at the intermediate levels-- techniques that aim to visualize or cluster unit activations can provide a bit of insight, but there&#x27;s always the possibility that we&#x27;re interpreting the patterns incorrectly because we&#x27;re trying to fit it into the framework of &quot;what would a human think?&quot;.
Further, the representation is somewhat monolithic-- we can&#x27;t tweak the value of one thing without changing the values of others.
In chess engines, we might modify the material value of, say, a knight, without affecting the value of a rook.
In a convolutional net, if we adjust the value of one position, it will tend to affect the value of many others.<p>* We can attempt to quantify its strength by comparing it to other programs, but AlphaGo has already crushed other programs (99% win rate), so all that it tells us is that it is stronger than those programs.<p>Essentially, without the ability to perform a significant amount of searching, or gauge strength via margin-of-victory, or to examine the program from other angles, it&#x27;s hard to gauge just how good the program is.<p>The only thing we can do is throw skilful opponents at it, and see if it fails eventually[3].
In its current incarnation, though, it seems like its playing strength is just going to be &quot;stronger than you&quot;.<p>---<p>1. Hence the need for Deep Reinforcement Learning-- we learn how valuable each position is based on the results of the positions that it can lead to.<p>2. By modifying the search to maintain a given margin once it has been attained-- but I do not work at DeepMind, nor am I an expert on MCTS like some of my colleagues, so I don&#x27;t know if this could adversely affect AlphaGo&#x27;s overall strength.<p>3. We might be able to get a better idea by having extremely strong players play against weaker versions of AlphaGo (ones with less computing power) and then sort of telescope upwards once a good baseline has been set, but it remains to be seen if the current level of invincibility is due to it not having been around long enough for its weaknesses to become apparent[4].<p>4. How would an AI researcher play against it? I&#x27;ve talked to a few people, and the answers have been: (a) play the game to the conclusion, don&#x27;t resign; (b) attempt to take the game off-the-rails into parts of the state-space it hasn&#x27;t really explored before (although this is risky because the human player is more likely to make mistakes in these cases as well), and (c) let it get ahead somewhat so that it &quot;relaxes&quot; (see the points about margin), allowing you to catch up and overtake it.