Grandmaster level in StarCraft II using multi-agent reinforcement learning
&gt; <i>Agents were capped at a max of 22 agent actions per 5 seconds, where one agent action corresponds to a selection, an ability and a target unit or point, which counts as up to 3 actions towards the in-game APM counter. Moving the camera also counts as an agent action, despite not being counted towards APM.</i><p>I&#x27;m happy to see that they&#x27;ve greatly improved the APM cap. During the earlier showmatch they had an extremely naive cap on the average APM during the whole game. Which meant that the AI could take it easy for most of the time and then during battle sequences hit peaks of 2000 APM. Also the previous cap was based on the in-game APM counter, which doesn&#x27;t count some things like moving the camera, which is now addressed. The current state sounds a lot better.<p>However it seems still superhuman in mechanical non-strategy ways, e.g. a human can misclick (click too early&#x2F;late when moving the mouse, or just miss the target with the cursor completely) or do accidental double clicks etc. These end up being very costly mistakes against a zero mechanical mistake AI. Which in turn means that the AI can win with an inferior strategy due to the extra gains it has via superior mechanical accuracy. In other words this artificial intelligence is still under significacnt artificial motor skills welfare, and thus even if it starts beating pro players we shouldn&#x27;t be too quick to talk about how it&#x27;s the intelligence part that got it the win.<p>All of that said, I&#x27;m liking the progress and am excited to see what they achieve with this next. Would love another showmatch against pro players.