Unfortunately, the ways AI researchers measure and compare their results to human performance are often rather weird and favor algorithms via.. let&#x27;s say &quot;unusual&quot; experiment setup.<p>For example, face recognition performance is often measured by comparing two random faces taken from a sample set. In real life, the &quot;problem&quot; is almost always to match a random face against the entire set of faces you remember. Performance in these two tasks is not at all equivalent.<p>I&#x27;ve seen similarly weird problem formulations in many other AI research papers.