As I said, the problem is writing the tests and knowing what to measure. How do you discern between a bunch of tests and measurements that are poorly-designed, and a bunch that are well-designed? You gather a bunch of people with good taste, and trust their gut.<p>But at that point, why not just cut out the middleman, forget the tests, and let the artists be artists?<p>See also: Footnote 3 of <a href="http:&#x2F;&#x2F;www.paulgraham.com&#x2F;colleges.html#f3n" rel="nofollow">http:&#x2F;&#x2F;www.paulgraham.com&#x2F;colleges.html#f3n</a>