&gt; <i>Knowing when you don&#x27;t know the answer is something that has been lacking</i><p>Definitely, and I&#x27;m not sure why that space isn&#x27;t getting more attention. For RL there&#x27;s KWIK (knows what it knows)
<a href="http:&#x2F;&#x2F;www.research.rutgers.edu&#x2F;~lihong&#x2F;pub&#x2F;Li08Knows.pdf" rel="nofollow">http:&#x2F;&#x2F;www.research.rutgers.edu&#x2F;~lihong&#x2F;pub&#x2F;Li08Knows.pdf</a> [pdf]. A large class of problems (the robo TA being one of them) lend themselves very well to AI with error bounds, for lack of a better term.