Wow. This might be perfect for advanced screen scraping.<p>"GUI Testing Using Computer Vision"<p><a href="http://groups.csail.mit.edu/uid/projects/sikuli/sikuli-chi2010.pdf" rel="nofollow">http://groups.csail.mit.edu/uid/projects/sikuli/sikuli-chi20...</a><p>EDIT: It appears it cannot grab the actual text using the Native APIs so you would have to include a pipeline to OCR black-on-white text