I imagine a webcam capture to a window could then be inspected with a tool such as <a href="http:&#x2F;&#x2F;www.sikulix.com&#x2F;" rel="nofollow">http:&#x2F;&#x2F;www.sikulix.com&#x2F;</a><p>I was attemping to scrap a Flash newspaper website with PHP and found it wasnt possible easily with Curl, so i wanted to automate navigating chrome and the Flash app using Sikulix about a year ago ... So I imagine Sikulix or a similar tool could be the glue you want to marry your robot tool with information you inspect from the webcam&#x2F;LCD screens.<p>Sounds like a fair amount of work though.