How I got sued by Facebook
"Their contention was robots.txt had no legal force and they could sue anyone for accessing their site even if they scrupulously obeyed the instructions it contained. The only legal way to access any web site with a crawler was to obtain prior written permission."This is ridiculous. Can someone release the data so this can be tested in court? EFF?