Videolan.org robots.txt
These are some cute "fuck off"s but its unlikely that these sites actually respect the robots.txt, right?Correct me if I'm wrong: After the recent web scraping ruling[1] it seems that it's perfectly legal to ignore the robots.txt.[1] https://news.ycombinator.com/item?id=31075396