This is what I was saying yesterday! Things are open so there is not much any of us can do individually if a bad actor ignores the robots.txt. They will need to do some sort of api agreement, but the enforcement of that would still be difficult.