robots.txt actually has little to nothing to do with copyright, and more to do with &quot;unauthorized computer access&quot; which is protected by the CPAA.<p>It&#x27;s a guard against accidental access or publishing of sensitive data - which isn&#x27;t necessarily copyrighted but has other legal protections - as well as placing an unwanted burden on the server.