If example.com allowed indexing in 1999, a new owner of example.com can hide&#x2F;delete the 1999-2015 content by changing the robots.txt in 2015.<p>It would be better if archive.org would adhere to the robots.txt of the requested date&#x2F;year (show content of example.com from 1999-2014).