title: Can I block search crawlers for every site on an Apache web server?
body: <p>I have somewhat of a staging server on the public internet running copies of the production code for a few websites. I'd really not like it if the staging sites get indexed.  </p>
  
  <p>Is there a way I can modify my httpd.conf on the staging server to block search engine crawlers?  </p>
  
  <p>Changing the robots.txt wouldn't really work since I use scripts to copy the same code base to both servers.  Also, I would rather not change the virtual host conf files either as there is a bunch of sites and I don't want to have to remember to copy over a certain setting if I make a new site.</p>