title: How to execute a PHP spider/scraper but without it timing out
body: <p>Basically I need to get around max execution time.</p>
  
  <p>I need to scrape pages for info at varying intervals, which means calling the bot at those intervals, to load a link form the database and scrap the page the link points to.</p>
  
  <p>The problem is, loading the bot.  If I load it with javascript (like an Ajax call) the browser will throw up an error saying that the page is taking too long to respond yadda yadda yadda, plus I will have to keep the page open.</p>
  
  <p>If I do it from within PHP I could probably extend the execution time to however long is needed but then if it does throw an error I don't have the access to kill the process, and nothing is displayed in the browser until the PHP execute is completed right?</p>
  
  <p>I was wondering if anyone had any tricks to get around this?  The scraper executing by itself at various intervals without me needing to watch it the whole time.</p>
  
  <p>Cheers :)</p>