title: how to know if the url is crawled by robots or clicked by user?
body: <p>Daily I am getting same error from same IP at different time intervals.
  Here are details,</p>
  
  <pre><code>&lt;site_name&gt; &lt;same_site_name's_IP&gt; - - [13/May/2012:16:27:30 +0100] "POST /forum/updateuserpassword.php HTTP/1.1" 500 237 "http://localhost/mgh/auth" "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9" mod_deflate: In:- Out:-:-pct.
  </code></pre>
  
  <p>some times it gets accepted showing 200 25 instead of 500 237 ....</p>
  
  <p>What may be the issue?</p>
  
  <p>Thanks</p>