title: Block bots by specific urls with robots.txt in php apache environment
body: <p>Strange case, Yandex bot is massively overloading my website. The problem is mine obviously, as I have some ajax filters on website active but quite heavy if they are called altogether like bots do. </p>
  
  <p>I have tried with many <code>robots.txt</code>, but they are having no effect. The kind of URL needed to be blocked are in this following form:</p>
  
  <pre><code> /de/component/customfilters/0-zu-15-eur/nKein+Herstellerf.html?custom_f_116[0]=38&amp;custom_f_116[1]=4c&amp;custom_f_116[2]=39&amp;start=100
  </code></pre>
  
  <p>But they are URL rewrited not physical. The physycal folder is already blocked in <code>robotx.txt</code></p>
  
  <p>How can solve this and how can check if Yandex bot are not reading the <code>robots.txt</code> file? </p>
  
  <p>Every time I edit <code>robots.txt</code> file should I restart Apache? I think no like htaccess</p>