title: Why solr RemoveDuplicatesTokenFilterFactory dont work?
body: <p>My schema.xml is splitting product name and then uses RemoveDuplicate to remove duplicated words after split.</p>
  
  <pre><code>    &lt;fieldType name="type_name" class="solr.TextField"&gt;
          &lt;analyzer type="index"&gt;
              &lt;tokenizer class="solr.PatternTokenizerFactory" pattern="\|| " /&gt;
              &lt;filter class="solr.LowerCaseFilterFactory"/&gt;
              &lt;filter class="solr.RemoveDuplicatesTokenFilterFactory"/&gt;
  </code></pre>
  
  <p>And in query analyzer I see that RemoveDuplicatesTokenFilterFactory did absolutely nothing to duplicated words. Why?</p>
  
  <p><img src="https://i.stack.imgur.com/Jh4xq.png" alt="enter image description here"></p>