Secondly , we need to investigate techniques for identifying identical documents , virtually identical documents and highly repetitive documents , such as those pioneered by Fletcher ( 2004b ) and shingling techniques described by Chakrabarti ( 2002 ) .
facilitating the compilation and dissemination of adhoc web corpora
W H Fletcher
From a computational linguistic view , the framework will also need to take into account the granularity of the unit ( for example , POS tagging requires sentence-units , but anaphoric annotation needs paragraphs or larger ) . Secondly , we need to investigate techniques for identifying identical documents , virtually identical documents and highly repetitive documents , such as those pioneered by Fletcher ( 2004b ) and shingling techniques described by Chakrabarti ( 2002 ) . The second stage of our work will involve implementing the framework within a P2P environment .
Secondly , we need to investigate techniques for identifying identical documents , virtually identical documents and highly repetitive documents , such as those pioneered by @@CITATIONb ) and shingling techniques described by Chakrabarti ( 2002 ) .