For our Text modality , we use deWaC , a large German web corpus created by the WaCKy group ( Baroni et al. , 2009 ) containing approximately 1.7 B word tokens .
the wacky wide web a collection of very large linguistically processed webcrawled corpora language resources and evaluation
Marco Baroni Silvia Bernardini Adriano Ferraresi Eros Zanchetta
For our Text modality , we use deWaC , a large German web corpus created by the WaCKy group ( Baroni et al. , 2009 ) containing approximately 1.7 B word tokens . We filtered the corpus by : removing words with unprintable characters or encoding troubles ; removing all stopwords ; removing word types with a total frequency of less than 500 ; and removing documents with a length shorter than 100 .
For our Text modality , we use deWaC , a large German web corpus created by the WaCKy group ( @@CITATION ) containing approximately 1.7 B word tokens .