Answers.Body: <p>Check SpaCy, it's a powerful NLP library that provides lot of different language models, including one for <a href="https://spacy.io/models/pt" rel="nofollow noreferrer">Portuguese</a>.</p>
  <p>To answer the more generic question, translating to another language undermines the whole purpose of text pre-processing. Not only will translating generate errors, even when translating to a common language like English, but most importantly, you're forgetting that every language has its own specific linguistic characteristics, like different grammatical genders, tenses, grammar rules for plurals and adjectives, adverbs and so on. By translating you'll throw all that information in the bin.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-22T08:10:27.290Z
Answers.LastActivityDate: 2021-10-22T08:36:21.847Z
Answers.LastEditDate: 2021-10-22T08:36:21.847Z
Answers.UserDisplayName: Edoardo Guerriero
Body: <p>For non-English languages (in my case Portuguese), what is the best approach? Should I use the not-so-complete tools in my language, or should I translate the text to English, and after using the tools in English? Lemmatization, for example, is not so good in non-English languages.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-10-22T06:53:18.373Z
Comments.Text: The answer may depend on the task, for instance if your task is Portuguese to Russian translation, the answer may be different than a classifier. I am not sure, because not an NLP expert. However, it is probably worth explaining briefly what kind of processing you are performing with the input written text.
Comments.UserDisplayName: Neil Slater
Tags: <natural-language-processing><data-preprocessing><machine-translation><lemmatization>
Title: Given the immaturity of NLP tools for non-English languages, should I first translate the non-English language to English before text pre-processing?
UserDisplayName: Vinícius Araújo
ThreadText: # Given the immaturity of NLP tools for non-English languages, should I first translate the non-English language to English before text pre-processing?
  
  (Asked by: username_0 on 2021-10-22)
  
  For non-English languages (in my case Portuguese), what is the best approach? Should I use the not-so-complete tools in my language, or should I translate the text to English, and after using the tools in English? Lemmatization, for example, is not so good in non-English languages.
  
  **Tags:** natural-language-processing, data-preprocessing, machine-translation, lemmatization
  > **Comments:**
  > **username_1**: The answer may depend on the task, for instance if your task is Portuguese to Russian translation, the answer may be different than a classifier. I am not sure, because not an NLP expert. However, it is probably worth explaining briefly what kind of processing you are performing with the input written text.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2021-10-22. Score: 1 | Accepted answer
  
  Check SpaCy, it's a powerful NLP library that provides lot of different language models, including one for [Portuguese](https://spacy.io/models/pt).
  
  To answer the more generic question, translating to another language undermines the whole purpose of text pre-processing. Not only will translating generate errors, even when translating to a common language like English, but most importantly, you're forgetting that every language has its own specific linguistic characteristics, like different grammatical genders, tenses, grammar rules for plurals and adjectives, adverbs and so on. By translating you'll throw all that information in the bin.
  
  
  ---
  
  