Answers.Body: <p>Have you tried <a href="http://www.nltk.org/" rel="nofollow noreferrer">NLTK</a>, what you are looking for is in <a href="http://www.nltk.org/book/ch06.html" rel="nofollow noreferrer">Chapter 6</a> of the book. Basically what you need to do is:</p>
  
  <ul>
  <li>Tokenize the user input.</li>
  <li>Extract vector set from the tokenized words.</li>
  <li>Train your model with some given texts, and same vector sets.</li>
  </ul>
  
  <p>And you can use your model to categorize the document.</p>
  
  <p>One other suggestion, instead of extracting vector sets you can use every word in the input
  to be evaluated in to some category using a training set of large corpus, which you are sure
  it contains all the words.
  And then you multiply probability of each word being on a category to decide where the document belongs.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-12-31T06:23:04.337Z
Answers.LastActivityDate: 2017-01-12T12:27:07.703Z
Answers.LastEditDate: 2017-01-12T12:27:07.703Z
Answers.UserDisplayName: Cbrom
Body: <p>I am working on a project, wherein I take input from the user as free text and try to relate the text to what the user might mean. I have tried <strong>Stanford NLP</strong> which tokenizes the text into tokens, but I am not able to categorize the input. For example, the user might be greeting someone or sharing some problem he is facing. In case he is sharing some problem I need to categorize the problem as well.</p>
  
  <p>Can someone help me with from where should I start?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-01-12T13:33:55.283Z
Comments.Text: First figure out what all you want to figure out, unless you know what all you want to detect there is no way you could solve this problem as the problem is not defined yet. More formally, you need to know what are your output variables. Any algorithmic problem is defined by its input and output variables.
Comments.UserDisplayName: Ankur
Tags: <natural-language-processing>
Title: Can I categorise the user input which I get as free text?
UserDisplayName: Karan Khanna
ThreadText: # Can I categorise the user input which I get as free text?
  
  (Asked by: username_0 on 2016-12-07)
  
  I am working on a project, wherein I take input from the user as free text and try to relate the text to what the user might mean. I have tried **Stanford NLP** which tokenizes the text into tokens, but I am not able to categorize the input. For example, the user might be greeting someone or sharing some problem he is facing. In case he is sharing some problem I need to categorize the problem as well.
  
  Can someone help me with from where should I start?
  
  **Tags:** natural-language-processing
  
  > **Comments:**
  > **username_1**: First figure out what all you want to figure out, unless you know what all you want to detect there is no way you could solve this problem as the problem is not defined yet. More formally, you need to know what are your output variables. Any algorithmic problem is defined by its input and output variables.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2016-12-31. Score: 2
  
  Have you tried [NLTK](http://www.nltk.org/), what you are looking for is in [Chapter 6](http://www.nltk.org/book/ch06.html) of the book. Basically what you need to do is:
  
  * Tokenize the user input.
  * Extract vector set from the tokenized words.
  * Train your model with some given texts, and same vector sets.
  
  And you can use your model to categorize the document.
  
  One other suggestion, instead of extracting vector sets you can use every word in the input
  to be evaluated in to some category using a training set of large corpus, which you are sure
  it contains all the words.
  And then you multiply probability of each word being on a category to decide where the document belongs.
  
  
  ---
  
  