Answers.Body: <p>As a person who works with people who work on Watson, perhaps I can give some insight.</p>
  
  <p>The name <em>Watson</em> is casually thrown around a lot whilst many people aren't aware of its evolution into a larger suite of systems and services. We now have Chef Watson, Watson Health, and many other developing projects along the "cognitive" route. <em>Watson</em> is really an amalgamation and varied application of the different cognitive computing routes IBM is pursuing.</p>
  
  <p>So, there are many forms of NLP that Watson conducts and has conducted, developed by different teams to fit different processes, interconnected in different ways. Additionally, much (probably all) of it is proprietary/classified since, as one would imagine, ongoing research is constantly being conducted and added to Watson. This is likely your largest obstacle. The precise workings of the NLP of the Jeopardy flavor of Watson are probably themselves still classified (I can't find anything in the time I've just spent looking myself)</p>
  
  <p>There are, thus, many answers to this question; many outdated, and others not always applicable. The full answer is very complicated and, by the time you find out what the answer is today, it's probably already been advanced. The researches I know are always working on new, cutting-edge algorithms and processes for text classification and the related NLP topics. See, for example, this article <a href="http://www.aaai.org/Magazine/Watson/watson.php" rel="nofollow noreferrer">http://www.aaai.org/Magazine/Watson/watson.php</a>, where it is stated</p>
  
  <blockquote>
    <p>For the Jeopardy Challenge, we use more than 100 different techniques for analyzing natural language, identifying sources, finding and generating hypotheses, finding and scoring evidence, and merging and ranking hypotheses.</p>
  </blockquote>
  
  <p>and</p>
  
  <blockquote>
    <p>Watson's metalearner uses multiple trained models to handle different question classes as, for instance, certain scores that may be crucial to identifying the correct answer for a factoid question may not be as useful on puzzle questions</p>
  </blockquote>
  
  <p>Most of these techniques have likely already been modified, adapted, or dropped altogether for other methods.</p>
  
  <p>To point you to more information, take a look at the links below.</p>
  
  <h3>General</h3>
  
  <ul>
  <li><p><a href="http://researcher.watson.ibm.com/researcher/view_group.php?id=2099" rel="nofollow noreferrer">The DeepQA Research Team</a>, specifically, have a look at <a href="https://researcher.watson.ibm.com/researcher/view_group_pubs.php?grp=2099" rel="nofollow noreferrer">their publications</a></p></li>
  <li><p><a href="http://www.research.ibm.com/artificial-intelligence/" rel="nofollow noreferrer">IBM Research AI</a></p></li>
  </ul>
  
  <h3>Articles</h3>
  
  <ul>
  <li><a href="http://www.aaai.org/Magazine/Watson/watson.php" rel="nofollow noreferrer">Building Watson: An Overview of the DeepQA Project</a> (2010) written by the IBM Watson Research Team, led by David Ferucci, and published in AI Magazine Fall, 2010.</li>
  </ul>
  
  <h3>Videos</h3>
  
  <ul>
  <li><a href="https://www.youtube.com/watch?v=r7E1TJ1HtM0" rel="nofollow noreferrer">How does IBM Watson work?</a> (2018), by IBM Watson, which states that Watson uses deep learning and transfer learning</li>
  </ul>
  
  <h3>Other</h3>
  
  <ul>
  <li><a href="https://academic.oup.com/jamia/article/18/5/544/829676" rel="nofollow noreferrer">Natural language processing: an introduction</a> (2011), a good but technical paper on natural language understanding (that acknowledges Watson)</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2016-08-17T14:41:03.707Z
Answers.LastActivityDate: 2019-06-29T23:19:56.893Z
Answers.LastEditDate: 2019-06-29T23:19:56.893Z
Answers.UserDisplayName: Avik Mohan
Body: <p>What AI techniques does IBM use for its Watson platform (specifically, its natural language processing part)?</p>
  
Tags: <natural-language-processing><watson>
Title: What are the main AI technologies behind the Watson platform?
UserDisplayName: kenorb
ThreadText: # What are the main AI technologies behind the Watson platform?
  
  (Asked by: username_0 on 2016-08-03)
  
  What AI techniques does IBM use for its Watson platform (specifically, its natural language processing part)?
  
  **Tags:** natural-language-processing, watson
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2016-08-17. Score: 4 | Accepted answer
  
  As a person who works with people who work on Watson, perhaps I can give some insight.
  
  The name *Watson* is casually thrown around a lot whilst many people aren't aware of its evolution into a larger suite of systems and services. We now have Chef Watson, Watson Health, and many other developing projects along the "cognitive" route. *Watson* is really an amalgamation and varied application of the different cognitive computing routes IBM is pursuing.
  
  So, there are many forms of NLP that Watson conducts and has conducted, developed by different teams to fit different processes, interconnected in different ways. Additionally, much (probably all) of it is proprietary/classified since, as one would imagine, ongoing research is constantly being conducted and added to Watson. This is likely your largest obstacle. The precise workings of the NLP of the Jeopardy flavor of Watson are probably themselves still classified (I can't find anything in the time I've just spent looking myself)
  
  There are, thus, many answers to this question; many outdated, and others not always applicable. The full answer is very complicated and, by the time you find out what the answer is today, it's probably already been advanced. The researches I know are always working on new, cutting-edge algorithms and processes for text classification and the related NLP topics. See, for example, this article <http://www.aaai.org/Magazine/Watson/watson.php>, where it is stated
  
  > For the Jeopardy Challenge, we use more than 100 different techniques for analyzing natural language, identifying sources, finding and generating hypotheses, finding and scoring evidence, and merging and ranking hypotheses.
  
  and
  
  > Watson's metalearner uses multiple trained models to handle different question classes as, for instance, certain scores that may be crucial to identifying the correct answer for a factoid question may not be as useful on puzzle questions
  
  Most of these techniques have likely already been modified, adapted, or dropped altogether for other methods.
  
  To point you to more information, take a look at the links below.
  
  ### General
  
  * [The DeepQA Research Team](http://researcher.watson.ibm.com/researcher/view_group.php?id=2099), specifically, have a look at [their publications](https://researcher.watson.ibm.com/researcher/view_group_pubs.php?grp=2099)
  * [IBM Research AI](http://www.research.ibm.com/artificial-intelligence/)
  
  ### Articles
  
  * [Building Watson: An Overview of the DeepQA Project](http://www.aaai.org/Magazine/Watson/watson.php) (2010) written by the IBM Watson Research Team, led by David Ferucci, and published in AI Magazine Fall, 2010.
  
  ### Videos
  
  * [How does IBM Watson work?](https://www.youtube.com/watch?v=r7E1TJ1HtM0) (2018), by IBM Watson, which states that Watson uses deep learning and transfer learning
  
  ### Other
  
  * [Natural language processing: an introduction](https://academic.oup.com/jamia/article/18/5/544/829676) (2011), a good but technical paper on natural language understanding (that acknowledges Watson)
  
  
  ---
  
  