Answers.Body: <p>When automating tasks involving text, NLP techniques are definitely the way to go! Let me be frank, though, starting from scratch and "read and understand" will be harder with <em>today's tools</em> than directly reading the papers.</p>
  
  <p>Some typical required skills are below, and the bar height will depend on your mileage:</p>
  
  <ul>
  <li>Knowledge of NLP (e.g. terminology like <a href="https://en.wikipedia.org/wiki/Word_embedding" rel="nofollow noreferrer">embeddings</a>, bag of words, even perhaps <a href="https://en.wikipedia.org/wiki/Tf%E2%80%93idf" rel="nofollow noreferrer">tf-idf</a>).</li>
  <li>Knowledge of NLP libraries and implementation frameworks (e.g. <a href="https://stanfordnlp.github.io/CoreNLP/" rel="nofollow noreferrer">Stanford's</a> or <a href="https://www.tensorflow.org/tutorials/text_classification_with_tf_hub" rel="nofollow noreferrer">TensorFlow</a>).</li>
  <li>Knowledge of a programming language (e.g. Python or Java).</li>
  </ul>
  
  <p>In short, the goal you set will probably require many more papers than expected. But if you succeed only the automated reading / summary part, you have a bright future ahead (let aside <em>understanding</em>, a way more contentious problem).</p>
  
  <p>Just for the sake of putting an example, companies like <a href="https://iris.ai/" rel="nofollow noreferrer">Iris.ai</a> and others try to solve related problems---great potential, but definitely challenging.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T06:49:54.943Z
Answers.Text: I do not usually understand the papers I read, so I'm looking for some help (AI). Thanks for your answer.
Answers.UserDisplayName: VansFannel
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T06:57:36.747Z
Answers.Text: Sorry just for my own understanding, are you saying with the frameworks like Stanford's and programming language we can write an application that reads and analyses documents and answers questions or this is still a challenging issue? How does these chat bots like Oracle's do this?
Answers.UserDisplayName: xbmono
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T08:35:32.653Z
Answers.Text: @VansFannel Understanding the papers takes time and work. AI is a broad topic, even if we are just talking about NLP. Perhaps you can select something that motivates you, and start from there. That should lead you to more understanding toward next steps, and more questions to ask here. Narrow question are easier to get attention and answers.
Answers.UserDisplayName: Eric Platon
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T08:38:35.370Z
Answers.Text: @xbmono The existing tools and techniques have qualities and limitations, yet they can be used for many problems that have not been tried yet. For example, one of my previous employers used the Stanford NLP library to perform automated comment moderation (similar to spam filtering). Now the tools have limitations, and there are a lot of challenges. NLP libraries usually break facing indirect speech, some forms of humour, etc. And NLP libraries are usually ignorant of context, e.g. in a discussion thread. A lot possible, and a lot yet to do!
Answers.UserDisplayName: Eric Platon
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T08:45:41.130Z
Answers.Text: @EricPlaton Thanks, but it was only a joke. Thanks again.
Answers.UserDisplayName: VansFannel
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T17:12:52.743Z
Answers.Text: I have received this on email a few minutes ago, coincidence?: https://software.seek.intel.com/DLNaturalLanguageWebinar_Reg
Answers.UserDisplayName: VansFannel
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-05-30T06:42:55.350Z
Answers.LastActivityDate: 2018-05-30T06:42:55.350Z
Answers.UserDisplayName: Eric Platon
Body: <p>I have to read a lot of papers, and I thought that I can use an A.I. to read them and summarize them. Maybe find one that can understand what the papers are talking about it seems a lot to ask.</p>
  
  <p>I think I can use natural language processing. Is it the right choice?</p>
  
  <p>I'm sorry, but I'm new in A.I. and I don't know much about it.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-05-27T17:24:19.347Z
Comments.Text: I don’t hunk there exists such an AI that is open. Yet. Might be wrong though, so just hang in there!
Comments.UserDisplayName: Andreas Storvik Strauman
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-05-28T07:38:50.783Z
Comments.Text: Besides searching to something done, I'm also asking, how can I do it? Maybe, I can use natural language processing.
Comments.UserDisplayName: VansFannel
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-05-30T06:46:03.800Z
Comments.Text: I am also interested to know if there is any online service or API that does this. For example, it scans documents and answers the questions as per the facts it learnt from the docs. From my understanding, Google Cloud NL can analyse documents to extract information but I don't know if it can also answer your questions. With Google you can have docs in Q/A and it parses intents from the docs but again not sure if it is answering your questions? Do we need another service to feed the analysed docs to chat with AI?
Comments.UserDisplayName: xbmono
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-05-30T07:40:10.873Z
Comments.Text: This field of AI is called 'automatic text summarisation'.  An Internet search of that term will get you started.
Comments.UserDisplayName: DrMcCleod
Tags: <natural-language-processing>
Title: How can I build an AI with NLP that reads and understands documents?
UserDisplayName: VansFannel
ThreadText: # How can I build an AI with NLP that reads and understands documents?
  
  (Asked by: username_0 on 2018-05-27)
  
  I have to read a lot of papers, and I thought that I can use an A.I. to read them and summarize them. Maybe find one that can understand what the papers are talking about it seems a lot to ask.
  
  I think I can use natural language processing. Is it the right choice?
  
  I'm sorry, but I'm new in A.I. and I don't know much about it.
  
  **Tags:** natural-language-processing
  
  > **Comments:**
  > **username_1**: I don’t hunk there exists such an AI that is open. Yet. Might be wrong though, so just hang in there!  
  > **username_0**: Besides searching to something done, I'm also asking, how can I do it? Maybe, I can use natural language processing.  
  > **username_2**: I am also interested to know if there is any online service or API that does this. For example, it scans documents and answers the questions as per the facts it learnt from the docs. From my understanding, Google Cloud NL can analyse documents to extract information but I don't know if it can also answer your questions. With Google you can have docs in Q/A and it parses intents from the docs but again not sure if it is answering your questions? Do we need another service to feed the analysed docs to chat with AI?  
  > **username_3**: This field of AI is called 'automatic text summarisation'.  An Internet search of that term will get you started.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_4 on 2018-05-30. Score: 2 | Accepted answer
  
  When automating tasks involving text, NLP techniques are definitely the way to go! Let me be frank, though, starting from scratch and "read and understand" will be harder with *today's tools* than directly reading the papers.
  
  Some typical required skills are below, and the bar height will depend on your mileage:
  
  * Knowledge of NLP (e.g. terminology like [embeddings](https://en.wikipedia.org/wiki/Word_embedding), bag of words, even perhaps [tf-idf](https://en.wikipedia.org/wiki/Tf%E2%80%93idf)).
  * Knowledge of NLP libraries and implementation frameworks (e.g. [Stanford's](https://stanfordnlp.github.io/CoreNLP/) or [TensorFlow](https://www.tensorflow.org/tutorials/text_classification_with_tf_hub)).
  * Knowledge of a programming language (e.g. Python or Java).
  
  In short, the goal you set will probably require many more papers than expected. But if you succeed only the automated reading / summary part, you have a bright future ahead (let aside *understanding*, a way more contentious problem).
  
  Just for the sake of putting an example, companies like [Iris.ai](https://iris.ai/) and others try to solve related problems---great potential, but definitely challenging.
  
  > **Comments:**
  > **username_0**: I do not usually understand the papers I read, so I'm looking for some help (AI). Thanks for your answer.  
  > **username_2**: Sorry just for my own understanding, are you saying with the frameworks like Stanford's and programming language we can write an application that reads and analyses documents and answers questions or this is still a challenging issue? How does these chat bots like Oracle's do this?  
  > **username_4**: @username_0 Understanding the papers takes time and work. AI is a broad topic, even if we are just talking about NLP. Perhaps you can select something that motivates you, and start from there. That should lead you to more understanding toward next steps, and more questions to ask here. Narrow question are easier to get attention and answers.  
  > **username_4**: @username_2 The existing tools and techniques have qualities and limitations, yet they can be used for many problems that have not been tried yet. For example, one of my previous employers used the Stanford NLP library to perform automated comment moderation (similar to spam filtering). Now the tools have limitations, and there are a lot of challenges. NLP libraries usually break facing indirect speech, some forms of humour, etc. And NLP libraries are usually ignorant of context, e.g. in a discussion thread. A lot possible, and a lot yet to do!  
  > **username_0**: @username_4 Thanks, but it was only a joke. Thanks again.  
  > **username_0**: I have received this on email a few minutes ago, coincidence?: https://software.seek.intel.com/DLNaturalLanguageWebinar_Reg  
  
  ---
  
  