Body: <p>You can feed books to an RNN and it learn how to produce text.</p>
  
  <p>What I'm interested in is an algorithm that, given say 20 letters it suggest, say the best 10 options for the next 10 letters.</p>
  
  <p>So for example it begins with "The cat jumped "
  and then we get various options such as "over the dog". "on the table" and so on.</p>
  
  <p>My initial thoughts are to first use the most likely next letters. Then find the letter which is most uncertain and change this to the second likely next letter. And repeat this process.</p>
  
  <p>(Then I may have another evaluation neural network to assess which is "best" English.)</p>
  
  <p>In other words I want the RNN to "think ahead" at what it's saying - much like a chess playing machine.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-08-17T17:17:39.263Z
Comments.Text: I'd recommend going through the CBOW-based word2vec, which pretty much does the same thing: https://israelg99.github.io/2017-03-23-Word2Vec-Explained/
Comments.UserDisplayName: Syed Ali Hamza
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-08-19T02:30:59.630Z
Comments.Text: you mention neural text generations which work off of sampling (so just sample 10x) or find 10 most likely
Comments.UserDisplayName: mshlis
Tags: <recurrent-neural-networks>
Title: Is there an standard algorithm for giving options from an RNN?
UserDisplayName: zooby
ThreadText: # Is there an standard algorithm for giving options from an RNN?
  
  (Asked by: username_0 on 2019-08-17)
  
  You can feed books to an RNN and it learn how to produce text.
  
  What I'm interested in is an algorithm that, given say 20 letters it suggest, say the best 10 options for the next 10 letters.
  
  So for example it begins with "The cat jumped "
  and then we get various options such as "over the dog". "on the table" and so on.
  
  My initial thoughts are to first use the most likely next letters. Then find the letter which is most uncertain and change this to the second likely next letter. And repeat this process.
  
  (Then I may have another evaluation neural network to assess which is "best" English.)
  
  In other words I want the RNN to "think ahead" at what it's saying - much like a chess playing machine.
  
  **Tags:** recurrent-neural-networks
  
  > **Comments:**
  > **username_1**: I'd recommend going through the CBOW-based word2vec, which pretty much does the same thing: https://israelg99.github.io/2017-03-23-Word2Vec-Explained/  
  > **username_2**: you mention neural text generations which work off of sampling (so just sample 10x) or find 10 most likely  
  
  ---
  
  ## 0 answers
  
  