Answers.Body: <p>I thought the answer might be no. </p>
  
  <p><a href="https://i.sstatic.net/jvuJp.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/jvuJp.png" alt="enter image description here"></a></p>
  
  <p>In this 2020 ICLR paper: <a href="https://arxiv.org/abs/1904.09751" rel="nofollow noreferrer">The Curious Case of Neural Text Degeneration</a>, researchers found that beam search text is less surprising compared to human natural language. And they proposed a nucleus sampling method which generates more human like text.  </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-02-19T12:34:11.407Z
Answers.LastActivityDate: 2020-02-19T12:43:51.787Z
Answers.LastEditDate: 2020-02-19T12:43:51.787Z
Answers.UserDisplayName: Lerner Zhang
Body: <p>As far as I understand, <a href="https://www.youtube.com/watch?v=RLWuzLLSIgw" rel="nofollow noreferrer">beam search</a> is the most widely used algorithm for text generation in NLP. So I was wondering: does the human brain also use beam search for text generation? If not, then what?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-02T19:56:11.643Z
Comments.Text: i dont think neuroscience is far enough to the point it can answer that....
  beamsearch is an effective and memory constrained method of approximating the sequence that maximizes the joint probability
Comments.UserDisplayName: mshlis
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-03T08:29:23.837Z
Comments.Text: I think text generation uses for more different approaches than just this one algorithm. There is a lot of NLP happening which does not involve neural networks/deep learning approaches.
Comments.UserDisplayName: Oliver Mason
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-05T17:35:56.137Z
Comments.Text: @OliverMason for example ... ?
Comments.UserDisplayName: Pablo Messina
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-06T08:17:40.980Z
Comments.Text: Any work in text generation in the past 60 years.
Comments.UserDisplayName: Oliver Mason
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-06-06T21:38:01.030Z
Comments.Text: @OliverMason would you mind being more specific? For example, any state of the art method which does not use beam search? Some concrete references/links will be appreciated.
Comments.UserDisplayName: Pablo Messina
Tags: <natural-language-processing><brain>
Title: Does the human brain use beam search for text generation?
UserDisplayName: Pablo Messina
ThreadText: # Does the human brain use beam search for text generation?
  
  (Asked by: username_0 on 2019-06-02)
  
  As far as I understand, [beam search](https://www.youtube.com/watch?v=RLWuzLLSIgw) is the most widely used algorithm for text generation in NLP. So I was wondering: does the human brain also use beam search for text generation? If not, then what?
  
  **Tags:** natural-language-processing, brain
  > **Comments:**
  > **username_1**: i dont think neuroscience is far enough to the point it can answer that.... beamsearch is an effective and memory constrained method of approximating the sequence that maximizes the joint probability  
  > **username_2**: I think text generation uses for more different approaches than just this one algorithm. There is a lot of NLP happening which does not involve neural networks/deep learning approaches.  
  > **username_0**: @OliverMason for example ... ?  
  > **username_2**: Any work in text generation in the past 60 years.  
  > **username_0**: @OliverMason would you mind being more specific? For example, any state of the art method which does not use beam search? Some concrete references/links will be appreciated.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_3 on 2020-02-19. Score: 3
  
  I thought the answer might be no.
  
  [![enter image description here](https://i.sstatic.net/jvuJp.png)](https://i.sstatic.net/jvuJp.png)
  
  In this 2020 ICLR paper: [The Curious Case of Neural Text Degeneration](https://arxiv.org/abs/1904.09751), researchers found that beam search text is less surprising compared to human natural language. And they proposed a nucleus sampling method which generates more human like text.
  
  
  ---
  
  