Answers.Body: <p>It seems that in this paper neuron means the perceptrons in the MLP layers of the transformer.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-05-10T05:40:36.547Z
Answers.LastActivityDate: 2023-05-10T05:40:36.547Z
Answers.UserDisplayName: Peyman
Body: <p>I'm reading OpenAI's new paper &quot;<a href="https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html" rel="nofollow noreferrer">Language models can explain neurons in language models</a>&quot; And I can't fully understand the concept of neurons here.</p>
  <p>Can you please explain it? Is it related to the attention mechanism?</p>
  
Tags: <natural-language-processing><transformer><chatgpt><gpt><artificial-neuron>
Title: What is a neuron in large language models?
UserDisplayName: Peyman
ThreadText: # What is a neuron in large language models?
  
  (Asked by: username_0 on 2023-05-10)
  
  I'm reading OpenAI's new paper "[Language models can explain neurons in language models](https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html)" And I can't fully understand the concept of neurons here.
  
  Can you please explain it? Is it related to the attention mechanism?
  
  **Tags:** natural-language-processing, transformer, chatgpt, gpt, artificial-neuron
  
  ---
  
  ## 1 answers
  
  ### Answer by username_0 on 2023-05-10. Score: 0 | Accepted answer
  
  It seems that in this paper neuron means the perceptrons in the MLP layers of the transformer.
  
  
  ---
  
  