<p>It seems that in this paper neuron means the perceptrons in the MLP layers of the transformer.</p>

CC BY-SA 4.0
2023-05-10T05:40:36.547Z
2023-05-10T05:40:36.547Z
Peyman
<p>I'm reading OpenAI's new paper &quot;<a href="https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html" rel="nofollow noreferrer">Language models can explain neurons in language models</a>&quot; And I can't fully understand the concept of neurons here.</p>
<p>Can you please explain it? Is it related to the attention mechanism?</p>

<natural-language-processing><transformer><chatgpt><gpt><artificial-neuron>
What is a neuron in large language models?
Peyman
# What is a neuron in large language models?

(Asked by: username_0 on 2023-05-10)

I'm reading OpenAI's new paper "[Language models can explain neurons in language models](https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html)" And I can't fully understand the concept of neurons here.

Can you please explain it? Is it related to the attention mechanism?

**Tags:** natural-language-processing, transformer, chatgpt, gpt, artificial-neuron


---

## 1 answers

### Answer by username_0 on 2023-05-10. Score: 0 | Accepted answer

It seems that in this paper neuron means the perceptrons in the MLP layers of the transformer.


---

