Language models can explain neurons in language models

2ρ − 1 < ρ2

Σ−1/2

Σ−1/2

https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html

29/32
Language models can explain neurons in language models