Language models can explain neurons in language models

https://openaipublic.blob.core.windows.net/neuron-explainer/paper/index.html

18/32

O
f
 
c
o
u
r
s
e
,
 
s
i
m
u
l
a
t
i
o
n
 
q
u
a
l
i
t
y
 
c
a
n
n
o
t
 
b
e
 
m
e
a
s
u
r
e
d
 
u
s
i
n
g
 
s
c
o
r
e
.
 
H
o
w
e
v
e
r
,
 
w
e
 
c
a
n
 
a
l
s
o
 
v
e
r
i
f
y
 
t
h
a
t
 
s
c
o
r
e
-
i
n
d
u
c
e
d
 
c
o
m
p
a
r
i
s
o
n
s
 
f
r
o
m
l
a
r
g
e
r
 
s
i
m
u
l
a
t
o
r
s
 
a
g
r
e
e
 
m
o
r
e
 
w
i
t
h
 
h
u
m
a
n
s
,
 
u
s
i
n
g
 
t
h
e
 
h
u
m
a
n
 
c
o
m
p
a
r
i
s
o
n
 
d
a
t
a
 
d
e
s
c
r
i
b
e
d
 
e
a
r
l
i
e
r
.
 
H
e
r
e
,
 
t
h
e
 
h
u
m
a
n
 
b
a
s
e
l
i
n
e
 
c
o
m
e
s
f
r
o
m
 
h
u
m
a
n
-
h
u
m
a
n
 
a
g
r
e
e
m
e
n
t
 
r
a
t
e
s
.
 
S
c
o
r
e
s
 
u
s
i
n
g
 
G
P
T
-
4
 
a
s
 
a
 
s
i
m
u
l
a
t
o
r
 
m
o
d
e
l
 
a
r
e
 
a
p
p
r
o
a
c
h
i
n
g
,
 
b
u
t
 
s
t
i
l
l
 
s
o
m
e
w
h
a
t
 
b
e
l
o
w
,
 
h
u
m
a
n
-
l
e
v
e
l
 
a
g
r
e
e
m
e
n
t
 
r
a
t
e
s
 
w
i
t
h
 
o
t
h
e
r
 
h
u
m
a
n
s
.
11/05/2023, 05:10
Language models can explain neurons in language models