Language models can explain neurons in language models
LLMs are quickly going to be able to start explaining their own thought processes better than any human can explain their own. I wonder how many new words we will come up with to describe concepts (or &quot;node-activating clusters of meaning&quot;) that the AI finds salient that we don&#x27;t yet have a singular word for. Or, for that matter, how many of those concepts we will find meaningful at all. What will this teach us about ourselves?