Decomposing language models into understandable components
So, I came up with a pretty decent neural net from scratch about 20 years ago - it ran in the browser in Flash. It basically had a 10x10 bitmap input and an output of the same size, and lots of "neurons" in between that strengthened or weakened their connections based on feedback from the end result. And at a certain point they randomly mutated how they processed the input.<p>I don't see anything wildly different now, other than scale and youth and the hubris that accompanies those things.