Reverse engineering a neural network's clever solution to binary addition
These stories remind me of a story from Discover Magazine https://www.discovermagazine.com/technology/evolving-a-consc...
A researcher was using a process to "evolve" a FPGA and the result was a circuit that was super efficient but worked in ways that were unexpected: part of the circuit seemed unconnected to the rest but if removed the whole thing stopped working and it would only work at a specific temperature.