Reverse engineering a neural network's clever solution to binary addition
These stories remind me of a story from Discover Magazine <a href="https://www.discovermagazine.com/technology/evolving-a-conscious-machine" rel="nofollow">https://www.discovermagazine.com/technology/evolving-a-consc...</a>
A researcher was using a process to "evolve" a FPGA and the result was a circuit that was super efficient but worked in ways that were unexpected: part of the circuit seemed unconnected to the rest but if removed the whole thing stopped working and it would only work at a specific temperature.