Differentiable Plasticity: A New Method Learning to Learn
"What if the plasticity of the connections was under the control of the network itself, as it seems to be in biological brains through the influence of neuromodulators?"<p>Anyone who wishes to explore this idea would do well to go back to the basics of neural nets and read Warren McCulloch's seminal papers on neural nets, from the 40s:<p><a href="http://www.cse.chalmers.se/~coquand/AUTOMATA/mcp.pdf" rel="nofollow">http://www.cse.chalmers.se/~coquand/AUTOMATA/mcp.pdf</a> A Logical Calculus of the ideas immanent in nervous activity<p><a href="http://vordenker.de/ggphilosophy/mcculloch_heterarchy.pdf" rel="nofollow">http://vordenker.de/ggphilosophy/mcculloch_heterarchy.pdf</a> A heterarchy of values determined by the topology of neural nets<p>(After having read those two papers, one can then try to make sense of Heinz von Förster's masterpiece, <a href="http://www.univie.ac.at/constructivism/archive/fulltexts/1270.pdf" rel="nofollow">http://www.univie.ac.at/constructivism/archive/fulltexts/127...</a>, Objects: Tokens for (Eigen-)Behaviors, which also bears some relevance to this matter. However, most people find it incomprehensible.)