Answers.Body: <p><strong>Establishing Names and Terms</strong></p>
  <p>The mathematician's name is Kurt Gödel, an Austrian-American, and the machine concept named after him is the Gödel machine.  The idea of meta-learning (learning how to learn) can be extended recursively to learning how to learn how to learn how to learn and so on.</p>
  <p>Taking a decision is when the decision is external to the system and the system either copes or executes that decision, whereas <strong>making</strong> a decision is when the decision is internal to the system and the system executes it, reports it, or delegates it.</p>
  <p>Both of these have been tried in the laboratory or in real systems and various levels of recursion have achieved success, but not indefinite recursion.</p>
  <p><strong>A Few Points from AI History</strong></p>
  <p>Creating a learn how to learn recursion was the object of several early LISP efforts at MIT, and meta-learning is in active research in multiple universities and corporations as of this writing.  The first successful application of a single level of recursion were the expert systems that could acquire knowledge using meta-rules, which were rules about creating new rules.</p>
  <p><strong>Current Artificial Networks Regarding Meta-learning</strong></p>
  <p>It is correct that back propagation is not meta-learning.  It is a single level of learning in the above recursive learning concept.  Artificial networks have been applied to learn to adjust the hyper-parameters of another network, but these strategies require large quantities of data, and they don't cognate.</p>
  <p>They don't <strong>know</strong> how to adjust hyper-parameters.  They don't build models of learning and then use those models to learn.  The adjustment mechanism is the application of a learned function, not a conception of learning.</p>
  <p><strong>Requirements for Meta-learning</strong></p>
  <p>To establish a meta-learning paradigm, we must consider the elements of learning.</p>
  <ul>
  <li>Existence of function abstraction</li>
  <li>Ability to guess a parameterized function</li>
  <li>Ability to mutate that function</li>
  <li>Ability to tune the parameters</li>
  <li>A target functional behavior</li>
  <li>A way to detect whether the function is approaching the target behavior</li>
  <li>A strategy for deciding when to mutate and when to tune</li>
  <li>A way of performing experiments in isolation</li>
  <li>A way to recurse in a way that incorporates ALL of the above</li>
  </ul>
  <p>Once this has been achieved, it may be described as self-improvement and may qualify as what most theorists think of as a Gödel machine.</p>
  <p><strong>Specifics in the Question</strong></p>
  <blockquote>
  <p>Can [an artificial] network [make] decision about its own weights (update of weights) during training phase or during the phase of parallel training and inference?</p>
  </blockquote>
  <p>Yes.</p>
  <blockquote>
  <p>[Can] one [level] of [a] hierarchical [artificial network] [make] decision[s] about weights of other [levels]?</p>
  </blockquote>
  <p>Yes, but in a limited way as of the time of this writing.</p>
  <blockquote>
  <p>I am very keen to understand about self-awareness ...</p>
  </blockquote>
  <p>Self-awareness is the ability of the system to analyze and either utilize the result of that analysis, report it, or delegate based on the result IN COMBINATION WITH the ability to use itself as the object of analysis.</p>
  <p>This can be as simple as a program that parses Java and produces statistics using its own code as the code to parse.  It can be as complex as an anthropologist studying humanity.  It can be as personal as a human looking in the mirror and wondering about the qualities of person they are.  It can be as deep as someone wondering their purpose in their current life.</p>
  <p>In all cases, there are those two qualities.</p>
  <ol>
  <li>The ability to perform a type of analysis that could be applied toward a class of objects of which itself is a member</li>
  <li>The selection of itself for analysis</li>
  </ol>
  <p>There is one other aspect of awareness beyond these two that are not required but usually associated with awareness: Some way of directing attention of the analysis capability to itself regularly.  Here are a few examples from human experience.</p>
  <ul>
  <li>Practice of daily meditation</li>
  <li>Reading a book on purpose</li>
  <li>Seeing a cognitive behavioral therapist</li>
  <li>Writing an autobiography</li>
  <li>The first, fourth, and tenth Step of anonymous programs</li>
  <li>Watching a candid movie of one's self</li>
  <li>A family member that likes to step back and evaluate the family</li>
  <li>Religious accountability groups</li>
  </ul>
  <p>Self learning is like self-awareness except that learning replaces awareness.  Obviously, self-learning is dependent on some degree of self-awareness.  We now have a more activity based list because of the additional element of adjustment or inception of action.</p>
  <ul>
  <li>Decide, on the basis of personal abilities and interests, after evaluating options for living, to relocate</li>
  <li>Realizing that self cannot remember commitments to meetings to buy a technology device that notifies the user before such commitments and using the calendar app rigorously</li>
  <li>Finding that repeated attempts to eat greens rather than junk food is not working and joining a community of those with eating disorders with solutions to that issue</li>
  <li>Deciding that childhood views of future were good ones and abandoning current paths for ones that were bolder and will likely lead to fulfillment</li>
  </ul>
  <p>Self-improvement is a super-set of self-learning, since the only point of learning is improvement, however there are forms of improvement that don't strictly involve learning.  A system (or person) can execute something already learned that results in an improvement.</p>
  <blockquote>
  <p>Artificial general intelligence (e.g. Gödel machine)</p>
  </blockquote>
  <p>There is no mathematical proof that a Gödel machine would exhibit general artificial intelligence.  More importantly, there is no proof and a considerably body of evidence against the proposition that humans are generally intelligent.</p>
  <p>Lastly, there is no proof that general intelligence is achievable in a biological or artificial system.  Gödel's second incompleteness theorem is strong evidence that such ideas may be naive.</p>
  <blockquote>
  <p>[Artificial] networks are usually mentioned as examples of special, single-purpose intelligence, but I can not see the reason for such limitation if [they] essentially [try] to mimic human brains, at least in purpose if not in mechanics.</p>
  </blockquote>
  <p>Artificial networks emerged out of a desire to mimic human brains, but the perceptron design is based on an old view of neuron functionality.  Simulating a single neuron might require an entire rack of CPUs and GPUs.</p>
  <p>Furthermore, we are not yet clear on what intelligence is.  Definitions proposed vary widely.  The fields of artificial networks, bioinformatics, ontology of ideas, semantics, and the relationships between stable adaptivity and algorithms are all in their early stages, both theoretically and experimentally.</p>
  <blockquote>
  <p>Maybe this desired [capability] is already effectively achieved [or currently emerging] in the operation of recurrent ANNs as the effect of collective behavior?</p>
  </blockquote>
  <p>No, but RNNs are a tiny step closer to biological neurons in that their layers maintain state beyond the attenuation matrix.</p>
  <p>By attenuation matrix is meant the matrix of parameters used in vector-matrix multiplication to control the strength of signals from the activation functions of one layer to the activation functions of the next.  It's common name in machine learning literature is simply, &quot;The parameters.&quot;  Learning occurs as they change to converge the network on an optimal state.</p>
  <p>RNNs are also capable of being Turing complete, so they can theoretically realize arbitrary algorithms.</p>
  <p>However, the <strong>Requirements for Meta-learning</strong> above are not an expected capability of any single instance of an artificial networks, either of the MLP (multilayer perceptron) type or the RNN type.  Whether balancing two networks in symbiotic arrangement as in GANs, or a comprehensive recursive algorithm, or the simulation of neural and synaptic plasticity in silicon will lead to Gödel machines is unknown.</p>
  <p><strong>Let Science be Science</strong></p>
  <p>Whether ideas such as general intelligence are possible is unknown.  Whether ideas about singularities in books and mass media are realistic is unknown.  Whether the prophetic warnings of screenwriters about the emergence of artificial entities that become the dominant species on earth is unknown.</p>
  <p>Jaques Ellul is perhaps the most scientifically accurate prophetic voice.  In his <em>Techological Sociey</em>, he presents heaps evidence in support of the idea that humans are already serving an autonomous technology and have been since prior to industrialization.</p>
  <p>A Swiss philosopher, Francis Schaeffer, once prophecied, &quot;They will say all kinds of things in the name of science that have nothing to do with science.&quot;  We should be careful to keep conjecture from reaching the status of scientific fact in technical conversation.  If we have no carefully drawn theory or empirical evidence to support a conjecture, it should be stated as a proposal, not a conclusion.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-09-19T06:30:53.017Z
Answers.LastActivityDate: 2018-10-15T23:28:55.473Z
Answers.LastEditDate: 2020-06-17T09:57:20.710Z
Answers.UserDisplayName: Douglas Daseeco
Body: <p>Can neural network take decision about its own weights (update of weights) during training phase or during the phase of parallel training and inference? When one region of hierarchical NN takes decision about weights of other region is the special case of my question.</p>
  
  <p>I am very keen to understand about self-awareness, self-learning, self-improvement capabilities of neural networks, because those exactly those self-* capabilities are the key path to the artificial general intelligence (e.g. Goedel machine). Neural networks are usually mentioned as examples of special, single-purpose intelligence but I can not see the reason for such limitation if NN essentially trys to mimic human brains, at least in purpose if not in mechanics.</p>
  
  <p>Well - maybe this desired effect is already effectively achieved/emerges in the operation of recurrent ANNs as the effect of collective behavior?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T06:16:10.427Z
Comments.Text: What do you mean  by "take decision"? In back propagation, the gradients at one layer are used to derive the gradients of another layer. However, it is unlikely anyone would frame that as a "decision" because there are no alternatives to choose between at the point of the update; it is driven by maths of the error function, chain rule and whatever optimisation routine is in use.
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T06:19:55.573Z
Comments.Text: Backpropagation is just one algorithm. If we require neural network to be self-improving (Goedlian) then we should allow neural network to update its own learning algorithm and it effectively means that neural network should be able to take decisions about its own weights.
Comments.UserDisplayName: TomR
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T06:23:56.067Z
Comments.Text: Yes, but what does "take decision" mean to you? What are you asking? Does reinforcement learning count, for instance - in that, the neural network is used to make a decision about which action to take, and that then determines the next piece of data. That is clearly a feedback loop where a decision due to the neural network affects the next weight update . . . does that count?
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T06:28:42.267Z
Comments.Text: I mean: in one learning cycle NN outputs adress i-j of weight wij and new value w_ij for this weight. Or it outputs the whole array of addresses and new weights. Of course one can always encode this in the output of NN. And then some more ore less external mechanism writes those new wights back into NN. I don't know whether some existing NN technique already simulates this or I am seeking for something entirely new thing that even may not be accomodated inside existing frameworks.
Comments.UserDisplayName: TomR
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T06:33:05.630Z
Comments.Text: I think you need to consider on what basis the network would output a change to its own weights. What the goal would be, what cost function would be minimised. I suspect this is not meaningful in the context of a *single* NN, but is something you could end up with, with more complex multi-part architectures - even then you need to be very clear about the goals and types of interaction of the components.
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-09-19T13:13:58.127Z
Comments.Text: I think OP is aiming for something closer to G.E.B.'s "strange loops" but without a solid understanding of NNs, so the question is hard to understand/interpret. https://en.wikipedia.org/wiki/Strange_loop
Comments.UserDisplayName: Neil Slater
Tags: <neural-networks><artificial-consciousness><superintelligence>
Title: Can neural network take decision about its own weights (update of weights)?
UserDisplayName: TomR
ThreadText: # Can neural network take decision about its own weights (update of weights)?
  
  (Asked by: username_0 on 2018-09-19)
  
  Can neural network take decision about its own weights (update of weights) during training phase or during the phase of parallel training and inference? When one region of hierarchical NN takes decision about weights of other region is the special case of my question.
  
  I am very keen to understand about self-awareness, self-learning, self-improvement capabilities of neural networks, because those exactly those self-\* capabilities are the key path to the artificial general intelligence (e.g. Goedel machine). Neural networks are usually mentioned as examples of special, single-purpose intelligence but I can not see the reason for such limitation if NN essentially trys to mimic human brains, at least in purpose if not in mechanics.
  
  Well - maybe this desired effect is already effectively achieved/emerges in the operation of recurrent ANNs as the effect of collective behavior?
  
  **Tags:** neural-networks, artificial-consciousness, superintelligence
  
  > **Comments:**
  > **username_1**: What do you mean  by "take decision"? In back propagation, the gradients at one layer are used to derive the gradients of another layer. However, it is unlikely anyone would frame that as a "decision" because there are no alternatives to choose between at the point of the update; it is driven by maths of the error function, chain rule and whatever optimisation routine is in use.  
  > **username_0**: Backpropagation is just one algorithm. If we require neural network to be self-improving (Goedlian) then we should allow neural network to update its own learning algorithm and it effectively means that neural network should be able to take decisions about its own weights.  
  > **username_1**: Yes, but what does "take decision" mean to you? What are you asking? Does reinforcement learning count, for instance - in that, the neural network is used to make a decision about which action to take, and that then determines the next piece of data. That is clearly a feedback loop where a decision due to the neural network affects the next weight update . . . does that count?  
  > **username_0**: I mean: in one learning cycle NN outputs adress i-j of weight wij and new value w_ij for this weight. Or it outputs the whole array of addresses and new weights. Of course one can always encode this in the output of NN. And then some more ore less external mechanism writes those new wights back into NN. I don't know whether some existing NN technique already simulates this or I am seeking for something entirely new thing that even may not be accomodated inside existing frameworks.  
  > **username_1**: I think you need to consider on what basis the network would output a change to its own weights. What the goal would be, what cost function would be minimised. I suspect this is not meaningful in the context of a *single* NN, but is something you could end up with, with more complex multi-part architectures - even then you need to be very clear about the goals and types of interaction of the components.  
  > **username_1**: I think OP is aiming for something closer to G.E.B.'s "strange loops" but without a solid understanding of NNs, so the question is hard to understand/interpret. https://en.wikipedia.org/wiki/Strange_loop  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2018-09-19. Score: 1
  
  **Establishing Names and Terms**
  
  The mathematician's name is Kurt Gödel, an Austrian-American, and the machine concept named after him is the Gödel machine. The idea of meta-learning (learning how to learn) can be extended recursively to learning how to learn how to learn how to learn and so on.
  
  Taking a decision is when the decision is external to the system and the system either copes or executes that decision, whereas **making** a decision is when the decision is internal to the system and the system executes it, reports it, or delegates it.
  
  Both of these have been tried in the laboratory or in real systems and various levels of recursion have achieved success, but not indefinite recursion.
  
  **A Few Points from AI History**
  
  Creating a learn how to learn recursion was the object of several early LISP efforts at MIT, and meta-learning is in active research in multiple universities and corporations as of this writing. The first successful application of a single level of recursion were the expert systems that could acquire knowledge using meta-rules, which were rules about creating new rules.
  
  **Current Artificial Networks Regarding Meta-learning**
  
  It is correct that back propagation is not meta-learning. It is a single level of learning in the above recursive learning concept. Artificial networks have been applied to learn to adjust the hyper-parameters of another network, but these strategies require large quantities of data, and they don't cognate.
  
  They don't **know** how to adjust hyper-parameters. They don't build models of learning and then use those models to learn. The adjustment mechanism is the application of a learned function, not a conception of learning.
  
  **Requirements for Meta-learning**
  
  To establish a meta-learning paradigm, we must consider the elements of learning.
  
  * Existence of function abstraction
  * Ability to guess a parameterized function
  * Ability to mutate that function
  * Ability to tune the parameters
  * A target functional behavior
  * A way to detect whether the function is approaching the target behavior
  * A strategy for deciding when to mutate and when to tune
  * A way of performing experiments in isolation
  * A way to recurse in a way that incorporates ALL of the above
  
  Once this has been achieved, it may be described as self-improvement and may qualify as what most theorists think of as a Gödel machine.
  
  **Specifics in the Question**
  
  > Can [an artificial] network [make] decision about its own weights (update of weights) during training phase or during the phase of parallel training and inference?
  
  Yes.
  
  > [Can] one [level] of [a] hierarchical [artificial network] [make] decision[s] about weights of other [levels]?
  
  Yes, but in a limited way as of the time of this writing.
  
  > I am very keen to understand about self-awareness ...
  
  Self-awareness is the ability of the system to analyze and either utilize the result of that analysis, report it, or delegate based on the result IN COMBINATION WITH the ability to use itself as the object of analysis.
  
  This can be as simple as a program that parses Java and produces statistics using its own code as the code to parse. It can be as complex as an anthropologist studying humanity. It can be as personal as a human looking in the mirror and wondering about the qualities of person they are. It can be as deep as someone wondering their purpose in their current life.
  
  In all cases, there are those two qualities.
  
  1. The ability to perform a type of analysis that could be applied toward a class of objects of which itself is a member
  2. The selection of itself for analysis
  
  There is one other aspect of awareness beyond these two that are not required but usually associated with awareness: Some way of directing attention of the analysis capability to itself regularly. Here are a few examples from human experience.
  
  * Practice of daily meditation
  * Reading a book on purpose
  * Seeing a cognitive behavioral therapist
  * Writing an autobiography
  * The first, fourth, and tenth Step of anonymous programs
  * Watching a candid movie of one's self
  * A family member that likes to step back and evaluate the family
  * Religious accountability groups
  
  Self learning is like self-awareness except that learning replaces awareness. Obviously, self-learning is dependent on some degree of self-awareness. We now have a more activity based list because of the additional element of adjustment or inception of action.
  
  * Decide, on the basis of personal abilities and interests, after evaluating options for living, to relocate
  * Realizing that self cannot remember commitments to meetings to buy a technology device that notifies the user before such commitments and using the calendar app rigorously
  * Finding that repeated attempts to eat greens rather than junk food is not working and joining a community of those with eating disorders with solutions to that issue
  * Deciding that childhood views of future were good ones and abandoning current paths for ones that were bolder and will likely lead to fulfillment
  
  Self-improvement is a super-set of self-learning, since the only point of learning is improvement, however there are forms of improvement that don't strictly involve learning. A system (or person) can execute something already learned that results in an improvement.
  
  > Artificial general intelligence (e.g. Gödel machine)
  
  There is no mathematical proof that a Gödel machine would exhibit general artificial intelligence. More importantly, there is no proof and a considerably body of evidence against the proposition that humans are generally intelligent.
  
  Lastly, there is no proof that general intelligence is achievable in a biological or artificial system. Gödel's second incompleteness theorem is strong evidence that such ideas may be naive.
  
  > [Artificial] networks are usually mentioned as examples of special, single-purpose intelligence, but I can not see the reason for such limitation if [they] essentially [try] to mimic human brains, at least in purpose if not in mechanics.
  
  Artificial networks emerged out of a desire to mimic human brains, but the perceptron design is based on an old view of neuron functionality. Simulating a single neuron might require an entire rack of CPUs and GPUs.
  
  Furthermore, we are not yet clear on what intelligence is. Definitions proposed vary widely. The fields of artificial networks, bioinformatics, ontology of ideas, semantics, and the relationships between stable adaptivity and algorithms are all in their early stages, both theoretically and experimentally.
  
  > Maybe this desired [capability] is already effectively achieved [or currently emerging] in the operation of recurrent ANNs as the effect of collective behavior?
  
  No, but RNNs are a tiny step closer to biological neurons in that their layers maintain state beyond the attenuation matrix.
  
  By attenuation matrix is meant the matrix of parameters used in vector-matrix multiplication to control the strength of signals from the activation functions of one layer to the activation functions of the next. It's common name in machine learning literature is simply, "The parameters." Learning occurs as they change to converge the network on an optimal state.
  
  RNNs are also capable of being Turing complete, so they can theoretically realize arbitrary algorithms.
  
  However, the **Requirements for Meta-learning** above are not an expected capability of any single instance of an artificial networks, either of the MLP (multilayer perceptron) type or the RNN type. Whether balancing two networks in symbiotic arrangement as in GANs, or a comprehensive recursive algorithm, or the simulation of neural and synaptic plasticity in silicon will lead to Gödel machines is unknown.
  
  **Let Science be Science**
  
  Whether ideas such as general intelligence are possible is unknown. Whether ideas about singularities in books and mass media are realistic is unknown. Whether the prophetic warnings of screenwriters about the emergence of artificial entities that become the dominant species on earth is unknown.
  
  Jaques Ellul is perhaps the most scientifically accurate prophetic voice. In his *Techological Sociey*, he presents heaps evidence in support of the idea that humans are already serving an autonomous technology and have been since prior to industrialization.
  
  A Swiss philosopher, Francis Schaeffer, once prophecied, "They will say all kinds of things in the name of science that have nothing to do with science." We should be careful to keep conjecture from reaching the status of scientific fact in technical conversation. If we have no carefully drawn theory or empirical evidence to support a conjecture, it should be stated as a proposal, not a conclusion.
  
  
  ---
  
  