Answers.Body: <p>That is similar to a chicken-and-egg problem; If the second network could figure out the direction and learn faster, why couldn't the first network do that too and learn even faster. </p>
  
  <p>However, I would recommend looking up Actor Critic Methods. Here there are two networks but one (the critic) evaluates the other (the actor) to head it in the right direction. </p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-08-11T00:59:47.113Z
Answers.LastActivityDate: 2017-08-11T00:59:47.113Z
Answers.UserDisplayName: Jaden Travnik
Body: <p>I understand that as a network learns about an output with regards to an input, weights are updated according to how wrong the guess was for that node. So, over time, the weights move in the "direction" towards the correct value.</p>
  
  <p>Is it possible to use a separate neural network that takes as input the weights of the first network while it trains to try approximating that "direction" and, in effect, pushing the weights in that direction faster?</p>
  
Tags: <neural-networks><machine-learning><backpropagation><gradient-descent>
Title: Can a second network take as input the weights of a first network and help training the first network?
UserDisplayName: Mark Markrowave Charlton
ThreadText: # Can a second network take as input the weights of a first network and help training the first network?
  
  (Asked by: username_0 on 2017-07-07)
  
  I understand that as a network learns about an output with regards to an input, weights are updated according to how wrong the guess was for that node. So, over time, the weights move in the "direction" towards the correct value.
  
  Is it possible to use a separate neural network that takes as input the weights of the first network while it trains to try approximating that "direction" and, in effect, pushing the weights in that direction faster?
  
  **Tags:** neural-networks, machine-learning, backpropagation, gradient-descent
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2017-08-11. Score: 2
  
  That is similar to a chicken-and-egg problem; If the second network could figure out the direction and learn faster, why couldn't the first network do that too and learn even faster.
  
  However, I would recommend looking up Actor Critic Methods. Here there are two networks but one (the critic) evaluates the other (the actor) to head it in the right direction.
  
  
  ---
  
  