Answers.Body: <p>You cannot reason in a mathematical way over features in my opinion, as they are not defined. However, you can think of deep neurons as a hierarchy of always more high level concepts, as observed in the human brain.</p>
  <p>For example consider the task of identifying animals: the first layer, can at most identify simple stuff like edges, then the second layer combines edges and finds corner, the third layer might combine edges to find paws/ears/mouths and so on</p>
  <p>This is what he ideally describes as features, but there is nothing stopping the net to learn features that makes no sense for us humans, or not to learn anything on a layer and just propagate the identity</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-09-17T11:26:12.337Z
Answers.LastActivityDate: 2023-09-17T11:26:12.337Z
Answers.UserDisplayName: Alberto
Body: <p>I was reading Goodfellow. At the start of the text it was mentioned that there are two ways to represent depth of a deep neural network. One is using the depth of the computation graph and the other is using the depth of the chain of features/concepts that is learned by NN.</p>
  <p>Don't every layer in NN represent a concept so the depth would be the number of the layers, but then each layer also does calculation on input from previous layer so the length of computation graph will be same as number of layers. So both representation of depth will be same as number of layers in NN.</p>
  <p>Or is it that features can also be represented using more that one layers and not individual layers.</p>
  <p>Maybe I have misunderstood the concept of NN.</p>
  
Tags: <neural-networks><convolutional-neural-networks><multilayer-perceptrons><feature-extraction>
Title: Can a concept/feature be represented using more than one layer of a Neural Network?
UserDisplayName: rsonx
ThreadText: # Can a concept/feature be represented using more than one layer of a Neural Network?
  
  (Asked by: username_0 on 2023-09-16)
  
  I was reading Goodfellow. At the start of the text it was mentioned that there are two ways to represent depth of a deep neural network. One is using the depth of the computation graph and the other is using the depth of the chain of features/concepts that is learned by NN.
  
  Don't every layer in NN represent a concept so the depth would be the number of the layers, but then each layer also does calculation on input from previous layer so the length of computation graph will be same as number of layers. So both representation of depth will be same as number of layers in NN.
  
  Or is it that features can also be represented using more that one layers and not individual layers.
  
  Maybe I have misunderstood the concept of NN.
  
  **Tags:** neural-networks, convolutional-neural-networks, multilayer-perceptrons, feature-extraction
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-09-17. Score: 2
  
  You cannot reason in a mathematical way over features in my opinion, as they are not defined. However, you can think of deep neurons as a hierarchy of always more high level concepts, as observed in the human brain.
  
  For example consider the task of identifying animals: the first layer, can at most identify simple stuff like edges, then the second layer combines edges and finds corner, the third layer might combine edges to find paws/ears/mouths and so on
  
  This is what he ideally describes as features, but there is nothing stopping the net to learn features that makes no sense for us humans, or not to learn anything on a layer and just propagate the identity
  
  
  ---
  
  