Answers.Body: <p>Lowest layer generally refers to the layer closest to the input. This comes from the idea that layers closer to the input represent low-level features such as gradients and edges, while layers closer to the output represent high-level features such as parts and objects.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-28T03:52:36.273Z
Answers.Text: You will also see the term "TOP" layer. This usually refers to the output layer of the network.
Answers.UserDisplayName: Gerry P
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-02-01T21:08:19.850Z
Answers.Text: What quantifies a feature as "low" or "high" level? I never understood the origin of this terminology.
Answers.UserDisplayName: Antonios Sarikas
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-28T03:48:12.007Z
Answers.LastActivityDate: 2020-04-28T03:48:12.007Z
Answers.UserDisplayName: danijar
Answers.Body: <blockquote>
    <p>People sometimes use 1st layer, 2nd layer to refer to a specific layer in a neural net. Is the layer immediately follows the input layer called 1st layer?</p>
  </blockquote>
  
  <p>The 1st layer should typically refer to the layer that comes after the input layer. Similarly, the 2nd layer should refer to the layer that comes after the 1st layer, and so on.</p>
  
  <p>However, note that this convention and terminology may not be applicable in all cases. You should always take into account your context!</p>
  
  <blockquote>
    <p>How about lowest layer and highest layer?</p>
  </blockquote>
  
  <p>To be honest, I also dislike this ambiguous terminology. From my experience, I don't think there's an agreement on the actual meaning of "lowest" or "highest". It depends on how you depict the neural network, but it's possible that "lowest" refers to the layers closer to the inputs, because, if you think of a neural network as a hierarchy that starts from the inputs and builds more complex representations of it, the "lowest" may refer to the "lowest in the hierarchy" (but who knows!).</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-04-27T23:25:03.697Z
Answers.LastActivityDate: 2020-04-27T23:32:20.963Z
Answers.LastEditDate: 2020-04-27T23:32:20.963Z
Answers.UserDisplayName: nbro
Body: <p>People sometimes use 1st layer, 2nd layer to refer to a specific layer in a neural net. Is the layer immediately follows the input layer called 1st layer?</p>
  
  <p>How about the lowest layer and highest layer?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-04-28T09:22:08.027Z
Comments.Text: "Deep learning" may suggest vertical terminology, but everyone seems to draw left-to-right (horizontal) networks. Perhaps we should rename it to wide learning ;)
Comments.UserDisplayName: MSalters
Tags: <neural-networks><machine-learning><deep-learning><terminology>
Title: Does the "lowest layer" refer to the first or last layer of the neural network?
UserDisplayName: Piete3r
ThreadText: # Does the "lowest layer" refer to the first or last layer of the neural network?
  
  (Asked by: username_0 on 2020-04-27)
  
  People sometimes use 1st layer, 2nd layer to refer to a specific layer in a neural net. Is the layer immediately follows the input layer called 1st layer?
  
  How about the lowest layer and highest layer?
  
  **Tags:** neural-networks, machine-learning, deep-learning, terminology
  > **Comments:**
  > **username_1**: "Deep learning" may suggest vertical terminology, but everyone seems to draw left-to-right (horizontal) networks. Perhaps we should rename it to wide learning ;)  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_5 on 2020-04-27. Score: 3 | Accepted answer
  
  > People sometimes use 1st layer, 2nd layer to refer to a specific layer in a neural net. Is the layer immediately follows the input layer called 1st layer?
  
  The 1st layer should typically refer to the layer that comes after the input layer. Similarly, the 2nd layer should refer to the layer that comes after the 1st layer, and so on.
  
  However, note that this convention and terminology may not be applicable in all cases. You should always take into account your context!
  
  > How about lowest layer and highest layer?
  
  To be honest, I also dislike this ambiguous terminology. From my experience, I don't think there's an agreement on the actual meaning of "lowest" or "highest". It depends on how you depict the neural network, but it's possible that "lowest" refers to the layers closer to the inputs, because, if you think of a neural network as a hierarchy that starts from the inputs and builds more complex representations of it, the "lowest" may refer to the "lowest in the hierarchy" (but who knows!).
  
  
  ---
  
  ### Answer by username_2 on 2020-04-28. Score: 8
  
  Lowest layer generally refers to the layer closest to the input. This comes from the idea that layers closer to the input represent low-level features such as gradients and edges, while layers closer to the output represent high-level features such as parts and objects.
  
  > **Comments:**
  > **username_3**: You will also see the term "TOP" layer. This usually refers to the output layer of the network.  
  > **username_4**: What quantifies a feature as "low" or "high" level? I never understood the origin of this terminology.  
  
  ---
  
  