Answers.Body: <p>Architecture is the entire model.</p>
  <p><strong>Backbone</strong> is the first few hidden layers. This is containing low-level features which generalize the knowledge. Practically, it's commonly used in pretrain where this backbone weights are frozen (non-updatable). This is make sense since it's trained something general.</p>
  <p>Another terms are <strong>Neck</strong> and <strong>Head</strong>.</p>
  <p><strong>Neck</strong> is the intermediary layers between <strong>Head</strong> and <strong>Backbone</strong>. It's commonly used in transition for multi-task learning.</p>
  <p>While the <strong>Head</strong> is simply the output layer for certain task.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-10-11T05:50:33.690Z
Answers.LastActivityDate: 2024-10-11T05:50:33.690Z
Answers.UserDisplayName: Muhammad Ikhwan Perwira
Answers.Body: <p>The vocabulary is definitely non-standard and a bit confusing, but Feature Pyramid Networks is used as a feature extractor, and its output is then fed into EfficientNet-B2 to be used to classify the image. One neural network model is concatenated at the end of the other.</p>
  <p>So it seems like &quot;architecture&quot; is the front half of the neural network model which takes as input the satellite image and extracts image features, and then is directly connected to the back half of the model (hence &quot;backbone&quot;), which takes the features extracted from the &quot;architecture&quot; and makes a classification.</p>
  <p>This terminology is definitely non-standard here, at least in the AI community, and if you ask anyone here I think it will be uncommon for them to naturally think about the words &quot;architecture&quot; vs &quot;backbone&quot; in this way unless they specialize in a similar field to the authors.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-21T00:08:26.233Z
Answers.Text: I don't know if it's standard or not, but I've seen the term "backbone" being used in several CV papers. For example, take a look at [this famous paper](https://openaccess.thecvf.com/content_ICCV_2019/papers/Roy_Siamese_Networks_The_Tale_of_Two_Manifolds_ICCV_2019_paper.pdf) (famous siamese networks) or [this other one](https://arxiv.org/pdf/1703.06870.pdf) (mask R-CNN). I am pretty sure there are other examples, so I think that this terminology is not that uncommon, at least, in papers that introduce DL-based CV techniques.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-21T00:11:44.147Z
Answers.Text: There's also [this SO question](https://stackoverflow.com/q/59868132/3924118) or [this Stats question](https://stats.stackexchange.com/a/401107/82135). In any case, I don't know if this terminology is being used consistently or not across all these papers. I am not familiar with the paper mentioned in this post (and I don't really have time to read it now), but I think that your interpretation of the terms is different than the usage of these terms in other contexts (such as mask R-CNN, although it's been a long time since I skimmed through that mask R-CNN papers).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-21T00:17:35.540Z
Answers.Text: So, if you have some time, I suggest that you go through these papers (and questions/posts) more carefully and try to understand what they really mean by that and if they are being used consistently across these papers.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-21T21:44:24.850Z
Answers.Text: Thanks! I'll give it a read when I get the chance
Answers.UserDisplayName: user3667125
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-06-05T09:20:39.943Z
Answers.Text: The backbone term may be borrowed from other fields of software development. I work in web development and would understand them differently. The weird thing for me here is that "architecture" seems clearly used in the ai/NN sense, whilst "backbone" seems to be used in a more general software Dev sense.
Answers.UserDisplayName: Neil Slater
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-18T22:17:16.230Z
Answers.LastActivityDate: 2022-01-05T10:51:30.617Z
Answers.LastEditDate: 2022-01-05T10:51:30.617Z
Answers.UserDisplayName: user3667125
Answers.Body: <p>I've taken an NVIDIA course on the portal and it said that ResNet, VGG, GoogleNet were model architectures , and that DetectNet_V2,FasterRCNN,SSD, UNET were model backbones, so I think it's a common terminology</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-06-19T12:59:24.580Z
Answers.Text: It's actually the opposite for me. ResNet, VGG and GoogleNet are convolutional backbones, while FasteRCNN, SSD and DetectNet are typical Object Detection architectures, and UNET is a FC architecture for image-to-image tasks (e.g object segmentation).
Answers.UserDisplayName: Ciodar
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-09-21T14:32:49.857Z
Answers.LastActivityDate: 2022-09-21T14:32:49.857Z
Answers.UserDisplayName: imaneeh
Body: <p>In the paper &quot;<a href="https://arxiv.org/pdf/2011.05479.pdf" rel="nofollow noreferrer">ForestNet: Classifying Drivers of Deforestation in Indonesia using Deep Learning on Satellite Imagery</a>&quot;, the authors talk about using:</p>
  <ol>
  <li>Feature Pyramid Networks (as the architecture)</li>
  <li>EfficientNet-B2 (as the backbone)</li>
  </ol>
  <blockquote>
  <p><strong>Performance Measures on the Validation Set</strong>. The RF model that only inputs data from the visible Landsat 8 bands achieved the lowest
  performance on the validation set, but the incorporation of auxiliary
  predictors substantially improved its performance. All of the CNN
  models outperformed the RF models. The best performing model, which we
  call ForestNet, used an FPN architecture with an EfficientNet-B2
  backbone. The use of SDA provided large performance gains on the
  validation set, and land cover pre-training and incorporating
  auxiliary predictors each led to additional performance improvements.</p>
  </blockquote>
  <p>What's the difference between architectures and backbones? I can't find much online. Specifically, what are their respective purposes? From a high-level perspective, what would integrating the two look like?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-12-18T20:17:50.227Z
Comments.Text: [That paper](https://arxiv.org/pdf/2011.05479.pdf) gives the email of authors. Why don't you ask them by email?
Comments.UserDisplayName: Basile Starynkevitch
Tags: <deep-learning><convolutional-neural-networks><comparison><terminology><architecture>
Title: What's the difference between architectures and backbones?
UserDisplayName: codinggirl123
ThreadText: # What's the difference between architectures and backbones?
  
  (Asked by: username_0 on 2020-12-18)
  
  In the paper "[ForestNet: Classifying Drivers of Deforestation in Indonesia using Deep Learning on Satellite Imagery](https://arxiv.org/pdf/2011.05479.pdf)", the authors talk about using:
  
  1. Feature Pyramid Networks (as the architecture)
  2. EfficientNet-B2 (as the backbone)
  
  > **Performance Measures on the Validation Set**. The RF model that only inputs data from the visible Landsat 8 bands achieved the lowest
  > performance on the validation set, but the incorporation of auxiliary
  > predictors substantially improved its performance. All of the CNN
  > models outperformed the RF models. The best performing model, which we
  > call ForestNet, used an FPN architecture with an EfficientNet-B2
  > backbone. The use of SDA provided large performance gains on the
  > validation set, and land cover pre-training and incorporating
  > auxiliary predictors each led to additional performance improvements.
  
  What's the difference between architectures and backbones? I can't find much online. Specifically, what are their respective purposes? From a high-level perspective, what would integrating the two look like?
  
  **Tags:** deep-learning, convolutional-neural-networks, comparison, terminology, architecture
  > **Comments:**
  > **username_1**: [That paper](https://arxiv.org/pdf/2011.05479.pdf) gives the email of authors. Why don't you ask them by email?  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_2 on 2024-10-11. Score: 0
  
  Architecture is the entire model.
  
  **Backbone** is the first few hidden layers. This is containing low-level features which generalize the knowledge. Practically, it's commonly used in pretrain where this backbone weights are frozen (non-updatable). This is make sense since it's trained something general.
  
  Another terms are **Neck** and **Head**.
  
  **Neck** is the intermediary layers between **Head** and **Backbone**. It's commonly used in transition for multi-task learning.
  
  While the **Head** is simply the output layer for certain task.
  
  
  ---
  
  ### Answer by username_3 on 2020-12-18. Score: 0
  
  The vocabulary is definitely non-standard and a bit confusing, but Feature Pyramid Networks is used as a feature extractor, and its output is then fed into EfficientNet-B2 to be used to classify the image. One neural network model is concatenated at the end of the other.
  
  So it seems like "architecture" is the front half of the neural network model which takes as input the satellite image and extracts image features, and then is directly connected to the back half of the model (hence "backbone"), which takes the features extracted from the "architecture" and makes a classification.
  
  This terminology is definitely non-standard here, at least in the AI community, and if you ask anyone here I think it will be uncommon for them to naturally think about the words "architecture" vs "backbone" in this way unless they specialize in a similar field to the authors.
  
  > **Comments:**
  > **username_4**: I don't know if it's standard or not, but I've seen the term "backbone" being used in several CV papers. For example, take a look at [this famous paper](https://openaccess.thecvf.com/content_ICCV_2019/papers/Roy_Siamese_Networks_The_Tale_of_Two_Manifolds_ICCV_2019_paper.pdf) (famous siamese networks) or [this other one](https://arxiv.org/pdf/1703.06870.pdf) (mask R-CNN). I am pretty sure there are other examples, so I think that this terminology is not that uncommon, at least, in papers that introduce DL-based CV techniques.  
  > **username_4**: There's also [this SO question](https://stackoverflow.com/q/59868132/3924118) or [this Stats question](https://stats.stackexchange.com/a/401107/82135). In any case, I don't know if this terminology is being used consistently or not across all these papers. I am not familiar with the paper mentioned in this post (and I don't really have time to read it now), but I think that your interpretation of the terms is different than the usage of these terms in other contexts (such as mask R-CNN, although it's been a long time since I skimmed through that mask R-CNN papers).  
  > **username_4**: So, if you have some time, I suggest that you go through these papers (and questions/posts) more carefully and try to understand what they really mean by that and if they are being used consistently across these papers.  
  > **username_3**: Thanks! I'll give it a read when I get the chance  
  > **username_5**: The backbone term may be borrowed from other fields of software development. I work in web development and would understand them differently. The weird thing for me here is that "architecture" seems clearly used in the ai/NN sense, whilst "backbone" seems to be used in a more general software Dev sense.  
  
  ---
  
  ### Answer by username_6 on 2022-09-21. Score: -1
  
  I've taken an NVIDIA course on the portal and it said that ResNet, VGG, GoogleNet were model architectures , and that DetectNet\_V2,FasterRCNN,SSD, UNET were model backbones, so I think it's a common terminology
  
  > **Comments:**
  > **username_7**: It's actually the opposite for me. ResNet, VGG and GoogleNet are convolutional backbones, while FasteRCNN, SSD and DetectNet are typical Object Detection architectures, and UNET is a FC architecture for image-to-image tasks (e.g object segmentation).  
  
  ---
  
  