Answers.Body: <p>Yes, it is not specified because the region proposal algorithm did not change from R-CNN (the previous version from Fast R-CNN, however, in the next verion, Faster R-CNN, this algorithm is replaced by a CNN).</p>
  <p>The region proposal algorithm you are looking for is called selective search. You can find in the R-CNN paper that the algorithm is described in &quot;Selective Search for Object Recognition&quot;, I found a copy <a href="http://www.huppelen.nl/publications/selectiveSearchDraft.pdf" rel="nofollow noreferrer">here</a>.</p>
  <p>The algorithm is based on a series of segmentation and aggregation techniques of the input image for generating the proposed regions. Check it out 4 iterations of segmentation &amp; aggregation over the same input image to build the proposed regions.</p>
  <p><a href="https://i.sstatic.net/K9vNZ.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/K9vNZ.png" alt="enter image description here" /></a></p>
  <p>All the algorithm is doing is just iterating over 4 steps:</p>
  <ol>
  <li>Initial regions based on segmentation by pixel light intensity are obtained by applying a segmentation algorithm described in the paper. For example, given a picture of a shepherd with his sheep in the mountain, it is segmented by light intensity, and the image of Figure (a) is obtained.</li>
  <li>Different regions are proposed based on the previous segmentation, Figure (e)</li>
  <li>The similarity between the proposed regions is calculated using the formula proposed in equation 6
  in Section 3.2 in the paper which is nothing more than an aggregate metric of the similarity of two regions based in 4 metrics: similarity in color, texture, size and fill (measures how well a region within another)</li>
  <li>Add the regions based on similarity and get Figure (b). Then return to step two.</li>
  </ol>
  <p>That is how iteratively you get all the images depicted.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-02-03T17:20:22.583Z
Answers.Text: This answer is nice (because it visually shows what you mean by "segmentation + aggregation"), but it doesn't describe how "selective search" actually proceeds. So, to improve this answer, I would suggest that you attempt to describe "selective search" slightly more in detail (maybe provide the pseudocode, if it exists?), so that people when reading your answer (which could serve as a reference) have a more detailed idea than "segmentation + aggregation", which is somehow explained by the images that you show us.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-02-04T10:47:12.863Z
Answers.Text: yep, you re right, already updated :)
Answers.UserDisplayName: JVGD
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-02-04T10:52:11.383Z
Answers.Text: Maybe the only thing that is missing in your answer would be an answer to this question "And how is the size of these proposed regions calculated?".
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-02-04T12:45:31.520Z
Answers.Text: The intuitive approach on how the regions are calculated is easy to express with words but not that easy mathematically speaking. For a true description the algorithm is explained in the paper (algorithm 1) but I feel that if we were to describe it in here it would make this answer very big
Answers.UserDisplayName: JVGD
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-02T11:36:09.927Z
Answers.LastActivityDate: 2021-02-04T10:46:56.180Z
Answers.LastEditDate: 2021-02-04T10:46:56.180Z
Answers.UserDisplayName: JVGD
Body: <p>I read so many articles and the Fast R-CNN paper, but I'm still confused about how the region proposal method works in Fast R-CNN.</p>
  <p>As you can see in the image below, they say they used a <em>proposal method</em>, but it is not specified how it works.</p>
  <p>What confuses me is, for example, in the VGGnet, the output of the last convolution layer is feature maps of shape 14x14x512, but what is the used algorithm to propose the regions and how does it propose them from the feature maps?</p>
  <p><a href="https://i.sstatic.net/AQUnI.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/AQUnI.jpg" alt="enter image description here" /></a></p>
  
Tags: <computer-vision><object-detection><r-cnn><selective-search><faster-r-cnn>
Title: How does the region proposal method work in Fast R-CNN?
UserDisplayName: ozoubia
ThreadText: # How does the region proposal method work in Fast R-CNN?
  
  (Asked by: username_0 on 2020-05-10)
  
  I read so many articles and the Fast R-CNN paper, but I'm still confused about how the region proposal method works in Fast R-CNN.
  
  As you can see in the image below, they say they used a *proposal method*, but it is not specified how it works.
  
  What confuses me is, for example, in the VGGnet, the output of the last convolution layer is feature maps of shape 14x14x512, but what is the used algorithm to propose the regions and how does it propose them from the feature maps?
  
  [![enter image description here](https://i.sstatic.net/AQUnI.jpg)](https://i.sstatic.net/AQUnI.jpg)
  
  **Tags:** computer-vision, object-detection, r-cnn, selective-search, faster-r-cnn
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-08-02. Score: 4
  
  Yes, it is not specified because the region proposal algorithm did not change from R-CNN (the previous version from Fast R-CNN, however, in the next verion, Faster R-CNN, this algorithm is replaced by a CNN).
  
  The region proposal algorithm you are looking for is called selective search. You can find in the R-CNN paper that the algorithm is described in "Selective Search for Object Recognition", I found a copy [here](http://www.huppelen.nl/publications/selectiveSearchDraft.pdf).
  
  The algorithm is based on a series of segmentation and aggregation techniques of the input image for generating the proposed regions. Check it out 4 iterations of segmentation & aggregation over the same input image to build the proposed regions.
  
  [![enter image description here](https://i.sstatic.net/K9vNZ.png)](https://i.sstatic.net/K9vNZ.png)
  
  All the algorithm is doing is just iterating over 4 steps:
  
  1. Initial regions based on segmentation by pixel light intensity are obtained by applying a segmentation algorithm described in the paper. For example, given a picture of a shepherd with his sheep in the mountain, it is segmented by light intensity, and the image of Figure (a) is obtained.
  2. Different regions are proposed based on the previous segmentation, Figure (e)
  3. The similarity between the proposed regions is calculated using the formula proposed in equation 6
     in Section 3.2 in the paper which is nothing more than an aggregate metric of the similarity of two regions based in 4 metrics: similarity in color, texture, size and fill (measures how well a region within another)
  4. Add the regions based on similarity and get Figure (b). Then return to step two.
  
  That is how iteratively you get all the images depicted.
  
  > **Comments:**
  > **username_2**: This answer is nice (because it visually shows what you mean by "segmentation + aggregation"), but it doesn't describe how "selective search" actually proceeds. So, to improve this answer, I would suggest that you attempt to describe "selective search" slightly more in detail (maybe provide the pseudocode, if it exists?), so that people when reading your answer (which could serve as a reference) have a more detailed idea than "segmentation + aggregation", which is somehow explained by the images that you show us.  
  > **username_1**: yep, you re right, already updated :)  
  > **username_2**: Maybe the only thing that is missing in your answer would be an answer to this question "And how is the size of these proposed regions calculated?".  
  > **username_1**: The intuitive approach on how the regions are calculated is easy to express with words but not that easy mathematically speaking. For a true description the algorithm is explained in the paper (algorithm 1) but I feel that if we were to describe it in here it would make this answer very big  
  
  ---
  
  