Answers.Body: <p>This number refers to the number of kernels (or feature maps) that are convolved with the input. So, for example, in the first convolutional layer, <span class="math-container">$64$</span> <span class="math-container">$3 \times 3$</span> kernels are convolved with the image.</p>
  
  <p>The ResNet presented in <a href="https://arxiv.org/pdf/1512.03385.pdf" rel="nofollow noreferrer">Deep Residual Learning for Image Recognition</a> is used for image classification. Furthermore, note that your diagram already contains a fully connected layer at the end.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-07T10:24:45.447Z
Answers.Text: Are those all distinct kernels or is that the total number of convolutions that a particular 3x3 filter must perform when passed over all the pixels in an image? I added the FC layer at the end because I copied the format of their model, however mine isn't used for classification so should I remove the FC layer and possibly the average pooling?
Answers.UserDisplayName: thatsnotmyname71
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-07T10:54:55.910Z
Answers.Text: @thatsnotmyname71 The kernels in a CNN are learned, so they will likely all be distinct. What do you mean by _the embedding output a network produces for an image_? Maybe you could ask a separate question (in a separate post) with more details regarding your specific problem.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-08T08:29:47.037Z
Answers.Text: ahh, thank you, I understand the kernels now. The network is used for unsupervised learning, so an output embedding for image triplets (which allows the use of a loss function encouraging embeddings which separate the 'anchor' image from its 'distant' image. The concept comes from Tile2Vec/Word2Vec (https://arxiv.org/abs/1805.02855).
Answers.UserDisplayName: thatsnotmyname71
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-09T11:04:21.257Z
Answers.Text: @thatsnotmyname71 I will have to read your linked paper before trying to give you an appropriate answer.
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-08-07T10:10:35.693Z
Answers.LastActivityDate: 2019-08-07T10:10:35.693Z
Answers.UserDisplayName: nbro
Body: <p>So I've got a neural net model (ResNet-18) and made a diagram according to the literature (<a href="https://arxiv.org/abs/1512.03385" rel="nofollow noreferrer">https://arxiv.org/abs/1512.03385</a>). </p>
  
  <p>I think I understand most of the format of the convolutional layers:
  <em>filter dims</em> ,conv, <strong><em>unknown number</em></strong> ,<em>stride</em>(if applicable)</p>
  
  <p>What does the number after 'conv' in the convolutional layers indicate? is it the number of neurons in the layer? </p>
  
  <p><a href="https://i.sstatic.net/pkPi3.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/pkPi3.png" alt="ResNet-18 architecture"></a></p>
  
  <p>bonus q: this is being used for unsupervised learning of images, i.e the embedding output a network produces for an image is used for clustering. Would this make it incorrect for my architecture to have an FC layer at the end (which would be used for classifcation)?</p>
  
Tags: <convolutional-neural-networks><architecture>
Title: What do the numbers in this CNN architecture stand for?
UserDisplayName: thatsnotmyname71
ThreadText: # What do the numbers in this CNN architecture stand for?
  
  (Asked by: username_0 on 2019-08-07)
  
  So I've got a neural net model (ResNet-18) and made a diagram according to the literature (<https://arxiv.org/abs/1512.03385>).
  
  I think I understand most of the format of the convolutional layers:
  *filter dims* ,conv, ***unknown number*** ,*stride*(if applicable)
  
  What does the number after 'conv' in the convolutional layers indicate? is it the number of neurons in the layer?
  
  [![ResNet-18 architecture](https://i.sstatic.net/pkPi3.png)](https://i.sstatic.net/pkPi3.png)
  
  bonus q: this is being used for unsupervised learning of images, i.e the embedding output a network produces for an image is used for clustering. Would this make it incorrect for my architecture to have an FC layer at the end (which would be used for classifcation)?
  
  **Tags:** convolutional-neural-networks, architecture
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2019-08-07. Score: 1
  
  This number refers to the number of kernels (or feature maps) that are convolved with the input. So, for example, in the first convolutional layer, $64$ $3 \times 3$ kernels are convolved with the image.
  
  The ResNet presented in [Deep Residual Learning for Image Recognition](https://arxiv.org/pdf/1512.03385.pdf) is used for image classification. Furthermore, note that your diagram already contains a fully connected layer at the end.
  
  > **Comments:**
  > **username_0**: Are those all distinct kernels or is that the total number of convolutions that a particular 3x3 filter must perform when passed over all the pixels in an image? I added the FC layer at the end because I copied the format of their model, however mine isn't used for classification so should I remove the FC layer and possibly the average pooling?  
  > **username_1**: @thatsnotmyname71 The kernels in a CNN are learned, so they will likely all be distinct. What do you mean by _the embedding output a network produces for an image_? Maybe you could ask a separate question (in a separate post) with more details regarding your specific problem.  
  > **username_0**: ahh, thank you, I understand the kernels now. The network is used for unsupervised learning, so an output embedding for image triplets (which allows the use of a loss function encouraging embeddings which separate the 'anchor' image from its 'distant' image. The concept comes from Tile2Vec/Word2Vec (https://arxiv.org/abs/1805.02855).  
  > **username_1**: @thatsnotmyname71 I will have to read your linked paper before trying to give you an appropriate answer.  
  
  ---
  
  