Answers.Body: <p>Well, in regards to properties of CNNs in regards to local versus global features, you should familiarize yourself with the concepts of invariance and equivariance. At some point you should also learn about the Picasso problem which is a consequence of the invariances and equivariances of CNNs + pooling.</p>
  <p>That will probably also mean you'll encounter Capsule Nets at some point. While not really CNNs, learning about CapsNets can elucidate the weaknesses of convolutions since CapsNets were made to solve several of those.</p>
  <p>There are CNN architectures that, in parallel, use different scales of local features, such as the Inception architecture and ResNext; Both combine local features on different scales, i.e. they use differently sized kernels in parallel to improve classifications.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-10-30T06:39:28.137Z
Answers.LastActivityDate: 2021-10-30T06:39:28.137Z
Answers.UserDisplayName: Avatrin
Body: <p>Kaparthy in his <a href="https://karpathy.github.io/2019/04/25/recipe/" rel="nofollow noreferrer">blog post</a> said</p>
  <blockquote>
  <p>[this] hints at the kinds of architectures we’ll eventually explore. As an example - are very local features enough or do we need global context?</p>
  </blockquote>
  <p>I'd like to gain expertise in designing networks for local vs global features. Obviously increasing the receptive field of neurons (though more pooling/striding and bigger kernels) will allow to network to take more global context into account.</p>
  <p>Could someone point me in the direction of some readings on the topic?</p>
  <p>Are there any specific architectures targeted to local features or to global context?</p>
  
Tags: <neural-networks><convolutional-neural-networks><computer-vision><reference-request><architecture>
Title: CNN Architectures for local features vs global context
UserDisplayName: Tom Huntington
ThreadText: # CNN Architectures for local features vs global context
  
  (Asked by: username_0 on 2021-10-27)
  
  Kaparthy in his [blog post](https://karpathy.github.io/2019/04/25/recipe/) said
  
  > [this] hints at the kinds of architectures we’ll eventually explore. As an example - are very local features enough or do we need global context?
  
  I'd like to gain expertise in designing networks for local vs global features. Obviously increasing the receptive field of neurons (though more pooling/striding and bigger kernels) will allow to network to take more global context into account.
  
  Could someone point me in the direction of some readings on the topic?
  
  Are there any specific architectures targeted to local features or to global context?
  
  **Tags:** neural-networks, convolutional-neural-networks, computer-vision, reference-request, architecture
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2021-10-30. Score: 2 | Accepted answer
  
  Well, in regards to properties of CNNs in regards to local versus global features, you should familiarize yourself with the concepts of invariance and equivariance. At some point you should also learn about the Picasso problem which is a consequence of the invariances and equivariances of CNNs + pooling.
  
  That will probably also mean you'll encounter Capsule Nets at some point. While not really CNNs, learning about CapsNets can elucidate the weaknesses of convolutions since CapsNets were made to solve several of those.
  
  There are CNN architectures that, in parallel, use different scales of local features, such as the Inception architecture and ResNext; Both combine local features on different scales, i.e. they use differently sized kernels in parallel to improve classifications.
  
  
  ---
  
  