Answers.Body: <p>No, it is not only applicable to CNNs, but to a wide range of other architectures, <a href="https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1194/reports/custom/15763707.pdf" rel="nofollow noreferrer">even the hype transformers</a>.</p>
  <p>For an extensive survey, I recommend that you have a look at this paper <a href="https://arxiv.org/abs/2003.03033" rel="nofollow noreferrer">What is the State of Neural Network Pruning?</a>.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-29T10:36:59.003Z
Answers.LastActivityDate: 2021-11-26T23:20:35.707Z
Answers.LastEditDate: 2021-11-26T23:20:35.707Z
Answers.UserDisplayName: spiridon_the_sun_rotator
Answers.Body: <p>No, neural network pruning is applicable to any type of neural network, be it a feed-forward, convolutional or recurrent neural network.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-29T09:39:56.290Z
Answers.Text: To support your claim, maybe you could provide a link to a research paper that applies pruning to e.g. a FFNN (that maybe also includes the implementation).
Answers.UserDisplayName: nbro
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2021-06-29T08:11:37.193Z
Answers.LastActivityDate: 2021-06-29T08:11:37.193Z
Answers.UserDisplayName: SpiderRico
Body: <p><a href="https://analyticsindiamag.com/what-is-neural-network-pruning-and-why-is-it-important-today/" rel="nofollow noreferrer">This article</a> talks about pruning in the context of convolutional neural networks:</p>
  <blockquote>
  <p>One of the first methods of pruning is pruning entire convolutional filters. Using an L1 norm of the weight of all the filters in the network, they rank them. This is then followed by pruning the ‘n’ lowest ranking filters globally. The model is then retrained and this process is repeated.</p>
  <p>There also exist methods for implementing structured pruning for a more light-touch approach of regulating the output of the method. This method utilizes a set of particle filters that are the same in number as the number of convolutional filters in the network.</p>
  </blockquote>
  <p>Is pruning only applicable to CNNs?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-06-29T06:52:58.163Z
Comments.Text: No, you can apply the same concepts to any type of network. Also pruning is quite common when dealing with graphs.
Comments.UserDisplayName: razvanc92
Tags: <neural-networks><convolutional-neural-networks><optimization><filters>
Title: Is pruning only applicable to convolutional neural networks?
UserDisplayName: user366312
ThreadText: # Is pruning only applicable to convolutional neural networks?
  
  (Asked by: username_0 on 2021-06-29)
  
  [This article](https://analyticsindiamag.com/what-is-neural-network-pruning-and-why-is-it-important-today/) talks about pruning in the context of convolutional neural networks:
  
  > One of the first methods of pruning is pruning entire convolutional filters. Using an L1 norm of the weight of all the filters in the network, they rank them. This is then followed by pruning the ‘n’ lowest ranking filters globally. The model is then retrained and this process is repeated.
  >
  > There also exist methods for implementing structured pruning for a more light-touch approach of regulating the output of the method. This method utilizes a set of particle filters that are the same in number as the number of convolutional filters in the network.
  
  Is pruning only applicable to CNNs?
  
  **Tags:** neural-networks, convolutional-neural-networks, optimization, filters
  > **Comments:**
  > **username_1**: No, you can apply the same concepts to any type of network. Also pruning is quite common when dealing with graphs.  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2021-06-29. Score: 1
  
  No, it is not only applicable to CNNs, but to a wide range of other architectures, [even the hype transformers](https://web.stanford.edu/class/archive/cs/cs224n/cs224n.1194/reports/custom/15763707.pdf).
  
  For an extensive survey, I recommend that you have a look at this paper [What is the State of Neural Network Pruning?](https://arxiv.org/abs/2003.03033).
  
  
  ---
  
  ### Answer by username_3 on 2021-06-29. Score: 0
  
  No, neural network pruning is applicable to any type of neural network, be it a feed-forward, convolutional or recurrent neural network.
  
  > **Comments:**
  > **username_4**: To support your claim, maybe you could provide a link to a research paper that applies pruning to e.g. a FFNN (that maybe also includes the implementation).  
  
  ---
  
  