Answers.Body: <p>Yes, it is applied element-wise on every single value of the feature map.
  Assuming ReLU as your nonlinearity function, all negative values of the image feature map are set to zero, and the rest of the elements stay unchanged.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-05-08T17:23:33.287Z
Answers.LastActivityDate: 2020-05-08T17:23:33.287Z
Answers.UserDisplayName: Amir
Body: <p>If I have a convolutional neural network, and I convolve my input tensor with a kernel, the output is a feature map. Is an activation function then applied to this feature map?</p>
  
  <p>If its an image that is a 2D tensor, would the activation function change every single value on this image? </p>
  
Tags: <convolutional-neural-networks><activation-functions><convolution>
Title: Are activation functions applied to feature maps?
UserDisplayName: Khan
ThreadText: # Are activation functions applied to feature maps?
  
  (Asked by: username_0 on 2020-05-07)
  
  If I have a convolutional neural network, and I convolve my input tensor with a kernel, the output is a feature map. Is an activation function then applied to this feature map?
  
  If its an image that is a 2D tensor, would the activation function change every single value on this image?
  
  **Tags:** convolutional-neural-networks, activation-functions, convolution
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-05-08. Score: 2 | Accepted answer
  
  Yes, it is applied element-wise on every single value of the feature map.
  Assuming ReLU as your nonlinearity function, all negative values of the image feature map are set to zero, and the rest of the elements stay unchanged.
  
  
  ---
  
  