Answers.Body: <p>The term "activated" is mostly used when talking about activation functions which only outputs a value (except 0) when the input to the activation function is greater than a certain treshold.</p>
  
  <p>Especially when discussing ReLU the term "activated" may be used. ReLU will be "activated" when it's output is greater than 0, which is also when it's input is greater than 0.</p>
  
  <p>Other activation functions, like sigmoid, always returns a value greater than 0, and doesn't have any special treshold. Therefore, the term "activated" is of less meaning here.</p>
  
  <p>Even though we know little about them, the neurons in the brain also seems to have something which resembles an activation function with some kind of "activation treshold".</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-08-14T22:02:35.000Z
Answers.LastActivityDate: 2018-08-14T22:02:35.000Z
Answers.UserDisplayName: Mr. Eivind
Answers.Body: <p>A neuron is said activated when its output is more than a threshold, generally 0.</p>
  
  <p>For examples :
  \begin{equation}
  y = Relu(a) &gt; 0
  \end{equation}
  when 
  \begin{equation}
  a = w^Tx+b &gt; 0
  \end{equation}</p>
  
  <p>Same goes for sigmoid or other activation functions.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-08-14T13:51:10.510Z
Answers.LastActivityDate: 2018-08-14T13:51:10.510Z
Answers.UserDisplayName: Jérémy Blain
Body: <p>I just stumbled upon the concept of neuron coverage, which is the ratio of activated neurons and total neurons in a neural network. But what does it mean for a neuron to be "activated"? I know what activation functions are, but what does being activated mean e.g. in the case of a ReLU or a sigmoid function?</p>
  
Tags: <neural-networks><machine-learning><activation-functions><artificial-neuron>
Title: What does it mean for a neuron in a neural network to be activated?
UserDisplayName: Leon
ThreadText: # What does it mean for a neuron in a neural network to be activated?
  
  (Asked by: username_0 on 2018-08-14)
  
  I just stumbled upon the concept of neuron coverage, which is the ratio of activated neurons and total neurons in a neural network. But what does it mean for a neuron to be "activated"? I know what activation functions are, but what does being activated mean e.g. in the case of a ReLU or a sigmoid function?
  
  **Tags:** neural-networks, machine-learning, activation-functions, artificial-neuron
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2018-08-14. Score: 12 | Accepted answer
  
  A neuron is said activated when its output is more than a threshold, generally 0.
  
  For examples :
  \begin{equation}
  y = Relu(a) > 0
  \end{equation}
  when
  \begin{equation}
  a = w^Tx+b > 0
  \end{equation}
  
  Same goes for sigmoid or other activation functions.
  
  
  ---
  
  ### Answer by username_1 on 2018-08-14. Score: 4
  
  The term "activated" is mostly used when talking about activation functions which only outputs a value (except 0) when the input to the activation function is greater than a certain treshold.
  
  Especially when discussing ReLU the term "activated" may be used. ReLU will be "activated" when it's output is greater than 0, which is also when it's input is greater than 0.
  
  Other activation functions, like sigmoid, always returns a value greater than 0, and doesn't have any special treshold. Therefore, the term "activated" is of less meaning here.
  
  Even though we know little about them, the neurons in the brain also seems to have something which resembles an activation function with some kind of "activation treshold".
  
  
  ---
  
  