Body: <p>Are there any commonly used activation functions (e.g. that take values in <span class="math-container">$(0,.5)\cup (.5,1)$</span>)? Preferably for classification?</p>
  
  <p>Why? I was looking for commonly used activation functions on Google, and I noticed that all activation functions are continuous. However, I believe this is not needed in Hornik's paper.</p>
  
  <p>When I did a bit of testing myself, with a discontinuous activation function on the MNIST dataset, the results were good. So I was curious if anyone else used this kind of activation function.  </p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-04-01T06:49:53.190Z
Comments.Text: I'm looking for a commonly used discontinuous bounded activation function.  Somethign I can use for classification..
Comments.UserDisplayName: ABIM
Tags: <deep-learning><deep-neural-networks><activation-functions>
Title: Are there any commonly used discontinuous activation functions?
UserDisplayName: ABIM
ThreadText: # Are there any commonly used discontinuous activation functions?
  
  (Asked by: username_0 on 2020-03-31)
  
  Are there any commonly used activation functions (e.g. that take values in $(0,.5)\cup (.5,1)$)? Preferably for classification?
  
  Why? I was looking for commonly used activation functions on Google, and I noticed that all activation functions are continuous. However, I believe this is not needed in Hornik's paper.
  
  When I did a bit of testing myself, with a discontinuous activation function on the MNIST dataset, the results were good. So I was curious if anyone else used this kind of activation function.
  
  **Tags:** deep-learning, deep-neural-networks, activation-functions
  > **Comments:**
  > **username_0**: I'm looking for a commonly used discontinuous bounded activation function.  Somethign I can use for classification..  
  
  ---
  
  ## 0 answers
  
  