<p>Are there any commonly used activation functions (e.g. that take values in <span class="math-container">$(0,.5)\cup (.5,1)$</span>)? Preferably for classification?</p>

<p>Why? I was looking for commonly used activation functions on Google, and I noticed that all activation functions are continuous. However, I believe this is not needed in Hornik's paper.</p>

<p>When I did a bit of testing myself, with a discontinuous activation function on the MNIST dataset, the results were good. So I was curious if anyone else used this kind of activation function.  </p>

CC BY-SA 4.0
2020-04-01T06:49:53.190Z
I'm looking for a commonly used discontinuous bounded activation function.  Somethign I can use for classification..
ABIM
<deep-learning><deep-neural-networks><activation-functions>
Are there any commonly used discontinuous activation functions?
ABIM
# Are there any commonly used discontinuous activation functions?

(Asked by: username_0 on 2020-03-31)

Are there any commonly used activation functions (e.g. that take values in $(0,.5)\cup (.5,1)$)? Preferably for classification?

Why? I was looking for commonly used activation functions on Google, and I noticed that all activation functions are continuous. However, I believe this is not needed in Hornik's paper.

When I did a bit of testing myself, with a discontinuous activation function on the MNIST dataset, the results were good. So I was curious if anyone else used this kind of activation function.

**Tags:** deep-learning, deep-neural-networks, activation-functions

> **Comments:**
> **username_0**: I'm looking for a commonly used discontinuous bounded activation function.  Somethign I can use for classification..  

---

## 0 answers

