Activation Function


### Unlike sign function for [Back Propagation](https://texonom.com/back-propagation-18f4493692ad43449d4271f1bb293781), use non zero derivative
- sigmoid function - probability
- sign function - predict class
### Activation Functions
|Title|
|:-:|
|[Sigmoid Function](https://texonom.com/sigmoid-function-417e17b995cf40c996cec78f699ea59b)|
|[GELU](https://texonom.com/gelu-8f18023a80b84a06b5afd648811df6bc)|
|[ReLU](https://texonom.com/relu-e582549804da48b893758895e446ffb9)|
|[Sign Function](https://texonom.com/sign-function-b95e191cc2dc43c0befd6231f022555f)|
|[ELU Function](https://texonom.com/elu-function-c7306a8566014b4e9d0733b52bd399fa)|
|[Mish Function](https://texonom.com/mish-function-39eaae692b284adbadde08d3d707f13d)|
|[Tanh Function](https://texonom.com/tanh-function-679abf35c4eb4fb0bb0e56140cac3d23)|
|[Maxout Function](https://texonom.com/maxout-function-ad1f081fa0c34a6fbee08259c82ea4a1)|
|[ELU Function](https://texonom.com/elu-function-e6f30f8fff2c422993a85565f8ce5ee7)|



> [0023 Loss & Metric - Deepest Documentation](https://deepestdocs.readthedocs.io/en/latest/002_deep_learning_part_1/0023/)






