Relu, Neural Networks, Deep Learning, Data Science, Machine Learning.
types can be represented using a NN that consists of one hidden layer, given enough neurons with ReLU activation. For illustrative purposes, we consider only single feature inputs yet the idea applies to multiple feature inputs as well. ReLU activation Figure 1: Rectified Linear Unit (ReLU)