Relu, Neural Networks, Deep Learning, Data Science, Machine Learning.
a NN that consists of one hidden layer with ReLU activation and a linear output layer. Example To make it more concrete, we consider an example of a CPWL function that consists of 4 linear segments defined as below. Figure 4: Example of a PWL function. To represent this target function, we will use