AI, Machine Learning, Artificial Intelligence, Deep Learning, Data Science.
zero, resulting in a sparse representation. Another approach to achieving sparsity is to use a special type of activation function, such as the rectified linear unit (ReLU), which is non-linear but also has a sparse output. ReLU sets any negative values in the output to zero, effectively