AI, Machine Learning, Artificial Intelligence, Deep Learning, Data Science.
sparsity constraint to the loss function. One common approach to achieving sparsity is to add an L1 regularization term to the loss function, which encourages the absolute values of the encoding layer activations to be small. This has the effect of pushing many of the activations to be exactly