Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
the weights. Another idea could be to average the activation values across various examples and push it towards some value. An example of getting representational sparsity by imposing hard constraint on the activation value is the Orthogonal Matching Pursuit (OMP) algorithm, where a representation