Machine Learning, Artificial Intelligence, Deep Learning, Neural Networks.
pruning while training to get rid of connections that are close to zero. So far we have demonstrated why sparsity can avoid over-fitting. But why adding an L1 norm to the loss function and forcing the L1 norm of the solution to be small can produce sparsity? Yesterday when I first thought about