Machine Learning, Artificial Intelligence, Deep Learning, Neural Networks.
sparse solution avoid over-fitting? what does regularization do really? My initial confusion came from the fact that I only looked at the L1 norm and only thought about what it means for L1 norm to be small. What I should really do, however, is thinking the loss function and the L1 norm penalty as