Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
The value of the weights along the eigenvector i,is rescaled by λi /(λi+α), where λi represents the eigenvalue corresponding to that eigenvector. The diagram below illustrates this well: To look at its application to Machine Learning, we have to look at linear regression. The objective function