Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
Ω(θ))becomes: As α approaches 0, w comes closer to w*. Finally, since H is real and symmetric, it can be decomposed into a diagonal matrix ∧ and an orthonormal set of eigenvectors, Q.That is, H = Q’ ∧ Q. Because of the marked term, the value of each weight is rescaled along the eigenvectors of H.