Machine Learning, Deep Learning, Artificial Intelligence, Regularization, Deep Learning Book.
large), the parameter space is small and vice versa. This equivalence holds true for a linear model with quadratic cost function (initial parameters w⁰ = 0). Taking the Taylor Series Approximation of J(w) around the empirically optimal weights w*: multiplying with Q’ on both sides and using the