Machine Learning, Neural Networks, Statistics, Data Science, AI.
become clear. To get this term added in the weight update, we “hijack” the cost function J, and add a term that, when derived, will yield this desired -λ∙w; the term to add is, of course, -0.5 λ∙w². Taking the derivative of J -0.5 λ∙w² will thus yield ∇J-λ∙w, which is what we aimed for. Equation 4