Machine Learning, Neural Networks, Statistics, Data Science, AI.
: L² regularization from a weight decay perspective Plaut et al already point themselves to this relation to the L² norm in the aforementioned paper: “One way to view the term h∙w is as the derivative of 0.5 h∙w² , so we can view the learning procedure as a compromise between minimizing E (the