Regularization, Machine Learning, Convex Optimization, Lagrangian, Ml So Good.
function. now let’s add up this term to our actual objective function, which generally is a MSE or MAE. But P(W) is a lot like step function, as there is sudden penalty/loss as soon as we step out our threshold range. This would result in unhealthy gradient flow. step function like P(W) wrt W