Logistic Regression, Stochastic Gradient, Regularization.
This is why the Log loss function is chosen to modify w and b in a way that gets σ(zi) closer to yi. This post will cover the math behind minimizing the log loss by modifying w & b, and perform Stochastic Gradient Descent (SGD) on a toy dataset from scratch. Computing the gradients Before moving