Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
of w and b that makes function L(w, b) output its minimum value. Now, what does it mean to train a network? Suppose we train the toy network with (x, y) = (0.5, 0.2) and (2.5, 0.9), at the end of the training, we expect to find w* and b* such that f(0.5) outputs 0.2 and f(2.5) outputs 0.9. We hope