Machine Learning, Optimization, Gradient Descent, Deep Learning, Learning Parameters.
possible to reach our goal of minimizing the loss function. Let us mathematically define this. But how do we find the most ‘desirable’ change in θ? What is the right Δθ to use? The answer comes from the Taylor Series. This means the direction u or Δθ that we intend to move in should be at