Artificial Intelligence, Neural Networks, Calculus, Gradient Descent, Math.
and a ReLU activation. Our loss function is the commonly used Mean Squared Error (MSE). Knowing our network and our loss function, how can we tweak the weights and biases to minimize the loss? In Part 1, we learned that we have to find the slope to our loss (or cost) function in order to minimize