Backpropagation, Mathematics, Calculus, Machine Learning, Neural Networks.
this product is a matrix with size (3, 2), which is exactly the right size for our gradient matrix. Generally, when dealing with multiple training examples, algorithms tend to take the average gradients of all the examples in a batch. Since no matter how many training examples are shown, the