Machine Learning, Deep Learning, Recurrent Neural Network, Text Generation, Neural Networks.
Computing Gradients Given our loss function L, we need to calculate the gradients for our three weight matrices U, V, W, and bias terms b, c and update them with a learning rate α. Similar to normal back-propagation, the gradient gives us a sense of how the loss is changing with respect to each