Machine Learning, Deep Learning, Recurrent Neural Network, Text Generation, Neural Networks.
There is a small mathematical trick applied refer here for details. So our softmax looks like: Step 3: Compute Loss Since we are implementing a text generation model, the next character can be any of the unique characters in our vocabulary. So our loss will be cross-entropy loss. In multi-class