Machine Learning, Deep Learning, Recurrent Neural Network, Text Generation, Neural Networks.
as if the RNN is used to predict words or characters. A natural way to represent discrete variables is to regard the output o as giving the un-normalized log probabilities of each possible value of the discrete variable. We can then apply the softmax operation as a post-processing step to obtain a