Machine Learning, Deep Learning, Recurrent Neural Network, Text Generation, Neural Networks.
events. Whereas the exploding gradient can be fixed with gradient clipping technique as is used in the example code here, the vanishing gradient issue is still is major concern with an RNN. This vanishing gradient limitation was overcome by various networks such as long short-term memory (LSTM),