Machine Learning, Neural Networks, NLP, Deep Learning.
“gates” (for example, input gate, forget gate, output gate) that control information flow drawing on the logistic function. In Long Short-Term Memory Recurrent Neural Network Architectures for Large Scale Acoustic Modeling, Hasim Sak, Andrew Senior, and Françoise Beaufays showed that the deep LSTM