Deep Learning, Artificial Intelligence, Rnn, Recurrent Neural Network, Language Model.
Sequence Model, Language Model At that moment, there was a bottleneck of how to construct a efficient deep RNN when LSTM and GRU those gated networks are not used. Non-linear layers are added to make RNN deeper. This is a paper from Bengio’s research group. Outline Proposed DT-RNN, DOT-RNN, sRNN