Deep Learning, Artificial Intelligence, Recurrent Neural Network, Lstm, Gru.
LSTM: When off (rt close to 0), the reset gate effectively makes the unit act as if it is reading the first symbol of an input sequence, allowing it to forget the previously computed state. 3.2. Update Gate The activation ht of the GRU at time t is a linear interpolation between the previous