Deep Learning, Artificial Intelligence, Recurrent Neural Network, Lstm, Gru.
there are only 2 gates, which are called reset gate and update gate. 3.1. Reset Gate The candidate activation~ht is computed similarly to that of the traditional recurrent unit: where rt is a set of reset gates and ⊙ is an element-wise multiplication. The reset gate is similar to the forget gate in