Deep Learning, Artificial Intelligence, Recurrent Neural Network, Lstm, Gru.
activation ht-1 and the candidate activation ~ht: where an update gate zt decides how much the unit updates its activation, or content. The update gate is computed by: This procedure of taking a linear sum between the existing state and the newly computed state is similar to the LSTM unit. The GRU,