Machine Learning, Neural Networks, Neurips 2018.
this kind of skip connections between chunks solved vanishing gradients to a greater extent than other existing RNN based solutions like LSTM. Looking closely at the architecture, we can conclude that the input for the next chunk will be in the form of the equation below, This equation looks very