Machine Learning, Deep Learning, Recurrent Neural Network, Text Generation, Neural Networks.
parallelization because the forward propagation graph is inherently sequential; each time step may be computed only after the previous one. States computed in the forward pass must be stored until they are reused during the backward pass, so the memory cost is also O(τ). The back-propagation