I am using expand() to duplicate the latent space vector so that the decoder RNN gets the latent space as an input at every time step.
It seems to me like giving the RNN the latent space and previous timestep’s output at every step provides more info for it to make better predictions. However, I also haven’t done head on comparisons.