vdw:

Push current input through LSTM: (seq_len=1, batch_size, input_size=1)


Is this comment correct? Because how I saw it, the input size is actually the thing we defined as the hidden size. So the number of input features of the decoder is equal to the number of features the decoder gives the one time step output.