There is no sampling in RNN’s forward pass. So teacher forcing should just work if I understand it correctly.


Since it’s already outputting a sequence, why do you need to iterate on it to get a sequence? In case of directly feeding <GO>, it seems that you are not giving it any input, so I’d expect it to fail.


You’d have to use RNN cells or input sequences of length 1. But why would that be useful to you in this case?