During inference, you use the encoder as normal. For decoder, you pass the input (output of encoder) and then the output of decoder is used as input for next timestamp (and repeat).
So in your seq2seq imagine an arrow going from decoder output at step t to decoder input at step t+1.