Hello! I’m looking for help with applying skip connection in Seq2Seq model:)
I got each 3 LSTM layers for Encoder(encoder 1, 2 and 3) and Decoder(decoder 1, 2, and 3) like below.

image661×546 6.16 KB

And I want to connect (encoder 1 with decoder 3), (encoder 2 with decoder 2) and (encoder 3 with decoder 1) like C-shape.
Do you have any idea with connecting those LSTM layers?