Solved by vdw in post #4 
              
              
                As far as I can tell – I only had a very quick look at the paper – the LSTM is used as a decoder similar to Seq2Seq models. 
The figure indicates that the output of FC is used as the first initial state which has a shape of (num_layers * num_directions, batch, hidden_size). Given that it’s used as a…