Solved by karmus89 in post #2 
              
              
                Hi @Olshansky! 
I’ve been tackling a similar problem as you have in this post. I too tried to tackle my problem first by using the nn.Sequential container, but the problem lies in that the nn.LSTM outputs a tuple. 
Let me thus share a mockup solution that utilizes torch.nn.ModuleDict and a custom fo…