Solved by SimonW in post #4 
              
              
                I see. Not with the provided nn.[GRU|RNN|LSTM](Cell) classes. But certainly doable if you write your own variant. A good reference is probably the Cell classes’ implementation. e.g. 
Class: https://github.com/pytorch/pytorch/blob/27d7182d6c7e223e04166f33d5ec46ef8b510944/torch/nn/modules/rnn.py#L599 
…