Because of pytorch’s dynamic graph, you don’t need TimeDistributedDense like in Keras. You can just use Linear. LSTM networks become very straight forward. See the tutorial for pos tagging with LSTM: http://pytorch.org/tutorials/beginner/nlp/sequence_models_tutorial.html#example-an-lstm-for-part-of-speech-tagging 38