As explained in the docs 5, an nn.LSTM expects input, (hidden, cell) as the input. Since you are neither passing the hidden and cell state in the first layer nor using the output states, these should be initialized to zero tensors.
Do you know, how Keras handles this use case?