I agree that the error message could be improved, but I think it is important to have a well defined, strict sequential wrapper. One can always create a custom module (be it LSTM or anything else) with the desired specifications, and add it to nn.Sequential.