nn.Sequential is not meant for building a model that operates on time sequences; nn.LSTM will do that out of the box. nn.Sequential is for stringing together several layers that don’t use time sequences into one model that runs the layers one after another.