@jekasm
I think the dimension of [# texts, # sequential words, len of 1-hot for each word] is okay, BUT make sure the batch_first argument of the lstm is True just as the documentation suggested .LSTM — PyTorch 1.9.1 documentation