In the default setup nn.LSTM expects an input in the shape [L, N, H_in] as described in the docs.
Based on your description you are feeding inputs as [3, H*W, T]. Would this correspond to [N=batch_size, H_in, L]? If so, you would be mixing the dimensions and might want to check the inputs again.