Wow thanks while I had made this observation before I didn’t think to try to debug them in isolation and while trying to work with one keras and one pytorch model with only 1 LSTM unit, I noticed that I had erroneously passed the number of timesteps as the input space size for the torch LSTM without realizing that it is intended to be the feature dimension.
Definitely know what to fix here, I think a reshape of swapping dimensions and initializing the LSTM correctly should do the trick, I will let you know if that works for me.
Thanks for the insight!