Have you tried increasing the number of units in your LTSM layer? I’m not sure how long the sequences are in this dataset but 8 seems like a low amount of units to ‘remember’ anything about the previous sequence step.