Solved by vdw in post #2 
              
              
                There are a couple of things to unpack: 


Sequences of 10,000 are extremely long. Sure, LSTMs proud themselves to have long-term memory but 10k time steps seems awfully long. I’m not saying that it won’t work, it’s just something too keep in mind. 


Since the range of you sequences varies a lot, h…