One thing you could do is to duplicate your series 24 times. The first copy would skip one hour at the beginning, the second copy would skip 2 hours, etc. Then you could combine these series in parallel to make a tensor of shape (seq_len, 24, n_features).
That gives you two benefits.

batching allows more efficient computation
you get to train it on all possible 24 hour windows at once.

I would still suggest increasing your window length.
If you don’t mind I’d be interested in seeing your code.