Solved by googlebot in post #4 
              
              
                You’d create data windows for sampling purposes, but Conv & RNN inputs have no “window” dimension - it is just “time”. 
With your toy problem, different batching/sampling schemes would work, but general approach would be: 

sample batch_size sequences of length t
use input shape [batch, channels_in=…