Solved by jpeg729 in post #2 
              
              
                They should. 
To answer your first question. When your batches of data are independent short sequences, for example sentences of text, then you should reinitialise the hidden state before each batch. But if your data is made up of really long sequences like stock price data, and you cut it up into …