ok, so i guess my assumption is correct and initializing the hidden layer for each batch will cause the network to become stateless.
so to have the network statful, i either need to order the batches appropriately or “get rid” of batches (eg batch size 1). if somebody has an alternative solution, i would much appreciate it
here a some informative resources i found on this topic:
https://machinelearningmastery.com/stateful-stateless-lstm-time-series-forecasting-python/ 1

  
      
      Coursera
  
  
    

Stateful vs. Stateless LSTMs - DeepLearning Applications | Coursera 3

Learn online and earn valuable credentials from top universities like Yale, Michigan, Stanford, and leading companies like Google and IBM. Join Coursera for free and transform your career with degrees, certificates, Specializations, & MOOCs in...


  
  
    
    
  
  


https://www.quora.com/Im-having-a-hard-time-conceptualizing-the-difference-between-stateful-and-stateless-LSTMs-in-Keras-What-does-one-choose-stateful-vs-stateless 1