I’m also very confused by this init_hidden method.  I am trying to implement something similar so I can set the hidden state of a sequence model.  A lot of the discussion here as well as the code for init_hidden uses the words ‘parameters’ and ‘weights’.  The hidden states of an RNN are not parameters or weights.  Can someone clear up the terminology and then confirm what init_hidden does?  Shouldn’t the hidden state of an RNN be a buffer 2, not a parameter?