1 & 3. So the hidden state is not part of the graph? If it is why is it not detached on the .backward() call?  If it’s not then why is it not?
I thought the cell and hidden state where a result of operations applied to weights plus some non-linearity functions inside each lstm cell, should’t this make it part of the graph? I feel like I am massively confused about this.