I just made a backprop graph from this repo where I suspect a working backpropagation through past hidden states.
Digraph.gv988×2059 101 KB
I’m wondering now what it should look like if past hidden states are successfully back-propagated.