Hi,
So you want the gru2_opt to use the gradient for both use of gru2?
In that case, you will have to delay the gru1_opt,step() I’m afraid. Or recompute the forward after the gru1 net has been updated if that’s what you want.