No, it’s the same as hidden.detach(). It’s just a way to keep loss.backward() from computing the gradients all the way to the start of your training if that makes sense. I believe the official term for this is truncated back prop through time.