If you get valid gradient values for all parameters, then the computation graph is at least not detached.
Note however, that the gradients seem to be quite large. I’m not familiar with your exact use case, but maybe try to scale the loss down a bit so that the gradient magnitudes will also be reduced.