With detach, you will not backprop on operations that only involve the detached variable. But if an operation involves both your detached variable and a variable requiring grad computations, then you will derivate the operation, taking the detached variable as a constant.