I get it~ your explanation is so clear, thank you.
If I update x with loss.backward() but without zero_grad(),  because I don’t use an optimizer. In this way, whether the grad of x will be restored and added all along？