Yes, my code works fine without AMP.
I compute grads:
grads = torch.autograd.grad(loss, model.parameters())

Then update my model’s parameters:
for param in model.parameters():  
    param.data = ....  # (these params come from grads after some operation)