As the question is asked, e.g.:
for param in model.parameters():
        param.grad = 3.14

### do some additional compute

loss.backward()

optimizer.step()

Will this add the new grads from backward() on top of the manually set ones of 3.14? Or will it override the manually set ones?