Solved by ptrblck in post #2 
              
              
                You can manually unscale the gradients as shown in the Gradient penalty section of the amp examples: 
inv_scale = 1./scaler.get_scale()
grad_params = [p * inv_scale for p in scaled_grad_params]