Solved by ptrblck in post #4 
              
              
                Yes, the next section of the tutorials shows how to unscale gradients manually using inv_scale = 1./scaler.get_scale(), which you could also use in your hooks.