If you want to work with unscaled gradients, you could follow the AMP - Working with unscaled gradients tutorial 2, which explains how to unscale the gradients before using them in e.g. gradient clipping.