From the NVIDIA post 1:

Benefits of Mixed precision training

Speeds up math-intensive operations, such as linear and convolution layers, by using Tensor Cores. 1

Speeds up memory-limited operations by accessing half the bytes compared to single-precision.
Reduces memory requirements for training models, enabling larger models or larger minibatches.