I think it would use “conventional” SM hardware to do fp16 computation, meaning that there wouldn’t be extreme speedups expected over fp32, but also no strange rounding behavior (e.g., from reduced precision accumulations).
There are likely litmus tests you can construct from this e.g., create/train an fp32 model on one setup, create a mixed-precision copy on both setups, and see which one is closer to the “ground-truth” in output.