apex would be an approach to use gradient scaling etc. For mixed precision training as @Q_lee suggested.
However, if you would just want to compare the raw floating point formats, I would suggest to run the code on the GPU, since a lot of FP16 operations are not implemented for the CPU in PyTorch.