erap129:

Pytorch won’t work with half precision weights


What kind of issue are you seeing? The current master and nightly binaries support mixed precision training as described here 47, so you might take a look at it, if you are using a GPU.



 erap129:

plus the performance of the network is identical before and after this transformation.


This is expected, as all operations would still be performed in FP32. FP16 operations, such as matrix multiplications and convolutions, can be accelerated on the GPU using TensorCores. If you just round the values, you wouldn’t get any performance gains.