I am trying to train the model in float32 and inference in float16. I think my code is working fine. I wanted to know if anyone else has done this to reduce the size of the model and is there any change in accuracy while decreasing the precision? I know that this helps to increase the speed a little but I am worried about the performance.