Deep Learning, Pytorch, Fine Tuning, Computer Vision, Transfer Learning.
a loss of numerical precision and can impact the model’s accuracy or convergence. FP16 uses 16 bits to represent a number. FP16 and FP32 are referred as Single Precision and both comes with it’s own set of pros and cons as we saw in above pointers. To leverage advantages of both we have Mixed