Pinterest, Engineering, Monetization.
that it is stable. Due to both 16-bit types having lower precision, we want to keep as much of our model as possible in float32 so as to not risk prediction quality, but we still want to get good reductions in inference time. We found that most of the largest layers had room for improvement, while