Pinterest, Engineering, Monetization.
results, we selected bfloat16 for the large layers of our model. Lastly, there was the benchmarking. In offline testing, we found a 30% reduction in model inference time, with the same prediction accuracy. This inference time reduction translated well into production, and we obtained a significant