Pinterest, Engineering, Monetization.
more to serve. While there are many opportunities for optimization, one of the most notable ones is mixed precision inference. The GPUs we use for serving have tensor cores. Tensor cores are specialized in one thing: fused matrix multiply and add, but only with certain data types. Our current