Here’s the reference I found on bfloat32:

  
      
      Google Cloud Blog
  
  
    

BFloat16: The secret to high performance on Cloud TPUs | Google Cloud Blog 1

How the high performance of Google Cloud TPUs is driven by Brain Floating Point Format, or bfloat16