text: Title: Is it possible to train a Transformer with Relative Position Self-Attention on TPU?
  Body: ### Description
  Hi there,
  
  Is it possible to train a Transformer with Relative Position Self-Attention on TPU? If so, what would be the recommended TPU hyper-parameters for it on WMT14 (en-de) dataset? How long would the training take?
  
  ### Environment information
  
  Google Cloud TPU
  
  