T5 Training on TPU doesnt use TPU
I am trying to train T5 on TPU .Training started without errors but its very slow . I think its not using TPU backend.
https://colab.research.google.com/drive/10TN0zgPWCIAzbA0PKYIo3fF8wOvfa1P7?usp=sharing
Hi @santhoshkolloju  what is the xla and pytorch version ?<|||||>Pytorch - 1.7.0a0+542ac74
torch_xla - 1.6+30b65e9
The setup file is taken from 
VERSION = "nightly"  #@param ["1.5" , "20200325", "nightly"]
!curl https://raw.githubusercontent.com/pytorch/xla/master/contrib/scripts/env-setup.py -o pytorch-xla-env-setup.py
!python pytorch-xla-env-setup.py --version $VERSION<|||||>@patil-suraj i just realised that i was using the notebook created by you. Thanks for the notebook.
Did anything has changed in the current xla library because of which this is happening? <|||||>Hi @santhoshkolloju , yes there's been some changes to xla, I'm working on the fix, will let you know when I find it.

Also looks like you are trying to do question generation, I am going to release my own experiments by the end of the week. It's pretty exciting.   Here's a relevant thread for QG #4399<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
