Wondering if anyone has tested the distillation code for Seq2Seq models 2 on a TPU?
Just want to know if there has been a positive/negative experience on this.
@sshleifer you probably know more about this.
Thanks!