Translation finetuning error : TypeError: '>' not supported between instances of 'function' and 'int'
Dear huggingface team, 
I'd like to train from scratch T5 on wmt19 (de-en), and I see these instructions in your page:
- you provided the script for  finetune mbart_cc25, could I just change the model path and it works out of the box for training T5 on a translation task? any changes needed?
- when you use sortish sampler (line 256 finetune.py) you check the number of gpus, in case using tpus, shall I check the number of cores of tpus for distributed version of dataloader in line 256? 
- does distributed tpu training works for seq2seq model? I wonder why the dataloader is not modified for tpu cores, is this by purpose and works fine for tpus too? 
- I also gets these errors running the provided script, thank you for your help.
Best
Rabeeh

```
(test) rabeeh@brain1:~/ruse/hf/transformers/examples/seq2seq$ ./train_mbart_cc25_enro.sh --output_dir enro_finetune_baseline --label_smoothing 0.1 --fp16_opt_level=O1 --logger_name wandb --sortish_sampler
2020-11-04 01:41:53.720772: W tensorflow/stream_executor/platform/default/dso_loader.cc:59] Could not load dynamic library 'libcudart.so.10.1'; dlerror: libcudart.so.10.1: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/local/cuda/lib64:/usr/local/nccl2/lib:/usr/local/cuda/extras/CUPTI/lib64
2020-11-04 01:41:53.720823: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
  File "finetune.py", line 442, in <module>
    main(args)
  File "finetune.py", line 383, in main
    model: SummarizationModule = TranslationModule(args)
  File "finetune.py", line 367, in __init__
    super().__init__(hparams, **kwargs)
  File "finetune.py", line 57, in __init__
    if hparams.sortish_sampler and hparams.gpus > 1:
TypeError: '>' not supported between instances of 'function' and 'int'

```
The issue solved with setting --gpus 1 explicitly. thanks. 