Oh yeah, that’s because you use the run_glue.py which requires hyperparameter to be run, like the task.
Those are documented here. transformers/examples/pytorch/text-classification at master · huggingface/transformers · GitHub 3. You can also check the script directly to find the task mapping. transformers/examples/pytorch/text-classification at master · huggingface/transformers · GitHub 3