Solved by nielsr in post #2 
              
              
                Hi, 
I do have a demo notebook on using the Trainer for fine-tuning the Vision Transformer here: Transformers-Tutorials/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_🤗_Trainer.ipynb at master · NielsRogge/Transformers-Tutorials · GitHub. 
ViT doesn’t expect input_ids and attention_mask as …