Hi there! I made some demos on how to fine-tune ViT on a custom dataset here:

  
      

      github.com
  

  
    Transformers-Tutorials/VisionTransformer at master ·... 10

  master/VisionTransformer

  This repository contains demos I made with the Transformers library by HuggingFace. - Transformers-Tutorials/VisionTransformer at master · NielsRogge/Transformers-Tutorials