Question about fine-tuning with vision transformer (VIT)
Thanks for sharing great work!
I have a simple question about fine-tuning with VIT.
Is there any option for selecting trainable weight during fine-tuning phase? Or can I only train all weight?
Hi,

You can easily disable parameters which you don't want to train with requires_grad=False:

```
from transformers import ViTForImageClassification

model = ViTForImageClassification.from_pretrained("google/vit-base-patch16-224-in21k")

for name, param in model.named_parameters():
   if name == "...":
      param.requires_grad = False
```<|||||>Thank you for your fast and kind response! I will try it!