Can we support the trace of ViT and Swin-Transformer based on torch.fx?
# 🚀 Feature request

Can we support the trace of ViT and Swin-Transformer based on torch.fx()? If not, what's the difficulty for that?

## Motivation

ViT and Swin-Transformation is widely used in CV scenarios. Hope we could support the trace of torch.fx, so we can do the quantization based on the work.

## Your contribution

I'm not sure right now. Currently I wanda whether we could support the ViT and Swin-Transformer. If not, the reason. 

@michaelbenayoun   May I know the current situation or your schedule first? Thanks.<|||||>Hi, 
The plan is to work on a nicer solution for tracing the model as soon as possible.
I will take a look to add those models in the mean time as they might not be hard to add in the current setting.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.