VisualBERT, visual feature projection.
The default implementation takes in 1x197x768 visual features and gives an error while multiplying 197x768 with 2048x768 (or 1021/512 x 768 depending upon the model used).
Do we really need to modify the inner visual projection code for VisualBERT? Feels weird. Can someone help pl?
cc @gchhablani <|||||>@Shiv681991 Can you please share some code examples of what you are trying to do? It'll help me replicate and understand the issue better.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.