PerceiverIO Attention maps
Hi, I am quite amazed with the usage and the implementation of PerceiverIO so far.
I am trying to visualize the attention maps for an arbitrary image using "PerceiverForImageClassificationConvProcessing".

I want to visualize the attention maps like in  https://arxiv.org/pdf/2103.03206.pdf Figure 3.

I can hook into the layers to get attention vectors of the decoder and most probably I need a pixel-wise multiplication with the query vector to achieve such images. But if there are any other fast paced approach I really like to use it for this purpose.

Thanks
Hi,

You can get the attention scores by passing `output_attentions=True` to the forward method of any model in the Transformers library. See an example of how you can visualize the attention maps of DETR in [this notebook](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/DETR/DETR_minimal_example_(with_DetrFeatureExtractor).ipynb).<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.