Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
an image, a simple heuristic way for fusion is to combine them based on their spatial location. However, the two branches process patches of different sizes, thus having different number of patch tokens. This method first performs an interpolation to align the spatial size, and then fuse. On the