Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
0.6% with negligible extra parameters (0.02M). Inspired from recent work [5,21], it is also beneficial to inject local information modeling layers in the Feed Forward Network (FFN). The explicit residual-connected local token mixer is removed and the dept-wise 3 × 3 CONV is moved into the FFN, to