Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
Transformer models run as fast as MobileNet and maintain a similar size? The design choices of ViTs are revisited and an improved supernet with low latency and high parameter efficiency is proposed. A fine-grained joint search strategy is introduced that can find efficient architectures by