Deep Learning, Artificial Intelligence, Image Classification, Fourier Transform, Fft.
with gradually downsampled tokens. For Transformer-style models, a 12-layer model (GFNet-XS) is begun with a similar architecture with DeiT-S and ResMLP-12. Then, 3 variants of the model (GFNet-Ti, GFNet-S and GFNet-B) are obtained by simply adjusting the depth and embedding dimension, which have