Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Transformers.
the supernet is trained with Gumbel Softmax sampling [72] to get the importance score for the blocks within each MP: where α evaluates the importance of each block in MP as it represents the probability to select a block. ε∼U(0, 1) ensures exploration. n ∈ {4D, I} for S1 and S2, and n ∈ {4D, 3D, I}