Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Small Data.
ImageNet-1K. DHVT-S: 12 encoder layers, embedding dimension of 384, MLP ratios of 4, attention heads of 8 on CIFAR-100, 6 on DomainNet and ImageNet-1K. The main focus is training from scratch on small datasets. 2. Results 2.1. DomainNet & ImageNet-1K DomainNet & ImageNet-1K On DomainNet, DHVT shows