Deep Learning, Artificial Intelligence, Vlm, Clip, Visual Language.
benefit from larger data and samples seen scale. The strongest ImageNet accuracy (78%) is obtained with the largest total pre-training compute, using ViT-H/14 pre-trained on LAION-2B data scale and 34B samples seen. Fitting power-law (E=βC^α) on the Pareto frontier of the available models, we