Dino, Computer Vision, Transformers, Ssl, Deep Learning.
used. Koleo Regularizer for the distance between any point to another point in batch. 518*518 Resolution for better features. Usage of Flash attention to improve memory usage & to speed up self-attention layers. Using the same forward pass for Global and local crops unlike in DinoV1. stochastic