Dino, Computer Vision, Transformers, Ssl, Deep Learning.
learnings. Randomly applying Mask to the input patches to the student, but not to the teacher & CELoss here again, is used for Patch Level learnings. Patch level and Image level learnings are for Global and local understanding of image features. Few key points: Sinkhorn-knop batch normalization is