Deep Learning, Artificial Intelligence, Self Supervised Learning, Clustering, Contrastive Learning.
exponential matrix: where u and v are renormalization vectors with the size of K and B respectively. In practice, when working with small batches, features from the previous batches are used to augment the size of Z, around 3K features are stored. Only features from the last 15 batches are kept