Deep Learning, Artificial Intelligence, Self Supervised Learning, Image Classification, Unsupervised Learning.
with SimCLR, a momentum encoder is used, with doubling the size of the projection head (from 2048 to 4096 for the hidden layer, and from 128 to 256 for the output layer). In comparison with BYOL, the predictor head is removed and the contrastive loss is used instead of the mean squared prediction