Deep Learning, Machine Learning, Self Supervised Learning, Aritificial Intelligence, Neural Networks.
to contrastive learning but here we are comparing the codes instead of the features directly. If we expand one of the terms on the right-hand side, it looks like this: Here the softmax operation is applied on the dot product of z and C. The term Τ is the temperature parameter. Taking this loss over