16

Contrastive Loss
InfoNCE [Oord et al., 2018]
MINE [Belghazi et al., 2018]
Triplet [Schroﬀ et al., 2015]
Soft Triplet [Tian et al., 2020b]
N+1 Tuplet [Sohn, 2016]
Lifted Structured [Oh Song et al., 2016]
Modiﬁed Triplet Eqn. 10 [Coria et al., 2020] x
Triplet Contrastive Eqn. 2 [Ji et al., 2021] linear

φ(x)
ψ(x)
τ log((cid:15) + x) ex/τ
ex
log(x)
x
[x + (cid:15)]+
τ log(1 + x) ex/τ +(cid:15)
log(1 + x)
[log(x)]2
+

ex
ex+(cid:15)
sigmoid(cx)
linear
A Cookbook of Self-Supervised Learning