within the training image using saliency maps and then cuts and pastes these objects
onto background and optimizes a similar objective [Zhao et al., 2021]. Instead of using
augmentations to move objects around, Purushwalkam and Gupta [2020] notes that
nearby video frames contain the same object but in diﬀerent positions or from diﬀerent
viewpoints so that contrastive learning on video data can serve much the same purpose.
Recently, UP-DETR [Dai et al., 2021] and DETReg [Bar et al., 2022] proposed an end-
to-end SSL pretraining of the DETR family detectors. UP-DETR proposes to detect the
bounding boxes of randomly selected patch regions in images conditioned on their pixel
A Cookbook of Self-Supervised Learning