AI, Self Supervised Learning, Machine Learning, Data Science, Yann Lecun.
data’s connection to your downstream task. Part of Shwartz-Ziv and LeCun’s work was emphasizing the importance of understanding and explicitly defining these assumptions. However, the ways people make assumptions about how to train their SSL models, and what trade-offs they’re making in doing so,