A Cookbook of Self-Supervised Learning
Nice. It looks like it will be useful... although best practices are likely going to continue to evolve. The biggest question in my mind is whether we can come up, at some point in the future, with a kind of universal self-supervised learning objective that works well in practice for any task.