Artificial Intelligence, Technology, Machine Learning, Self Supervised Learning, Research.
teacher model. Once the teacher model was pretrained and fine-tuned, they used it to generate pseudo labels for unlabelled data. They then trained a student model on both labels and pseudo labels to generate final feature embeddings. An overview of SLADE To deal with the noisy pseudo labels