Artificial Intelligence, Technology, Machine Learning, Self Supervised Learning, Research.
generated by the teacher network, the researchers designed a new feature basis learning component for the student network. This comprises a new representation layer added after the embedding layer, which is only used for learning basis functions for the feature representation in unlabelled data.