Machine Learning, NLP, Computer Vision, Information Retrieval, Transformers.
ones. This paper proposes a very simple solution to this phenomenon which consists in replacing the BCE loss — where all documents are classified as either relevant or non-relevant — by a Contrastive Loss where only 1 positive document is considered at a time and negative documents are sampled