Large Language Models, Naturallanguageprocessing, Generative Ai Tools, Generative Ai Solution, Artificial Intelligence.
authors observed that the contrastive loss converges quickly when using instruction-input pairs of different tasks (i.e., normal negatives), leading to minor improvement in robustness. To collect hard negatives, authors drew inspiration from near-OOD samples, which are data that come from the same