Llm, Machine Learning, Fine Tuning.
can leak into the training data, effectively giving away the answers to the test before the test begins. As GPT-3.5 is potentially trained on HumanEval and other benchmarks, the research team tried three methods to avoid data contamination — N-gram overlap and embedding and syntax-based similarity.