content.raw: 🔍 Today's pick in Interpretability & Analysis of LMs: Enhanced Hallucination Detection in Neural Machine Translation through Simple Detector Aggregation by A. Himmi G. Staerman M. Picot 
content.type: text
content.value: 🔍 Today's pick in Interpretability & Analysis of LMs: Enhanced Hallucination Detection in Neural Machine Translation through Simple Detector Aggregation by A. Himmi G. Staerman M. Picot 
content.raw: @Colombo
content.type: mention
content.user: Colombo
content.type: text
content.raw: @nunonmg
content.type: mention
content.user: nunonmg
content.type: text
content.type: new_line
content.type: new_line
content.raw: Previous work on hallucination detection for MT showed that different detectors excel at detecting different types of hallucinations.
content.type: text
content.value: Previous work on hallucination detection for MT showed that different detectors excel at detecting different types of hallucinations.
content.type: new_line
content.type: new_line
content.raw: In this context, detectors based solely on model internals such as input contributions or sequence log-probabilities fare well on fully-detached hallucinations but show limited performances on oscillatory hallucinations, where ad-hoc trained detectors are still the best-performing methods.
content.type: text
content.value: In this context, detectors based solely on model internals such as input contributions or sequence log-probabilities fare well on fully-detached hallucinations but show limited performances on oscillatory hallucinations, where ad-hoc trained detectors are still the best-performing methods.
content.type: new_line
content.type: new_line
content.raw: This work proposes Simple Detectors Aggregation (STARE), an aggregation procedure to leverage detectors’ complementary strengths. Authors experiment with two popular hallucination detection benchmarks (LFAN-HALL and HalOmi), showing that STARE outperforms single detectors and other aggregation baselines.
content.type: text
content.value: This work proposes Simple Detectors Aggregation (STARE), an aggregation procedure to leverage detectors’ complementary strengths. Authors experiment with two popular hallucination detection benchmarks (LFAN-HALL and HalOmi), showing that STARE outperforms single detectors and other aggregation baselines.
content.type: new_line
content.type: new_line
content.raw: Results obtained aggregating internal detectors highlight how model-based features that are readily available as generation byproducts can outperform computationally expensive ad-hoc solutions.
content.type: text
content.value: Results obtained aggregating internal detectors highlight how model-based features that are readily available as generation byproducts can outperform computationally expensive ad-hoc solutions.
content.type: new_line
content.type: new_line
content.raw: 📄 Paper: 
content.type: text
content.value: 📄 Paper: 
content.label: Enhanced Hallucination Detection in Neural Machine Translation through
    Simple Detector Aggregation (2402.13331)
content.raw: https://huggingface.co/papers/2402.13331
content.id: 2402.13331
content.type: paper
content.type: resource
content.url: https://huggingface.co/papers/2402.13331
content.type: new_line
content.type: new_line
content.raw: 🔍 All daily picks in LM interpretability: 
content.type: text
content.value: 🔍 All daily picks in LM interpretability: 
content.href: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-of-lms-65ae3339949c5675d25de2f9
content.raw: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-of-lms-65ae3339949c5675d25de2f9
content.type: link
rawContent: 🔍 Today's pick in Interpretability & Analysis of LMs: Enhanced Hallucination Detection in Neural Machine Translation through Simple Detector Aggregation by A. Himmi G. Staerman M. Picot @Colombo @nunonmg 
  
  Previous work on hallucination detection for MT showed that different detectors excel at detecting different types of hallucinations.
  
  In this context, detectors based solely on model internals such as input contributions or sequence log-probabilities fare well on fully-detached hallucinations but show limited performances on oscillatory hallucinations, where ad-hoc trained detectors are still the best-performing methods.
  
  This work proposes Simple Detectors Aggregation (STARE), an aggregation procedure to leverage detectors’ complementary strengths. Authors experiment with two popular hallucination detection benchmarks (LFAN-HALL and HalOmi), showing that STARE outperforms single detectors and other aggregation baselines.
  
  Results obtained aggregating internal detectors highlight how model-based features that are readily available as generation byproducts can outperform computationally expensive ad-hoc solutions.
  
  📄 Paper: https://huggingface.co/papers/2402.13331
  
  🔍 All daily picks in LM interpretability: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-of-lms-65ae3339949c5675d25de2f9
reactions.reaction: ❤️
reactions.users: samusenps lunarflu osanseviero Kukedlc nunonmg Alexandro14