PreCOMET Collection COMET-like models for MT evaluation that predict some scores given only the source segment. https://github.com/zouharvi/subset2evaluate • 8 items • Updated 13 days ago • 2
COMET-early-exit Collection Models introduced in the paper Early-Exit and Instant Confidence Translation Quality Estimation https://github.com/zouharvi/COMET-early-exit • 4 items • Updated 17 days ago • 2
PWESuite: Phonetic Word Embeddings and Tasks They Facilitate Paper • 2304.02541 • Published Apr 5, 2023 • 2
RELIC: Investigating Large Language Model Responses using Self-Consistency Paper • 2311.16842 • Published Nov 28, 2023 • 1
Quality and Quantity of Machine Translation References for Automated Metrics Paper • 2401.01283 • Published Jan 2, 2024 • 1
Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains Paper • 2402.18747 • Published Feb 28, 2024 • 1
How to Select Datapoints for Efficient Human Evaluation of NLG Models? Paper • 2501.18251 • Published Jan 30 • 2
Leveraging Neural Machine Translation for Word Alignment Paper • 2103.17250 • Published Mar 31, 2021 • 1
Early-Exit and Instant Confidence Translation Quality Estimation Paper • 2502.14429 • Published 18 days ago • 3
C4AI Aya Expanse Collection Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. • 4 items • Updated 7 days ago • 37
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters Paper • 2408.03314 • Published Aug 6, 2024 • 57
steiner-preview Collection Reasoning models trained on synthetic data using reinforcement learning. • 3 items • Updated Oct 20, 2024 • 32
In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation Paper • 2408.00397 • Published Aug 1, 2024 • 12
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics Paper • 2209.09593 • Published Sep 20, 2022 • 1
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics Paper • 2406.14553 • Published Jun 20, 2024 • 2
Characterizing Prompt Compression Methods for Long Context Inference Paper • 2407.08892 • Published Jul 11, 2024 • 11
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits Paper • 2402.17764 • Published Feb 27, 2024 • 610