Machine Learning, NLP, Computer Vision, Information Retrieval, Transformers.
automatic benchmarks such as the GLUEbenchmark. Existing human-in-the-loop evaluation frameworks such as HYPE⁵, ChatEval⁶ or HUME⁷ focus on only one task each, so it’ll be interesting to see how much traction GENIE gets in the community as a more general purpose benchmark. 🔗 Where to find it: You