CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery
Paper
•
2406.08587
•
Published
•
16
Papers-Benchmarks
-
-
Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning
Paper • 2406.09170 • Published • 28 -
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Paper • 2407.18901 • Published • 34 -
Benchmarking Agentic Workflow Generation
Paper • 2410.07869 • Published • 27 -
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Paper • 2412.07626 • Published • 22 -
opendatalab/OmniDocBench
Viewer • Updated • 984 • 1.78k • 22 -
4
OmniEval
🥇 -
RUC-NLPIR/OmniEval-AutoGen-Dataset
Updated • 67 • 3 -
m-ric/agents_medium_benchmark_2
Viewer • Updated • 142 • 114 • 10 -
gaia-benchmark/GAIA
Updated • 11.1k • 298 -
GAIA: a benchmark for General AI Assistants
Paper • 2311.12983 • Published • 197 -
m-ric/agents_small_benchmark
Viewer • Updated • 100 • 54 • 10 -
EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents
Paper • 2502.09560 • Published • 36 -
m-a-p/CodeCriticBench
Preview • Updated • 69 • 3 -
MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
Paper • 2503.01935 • Published • 27 -
SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
Paper • 2502.12115 • Published • 45 -
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper • 2502.13595 • Published • 34 -
kyutai/Babillage
Viewer • Updated • 465k • 944 • 9 -
YourBench: Easy Custom Evaluation Sets for Everyone
Paper • 2504.01833 • Published • 20 -
4
Agent Reward Bench Demo
💻Visualize agent interactions with WebArena tasks
-
AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
Paper • 2504.08942 • Published • 27