Codabench: Flexible, easy-to-use, and reproducible meta-benchmark platform.Obtaining a standardized benchmark of computational methods is a major issue in data-science communities.  Here, we introduce Codabench, a meta-benchmark platform that is open sourced and community driven for benchmarking algorithms or software agents versus datasets or tasks.  A public instance of Codabench is open to everyone free of charge and allows benchmark organizers to fairly compare submissions under the same setting (software, hardware, data, algorithms), with custom protocols and data formats.  Codabench has unique features facilitating easy organization of flexible and reproducible benchmarks, such as the possibility of reusing templates of benchmarks and supplying compute resources on demand.  Codabench has been used internally and externally on various applications, receiving more than 130 users and 2,500 submissions. 
Codabench
Codabench: Flexible, easy-to-use, and reproducible meta-benchmark platform.Obtaining a standardized benchmark of computational methods is a major issue in data-science communities.  Here, we introduce Codabench, a meta-benchmark platform that is open sourced and community driven for benchmarking algorithms or software agents versus datasets or tasks.  A public instance of Codabench is open to everyone free of charge and allows benchmark organizers to fairly compare submissions under the same setting (software, hardware, data, algorithms), with custom protocols and data formats.  Codabench has unique features facilitating easy organization of flexible and reproducible benchmarks, such as the possibility of reusing templates of benchmarks and supplying compute resources on demand.  Codabench has been used internally and externally on various applications, receiving more than 130 users and 2,500 submissions. 
Codabench
Codabench: Flexible, easy-to-use, and reproducible meta-benchmark platform.Obtaining a standardized benchmark of computational methods is a major issue in data-science communities.  Here, we introduce Codabench, a meta-benchmark platform that is open sourced and community driven for benchmarking algorithms or software agents versus datasets or tasks.  A public instance of Codabench is open to everyone free of charge and allows benchmark organizers to fairly compare submissions under the same setting (software, hardware, data, algorithms), with custom protocols and data formats.  Codabench has unique features facilitating easy organization of flexible and reproducible benchmarks, such as the possibility of reusing templates of benchmarks and supplying compute resources on demand.  Codabench has been used internally and externally on various applications, receiving more than 130 users and 2,500 submissions. 
Codabench