Llm, Model Selection, Model Evaluation, Genai.
purpose tasks(no domain specific evaluation) use open source benchmarks. There could be differences among different implementations of a benchmark by different frameworks. For example, Hugging face found that the implementation of MMLU is different among HELM, EleutherAI and original