Quazim0t0
/

mosaic-14b-sce

Model card Files Files and versions

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	40.50
IFEval (0-Shot)	68.76
BBH (3-Shot)	55.69
MATH Lvl 5 (4-Shot)	38.29
GPQA (0-shot)	14.99
MuSR (0-shot)	16.44
MMLU-PRO (5-shot)	48.85

Downloads last month: 0

Safetensors

Model size

14.7B params

Tensor type

BF16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Quazim0t0/mosaic-14b-sce

Merges

1 model

Space using Quazim0t0/mosaic-14b-sce 1

Evaluation results

strict accuracy on IFEval (0-Shot)
Open LLM Leaderboard

68.760
normalized accuracy on BBH (3-Shot)
Open LLM Leaderboard

55.690
exact match on MATH Lvl 5 (4-Shot)
Open LLM Leaderboard

38.290
acc_norm on GPQA (0-shot)
Open LLM Leaderboard

14.990
acc_norm on MuSR (0-shot)
Open LLM Leaderboard

16.440
accuracy on MMLU-PRO (5-shot)
test set Open LLM Leaderboard

48.850

View on Papers With Code