unsloth

/

LFM2-1.2B-GGUF

like 11

Follow

Unsloth AI 7.66k

logs

+--------------+-----------+-----------------+------------------+-------+---------+---------+
| Model        | Dataset   | Metric          | Subset           |   Num |   Score | Cat.0   |
+==============+===========+=================+==================+=======+=========+=========+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | computer science |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | math             |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | chemistry        |    10 |  0.2    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | engineering      |    10 |  0.2    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | law              |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | biology          |    10 |  0.3    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | health           |    10 |  0.5    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | physics          |    10 |  0      | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | business         |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | philosophy       |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | economics        |    10 |  0      | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | other            |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | psychology       |    10 |  0.1    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | history          |    10 |  0.4    | default |
+--------------+-----------+-----------------+------------------+-------+---------+---------+
| LFM2_1B_8bit | mmlu_pro  | AverageAccuracy | OVERALL          |   140 |  0.1643 | -       |
+--------------+-----------+-----------------+------------------+-------+---------+---------+