region:us
---
{}
---
hf (pretrained=johnsnowlabs/BioLing-7B-Dare), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 8
|             Tasks             |Version|Filter|n-shot| Metric |Value |   |Stderr|
|-------------------------------|-------|------|-----:|--------|-----:|---|-----:|
|stem                           |N/A    |none  |     0|acc     |0.5164|±  |0.0059|
|                               |       |none  |     0|acc_norm|0.4705|±  |0.0068|
| - medmcqa                     |Yaml   |none  |     0|acc     |0.4633|±  |0.0077|
|                               |       |none  |     0|acc_norm|0.4633|±  |0.0077|
| - medqa_4options              |Yaml   |none  |     0|acc     |0.4941|±  |0.0140|
|                               |       |none  |     0|acc_norm|0.4941|±  |0.0140|
| - anatomy (mmlu)              |      0|none  |     0|acc     |0.5556|±  |0.0429|
| - clinical_knowledge (mmlu)   |      0|none  |     0|acc     |0.6755|±  |0.0288|
| - college_biology (mmlu)      |      0|none  |     0|acc     |0.6319|±  |0.0403|
| - college_medicine (mmlu)     |      0|none  |     0|acc     |0.5896|±  |0.0375|
| - medical_genetics (mmlu)     |      0|none  |     0|acc     |0.6900|±  |0.0465|
| - professional_medicine (mmlu)|      0|none  |     0|acc     |0.6654|±  |0.0287|
| - pubmedqa                    |      1|none  |     0|acc     |0.7480|±  |0.0194|

|Groups|Version|Filter|n-shot| Metric |Value |   |Stderr|
|------|-------|------|-----:|--------|-----:|---|-----:|
|stem  |N/A    |none  |     0|acc     |0.5164|±  |0.0059|
|      |       |none  |     0|acc_norm|0.4705|±  |0.0068|