๐ฅ OpenZephyrChat - Merging Zephyr-beta with OpenChat-3.5 ๐ฅ
This Model is a ties merge between Zephyr-beta and OpenChat-3.5, it was done by using the
https://github.com/cg123/mergekit repository
Model Information
- License: Apache-2 (commercially usable)
- Parameter size: 7B
- Merge:
- OpenChat with
--weight 0.6 --density 0.5
- Zephyr with
--weight 0.3 --density 0.5
- Mistral serving as the base model
Evals
BENCHMARK |
SCORE |
ARC |
64.85 |
HellaSwag |
85.08 |
MMLU |
64.92 |
TruthfulQA |
48.24 |
Winogrande |
81.06 |
GSM8K |
64.59 |
Source