---
license: apache-2.0
library_name: transformers
language:
- en
tags:
- mistral
- merge
- zephyr
- openchat
---
🔥 OpenZephyrChat - Merging Zephyr-beta with OpenChat-3.5 🔥
This Model is a ties merge between Zephyr-beta and OpenChat-3.5, it was done by using the
https://github.com/cg123/mergekit repository
# Model Information
- **License:** Apache-2 (commercially usable)
- **Parameter size:** 7B
- **Merge:**
- [OpenChat](https://huggingface.co/openchat/openchat_3.5) with ```--weight 0.6 --density 0.5```
- [Zephyr](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) with ```--weight 0.3 --density 0.5```
- [Mistral](https://huggingface.co/mistralai/Mistral-7B-v0.1) serving as the base model
## Evals
BENCHMARK |
SCORE |
ARC |
64.85 |
HellaSwag |
85.08 |
MMLU |
64.92 |
TruthfulQA |
48.24 |
Winogrande |
81.06 |
GSM8K |
64.59 |
Source