Introducing: Zephyr Gemma!
text
Introducing: Zephyr Gemma!
new_line
new_line
The community has struggled to do a good preference-tune of Gemma, so the amazing 
text
The community has struggled to do a good preference-tune of Gemma, so the amazing 
@lewtun
mention
lewtun
 and 
text
 and 
@philschmid
mention
philschmid
 built an open-source recipe and trained a model to help people get started. 
text
 built an open-source recipe and trained a model to help people get started. 
new_line
new_line
Handbook: 
text
Handbook: 
https://github.com/huggingface/alignment-handbook/blob/main/recipes/zephyr-7b-gemma/README.md
https://github.com/huggingface/alignment-handbook/blob/main/recipes/zephyr-7b-gemma/README.md
link
new_line
Model: 
text
Model: 
https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1
HuggingFaceH4/zephyr-7b-gemma-v0.1
model
resource
https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1
new_line
Demo: 
text
Demo: 
https://huggingface.co/spaces/HuggingFaceH4/zephyr-7b-gemma-chat
HuggingFaceH4/zephyr-7b-gemma-chat
space
resource
https://huggingface.co/spaces/HuggingFaceH4/zephyr-7b-gemma-chat
new_line
new_line
Some interesting details
text
Some interesting details
new_line
- Fine-tuned on DEITA and DPOed with Argilla DPO dataset
text
- Fine-tuned on DEITA and DPOed with Argilla DPO dataset
new_line
- Very strong MT Bench results (7.81), better than Zephyr Beta (mistral based) and Gemma Instruct
text
- Very strong MT Bench results (7.81), better than Zephyr Beta (mistral based) and Gemma Instruct
new_line
- Can run locally with tools such as llama.cpp on a Mac
text
- Can run locally with tools such as llama.cpp on a Mac
new_line
- Not so good AGIEval results compared to mistral-based tunes
text
- Not so good AGIEval results compared to mistral-based tunes
new_line
- All training code is open-sourced
text
- All training code is open-sourced
new_line
- Trained for 105 minutes on 8x H100
text
- Trained for 105 minutes on 8x H100
new_line
- No system message
text
- No system message
new_line
new_line
Big kudos to the team! Super exciting to see a good fine-tune for Gemma
text
Big kudos to the team! Super exciting to see a good fine-tune for Gemma
Introducing: Zephyr Gemma!

The community has struggled to do a good preference-tune of Gemma, so the amazing @lewtun and @philschmid built an open-source recipe and trained a model to help people get started. 

Handbook: https://github.com/huggingface/alignment-handbook/blob/main/recipes/zephyr-7b-gemma/README.md
Model: https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1
Demo: https://huggingface.co/spaces/HuggingFaceH4/zephyr-7b-gemma-chat

Some interesting details
- Fine-tuned on DEITA and DPOed with Argilla DPO dataset
- Very strong MT Bench results (7.81), better than Zephyr Beta (mistral based) and Gemma Instruct
- Can run locally with tools such as llama.cpp on a Mac
- Not so good AGIEval results compared to mistral-based tunes
- All training code is open-sourced
- Trained for 105 minutes on 8x H100
- No system message

Big kudos to the team! Super exciting to see a good fine-tune for Gemma
🤗
yjernite vladbogo clem samusenps dkyazze taufiqdp pdina
❤️
clem samusenps ajibawa-2023 giux78
🤝
clem
64aea8ff67511bd3d965697b
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user