nbeerbower's picture
Update README.md
1de49e0 verified
---
license: other
license_name: llama3
base_model:
- Locutusque/llama-3-neural-chat-v1-8b
- Azure99/blossom-v5-llama3-8b
- Undi95/Llama-3-Unholy-8B
- PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct
- NousResearch/Meta-Llama-3-8B-Instruct
- vicgalle/Configurable-Llama-3-8B-v0.2
library_name: transformers
tags:
- mergekit
- merge
---
![image/png](https://huggingface.co/nbeerbower/bophades-mistral-7B/resolve/main/bophades.png)
# llama-3-bophades-v1-8B
This model is based on Llama-3-8b, and is governed by [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](LICENSE)
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [vicgalle/Configurable-Llama-3-8B-v0.2](https://huggingface.co/vicgalle/Configurable-Llama-3-8B-v0.2) as a base.
### Models Merged
The following models were included in the merge:
* [Locutusque/llama-3-neural-chat-v1-8b](https://huggingface.co/Locutusque/llama-3-neural-chat-v1-8b)
* [Azure99/blossom-v5-llama3-8b](https://huggingface.co/Azure99/blossom-v5-llama3-8b)
* [Undi95/Llama-3-Unholy-8B](https://huggingface.co/Undi95/Llama-3-Unholy-8B)
* [PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct](https://huggingface.co/PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct)
* [NousResearch/Meta-Llama-3-8B-Instruct](https://huggingface.co/NousResearch/Meta-Llama-3-8B-Instruct)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: NousResearch/Meta-Llama-3-8B-Instruct
- model: Locutusque/llama-3-neural-chat-v1-8b
- model: Undi95/Llama-3-Unholy-8B
- model: PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct
- model: Azure99/blossom-v5-llama3-8b
merge_method: model_stock
base_model: vicgalle/Configurable-Llama-3-8B-v0.2
dtype: bfloat16
```