File size: 1,397 Bytes
db68c0a 7f88334 db68c0a e2ef386 7f88334 db68c0a e2ef386 4c54bc8 db68c0a e2ef386 db68c0a d5898d8 db68c0a d5898d8 db68c0a e2ef386 ce98d83 e2ef386 ce98d83 e2ef386 db68c0a e2ef386 db68c0a e2ef386 db68c0a e2ef386 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
---
library_name: transformers
license: other
datasets:
- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
- ResplendentAI/Synthetic_Soul_1k
language:
- en
tags:
- gguf
- quantized
- roleplay
- imatrix
- mistral
inference: false
---
This repository hosts GGUF-Imatrix quantizations for [ChaoticNeutrals/Eris_Floramix_DPO_7B](https://huggingface.co/ChaoticNeutrals/Eris_Floramix_DPO_7B).
```
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
```
```python
quantization_options = [
"Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K",
"Q8_0", "IQ4_XS", "IQ3_XXS"
]
```
**This is experimental.**
For imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt).
The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.
**Image:**
**Original model information:**
# Eris Floramix DPO
This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.
Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
|