|
--- |
|
library_name: transformers |
|
license: other |
|
datasets: |
|
- athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED |
|
- ResplendentAI/Synthetic_Soul_1k |
|
language: |
|
- en |
|
tags: |
|
- gguf |
|
- quantization |
|
- roleplay |
|
- imatrix |
|
- mistral |
|
--- |
|
|
|
This repository hosts GGUF-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B). |
|
|
|
```python |
|
quantization_options = [ |
|
"Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K", |
|
"Q8_0", "IQ4_XS", "IQ3_XXS" |
|
] |
|
``` |
|
|
|
**This is experimental.** |
|
|
|
For imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt). |
|
|
|
The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios. |
|
|
|
**Original model information:** |
|
|
|
# Eris Floramix DPO |
|
|
|
This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset. |
|
|
|
Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED |
