Hugging Face's logo

Lewdiculous
/
Eris_Floramix_DPO_7B-GGUF-Imatrix

Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Model card Files Community
1
Eris_Floramix_DPO_7B-GGUF-Imatrix / README.md
Lewdiculous's picture
Lewdiculous
Update README.md
e2ef386 verified
preview code
|
raw
history blame
1.08 kB
metadata
library_name: transformers
license: other
datasets:
  - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
  - ResplendentAI/Synthetic_Soul_1k
language:
  - en
tags:
  - gguf
  - quantized
  - roleplay
  - imatrix
  - mistral
inference: false

This repository hosts GGUF-Imatrix quantizations for ChaoticNeutrals/Eris_Floramix_DPO_7B.

    quantization_options = [
        "Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K",
        "Q8_0", "IQ4_XS", "IQ3_XXS"
    ]

The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.

Image:

image/png

Original model information:

Eris Floramix DPO

This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.

Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED