Hugging Face's logo

Lewdiculous
/
Eris_Floramix_DPO_7B-GGUF-Imatrix

Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Model card Files Community
1
Eris_Floramix_DPO_7B-GGUF-Imatrix / README.md
Lewdiculous's picture
Lewdiculous
Update README.md
ce98d83 verified
preview code
|
raw
history blame
1.32 kB
metadata
library_name: transformers
license: other
datasets:
  - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
  - ResplendentAI/Synthetic_Soul_1k
language:
  - en
tags:
  - gguf
  - quantized
  - roleplay
  - imatrix
  - mistral
inference: false

This repository hosts GGUF-Imatrix quantizations for ChaoticNeutrals/Eris_Floramix_DPO_7B.

    quantization_options = [
        "Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K",
        "Q8_0", "IQ4_XS", "IQ3_XXS"
    ]

This is experimental.

For imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it here.

The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.

Image:

image/png

Original model information:

Eris Floramix DPO

This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.

Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED