--- library_name: transformers license: other datasets: - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED - ResplendentAI/Synthetic_Soul_1k language: - en tags: - gguf - quantization - roleplay - imatrix - mistral --- This repository hosts GGUF-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B). ```python quantization_options = [ "Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0", "IQ4_XS", "IQ3_XXS" ] ``` **This is experimental.** For imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt). The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios. **Original model information:** # Eris Floramix DPO This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset. Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED