Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Lewdiculous commited on
Commit
db68c0a
1 Parent(s): cd5fe87

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: other
4
+ datasets:
5
+ - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
6
+ - ResplendentAI/Synthetic_Soul_1k
7
+ language:
8
+ - en
9
+ tags:
10
+ - gguf
11
+ - quantization
12
+ - roleplay
13
+ - imatrix
14
+ - mistral
15
+ ---
16
+
17
+ This repository hosts GGUF-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B).
18
+
19
+ ```python
20
+ quantization_options = [
21
+ "Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K",
22
+ "Q8_0", "IQ4_XS", "IQ3_XXS"
23
+ ]
24
+ ```
25
+
26
+ **This is experimental.**
27
+
28
+ For imatrix data generation, kalomaze's `groups_merged.txt` with added roleplay chats was used, you can find it [here](https://huggingface.co/Lewdiculous/Datura_7B-GGUF-Imatrix/blob/main/imatrix-with-rp-format-data.txt).
29
+
30
+ The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.
31
+
32
+ **Original model information:**
33
+
34
+ # Eris Floramix DPO
35
+
36
+ This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.
37
+
38
+ Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED