Phr00t commited on
Commit
2897b35
·
verified ·
1 Parent(s): 7455579

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Phr00t/Phr00tyMix-v4-32B
4
+ base_model_relation: quantized
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/631be8402ea8535ea48abbc6/zPB8Pmb6m4H7bKGw-dpmV.png)
12
+
13
+ # Phr00tyMix-v4-32B
14
+
15
+ Phr00tyMix-v3 did increase creativity, but at the expense of some of its instruction following and coherency. This mix is intended to fix that, which should improve its storytelling and obediency. This model is still very creative, uncensored (when asked to be) and smart.
16
+
17
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
+
19
+ ## Merge Details
20
+ ### Merge Method
21
+
22
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Phr00t/Phr00tyMix-v3-32B](https://huggingface.co/Phr00t/Phr00tyMix-v3-32B) as a base.
23
+
24
+ ### Models Merged
25
+
26
+ The following models were included in the merge:
27
+ * [allura-org/Qwen2.5-32b-RP-Ink](https://huggingface.co/allura-org/Qwen2.5-32b-RP-Ink)
28
+ * [nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored](https://huggingface.co/nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored)
29
+ * [Delta-Vector/Archaeo-32B-KTO](https://huggingface.co/Delta-Vector/Archaeo-32B-KTO)
30
+ * [arcee-ai/Virtuoso-Medium-v2](https://huggingface.co/arcee-ai/Virtuoso-Medium-v2)
31
+ * [Phr00t/Phr00tyMix-v2-32B](https://huggingface.co/Phr00t/Phr00tyMix-v2-32B)
32
+
33
+ ### Configuration
34
+
35
+ The following YAML configuration was used to produce this model:
36
+
37
+ ```yaml
38
+ merge_method: model_stock
39
+ base_model: Phr00t/Phr00tyMix-v3-32B
40
+ dtype: bfloat16
41
+ models:
42
+ - model: Delta-Vector/Archaeo-32B-KTO
43
+ - model: allura-org/Qwen2.5-32b-RP-Ink
44
+ - model: arcee-ai/Virtuoso-Medium-v2
45
+ - model: Phr00t/Phr00tyMix-v2-32B
46
+ - model: nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored
47
+ tokenizer:
48
+ source: "Delta-Vector/Archaeo-32B-KTO"
49
+
50
+ ```