aashish1904 commited on
Commit
bd6cb6a
·
verified ·
1 Parent(s): 394a33f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +108 -0
README.md ADDED
@@ -0,0 +1,108 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ base_model:
5
+ - IlyaGusev/saiga_nemo_12b
6
+ - elinas/Chronos-Gold-12B-1.0
7
+ - Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
8
+ - MarinaraSpaghetti/NemoMix-Unleashed-12B
9
+ library_name: transformers
10
+ tags:
11
+ - mergekit
12
+ - merge
13
+ - rp
14
+ - role-play
15
+ - mistral
16
+ language:
17
+ - ru
18
+ - en
19
+
20
+ ---
21
+
22
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
23
+
24
+
25
+ # QuantFactory/SAINEMO-reMIX-GGUF
26
+ This is quantized version of [Moraliane/SAINEMO-reMIX](https://huggingface.co/Moraliane/SAINEMO-reMIX) created using llama.cpp
27
+
28
+ # Original Model Card
29
+
30
+ # SAINEMO-reMIX
31
+ ![SAINEMO-reMIX](./remixwife.webp)
32
+
33
+ # GGUF: thx team mradermacher
34
+ https://huggingface.co/mradermacher/SAINEMO-reMIX-GGUF
35
+
36
+ # GGUF imatrix
37
+ https://huggingface.co/mradermacher/SAINEMO-reMIX-i1-GGUF
38
+ # learderboard
39
+ ![SAINEMO-reMIX](./learderboard.png)
40
+
41
+ # Presets
42
+ The given presets are quite suitable for this model. https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved
43
+ # Sampler
44
+
45
+
46
+ ```
47
+ Temp - 0,7 - 1,2 ~
48
+ TopA - 0,1
49
+ DRY - 0,8 1,75 2 0
50
+ I recommend trying the stock presets from SillyTavern, such as simple-1.
51
+ ```
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
64
+
65
+ ## Merge Details
66
+ ### Merge Method
67
+
68
+ This model was merged using the della_linear merge method using E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b as a base.
69
+
70
+ ### Models Merged
71
+
72
+ The following models were included in the merge:
73
+ * E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
74
+ * E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
75
+ * E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
76
+
77
+ ### Configuration
78
+
79
+ The following YAML configuration was used to produce this model:
80
+
81
+ ```yaml
82
+ models:
83
+ - model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
84
+ parameters:
85
+ weight: 0.55 # Основной акцент на русском языке
86
+ density: 0.4
87
+ - model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
88
+ parameters:
89
+ weight: 0.2 # РП модель, чуть меньший вес из-за ориентации на английский
90
+ density: 0.4
91
+ - model: E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
92
+ parameters:
93
+ weight: 0.15 # Вторая РП модель
94
+ density: 0.4
95
+ - model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
96
+ parameters:
97
+ weight: 0.25 # Русскоязычная поддержка и баланс
98
+ density: 0.4
99
+
100
+ merge_method: della_linear
101
+ base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
102
+ parameters:
103
+ epsilon: 0.05
104
+ lambda: 1
105
+ dtype: float16
106
+ tokenizer_source: base
107
+
108
+ ```