AlekseiPravdin commited on
Commit
476593e
1 Parent(s): 245dfcd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - Nitral-AI/KukulStanta-7B
8
+ - AlekseiPravdin/Seamaiiza-7B-v1
9
+ ---
10
+
11
+ # KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge
12
+
13
+ KukulStanta-7B-Seamaiiza-7B-v1-slerp-merge is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [Nitral-AI/KukulStanta-7B](https://huggingface.co/Nitral-AI/KukulStanta-7B)
15
+ * [AlekseiPravdin/Seamaiiza-7B-v1](https://huggingface.co/AlekseiPravdin/Seamaiiza-7B-v1)
16
+
17
+ ## 🧩 Configuration
18
+
19
+ ```yamlslices:
20
+ - sources:
21
+ - model: Nitral-AI/KukulStanta-7B
22
+ layer_range: [0, 31]
23
+ - model: AlekseiPravdin/Seamaiiza-7B-v1
24
+ layer_range: [0, 31]
25
+ merge_method: slerp
26
+ base_model: Nitral-AI/KukulStanta-7B
27
+ parameters:
28
+ t:
29
+ - filter: self_attn
30
+ value: [0, 0.5, 0.3, 0.7, 1]
31
+ - filter: mlp
32
+ value: [1, 0.5, 0.7, 0.3, 0]
33
+ - value: 0.5
34
+ dtype: float16