KatyTheCutie commited on
Commit
4b78d1e
·
verified ·
1 Parent(s): 8940576

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -22
README.md CHANGED
@@ -8,7 +8,7 @@ tags:
8
  - merge
9
 
10
  ---
11
- # merge
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
@@ -23,24 +23,3 @@ The following models were included in the merge:
23
  * [KatyTheCutie/EstopianMaid-13B](https://huggingface.co/KatyTheCutie/EstopianMaid-13B)
24
  * [Undi95/X-MythoChronos-13B](https://huggingface.co/Undi95/X-MythoChronos-13B)
25
 
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
-
32
- models:
33
- - model: Undi95/X-MythoChronos-13B
34
- - model: KatyTheCutie/EstopianMaid-13B
35
- merge_method: slerp
36
- base_model: KatyTheCutie/EstopianMaid-13B
37
- parameters:
38
- t:
39
- - filter: self_attn
40
- value: [0, 0.5, 0.3, 0.7, 1]
41
- - filter: mlp
42
- value: [1, 0.5, 0.7, 0.3, 0]
43
- - value: 0.5 # fallback for rest of tensors
44
- dtype: float16
45
-
46
- ```
 
8
  - merge
9
 
10
  ---
11
+ # MythoMaid
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
 
23
  * [KatyTheCutie/EstopianMaid-13B](https://huggingface.co/KatyTheCutie/EstopianMaid-13B)
24
  * [Undi95/X-MythoChronos-13B](https://huggingface.co/Undi95/X-MythoChronos-13B)
25