wwe180 commited on
Commit
d0853d2
·
verified ·
1 Parent(s): dcd84e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -26
README.md CHANGED
@@ -3,43 +3,23 @@ tags:
3
  - merge
4
  - mergekit
5
  - lazymergekit
6
- - shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat
7
- - MaziyarPanahi/Calme-7B-Instruct-v0.3
8
  base_model:
9
  - shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat
10
  - MaziyarPanahi/Calme-7B-Instruct-v0.3
 
 
11
  ---
12
 
13
  # Mistral-7B-v0.3-Chinese-lingyang-v1
14
 
 
 
15
  Mistral-7B-v0.3-Chinese-lingyang-v1 is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
16
  * [shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat](https://huggingface.co/shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat)
17
  * [MaziyarPanahi/Calme-7B-Instruct-v0.3](https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.3)
18
 
19
- ## 🧩 Configuration
20
-
21
- ```yaml
22
- slices:
23
- - sources:
24
- - model: shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat
25
- layer_range: [0, 32]
26
- - model: MaziyarPanahi/Calme-7B-Instruct-v0.3
27
- layer_range: [0, 32]
28
-
29
- merge_method: slerp
30
- base_model: shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat
31
-
32
- parameters:
33
- t:
34
- - filter: self_attn
35
- value: [0, 0.5, 0.3, 0.7, 1]
36
- - filter: mlp
37
- value: [1, 0.5, 0.7, 0.3, 0]
38
- - value: 0.5 # fallback for rest of tensors
39
-
40
- dtype: bfloat16
41
- ```
42
-
43
  ## 💻 Usage
44
 
45
  ```python
 
3
  - merge
4
  - mergekit
5
  - lazymergekit
6
+ - shenzhi-Chinese
7
+ - 7B
8
  base_model:
9
  - shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat
10
  - MaziyarPanahi/Calme-7B-Instruct-v0.3
11
+ license:
12
+ - other
13
  ---
14
 
15
  # Mistral-7B-v0.3-Chinese-lingyang-v1
16
 
17
+ #该模型是实验性的,因此无法保证结果。
18
+
19
  Mistral-7B-v0.3-Chinese-lingyang-v1 is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
20
  * [shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat](https://huggingface.co/shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat)
21
  * [MaziyarPanahi/Calme-7B-Instruct-v0.3](https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.3)
22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ## 💻 Usage
24
 
25
  ```python