wanlige lbourdois commited on
Commit
4060c8a
·
verified ·
1 Parent(s): 1e7d176

Improve language tag (#2)

Browse files

- Improve language tag (dbeeb7d375a8baf4d6acbd28aeafc0d4b3e4ad3e)


Co-authored-by: Loïck BOURDOIS <[email protected]>

Files changed (1) hide show
  1. README.md +67 -54
README.md CHANGED
@@ -1,54 +1,67 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-32B
4
- - Qwen/QwQ-32B
5
- - maldv/Awqward2.5-32B-Instruct
6
- - huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated
7
- - Qwen/QwQ-32B-Preview
8
- - Qwen/Qwen2.5-32B-Instruct
9
- - tanliboy/lambda-qwen2.5-32b-dpo-test
10
- library_name: transformers
11
- tags:
12
- - mergekit
13
- - merge
14
-
15
- ---
16
- # merge
17
-
18
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
-
20
- ## Merge Details
21
- ### Merge Method
22
-
23
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
24
-
25
- ### Models Merged
26
-
27
- The following models were included in the merge:
28
- * [Qwen/Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B)
29
- * [Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B)
30
- * [maldv/Awqward2.5-32B-Instruct](https://huggingface.co/maldv/Awqward2.5-32B-Instruct)
31
- * [huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated)
32
- * [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
33
- * [tanliboy/lambda-qwen2.5-32b-dpo-test](https://huggingface.co/tanliboy/lambda-qwen2.5-32b-dpo-test)
34
-
35
- ### Configuration
36
-
37
- The following YAML configuration was used to produce this model:
38
-
39
- ```yaml
40
- models:
41
- - model: Qwen/QwQ-32B
42
- - model: huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated
43
- - model: Qwen/Qwen2.5-32B
44
- - model: maldv/Awqward2.5-32B-Instruct
45
- - model: Qwen/Qwen2.5-32B-Instruct
46
- - model: Qwen/QwQ-32B-Preview
47
- - model: tanliboy/lambda-qwen2.5-32b-dpo-test
48
- merge_method: model_stock
49
- base_model: Qwen/Qwen2.5-32B-Instruct
50
- normalize: true
51
- int8_mask: true
52
- dtype: bfloat16
53
-
54
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-32B
4
+ - Qwen/QwQ-32B
5
+ - maldv/Awqward2.5-32B-Instruct
6
+ - huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated
7
+ - Qwen/QwQ-32B-Preview
8
+ - Qwen/Qwen2.5-32B-Instruct
9
+ - tanliboy/lambda-qwen2.5-32b-dpo-test
10
+ library_name: transformers
11
+ tags:
12
+ - mergekit
13
+ - merge
14
+ language:
15
+ - zho
16
+ - eng
17
+ - fra
18
+ - spa
19
+ - por
20
+ - deu
21
+ - ita
22
+ - rus
23
+ - jpn
24
+ - kor
25
+ - vie
26
+ - tha
27
+ - ara
28
+ ---
29
+ # merge
30
+
31
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
32
+
33
+ ## Merge Details
34
+ ### Merge Method
35
+
36
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
37
+
38
+ ### Models Merged
39
+
40
+ The following models were included in the merge:
41
+ * [Qwen/Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B)
42
+ * [Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B)
43
+ * [maldv/Awqward2.5-32B-Instruct](https://huggingface.co/maldv/Awqward2.5-32B-Instruct)
44
+ * [huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated)
45
+ * [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
46
+ * [tanliboy/lambda-qwen2.5-32b-dpo-test](https://huggingface.co/tanliboy/lambda-qwen2.5-32b-dpo-test)
47
+
48
+ ### Configuration
49
+
50
+ The following YAML configuration was used to produce this model:
51
+
52
+ ```yaml
53
+ models:
54
+ - model: Qwen/QwQ-32B
55
+ - model: huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated
56
+ - model: Qwen/Qwen2.5-32B
57
+ - model: maldv/Awqward2.5-32B-Instruct
58
+ - model: Qwen/Qwen2.5-32B-Instruct
59
+ - model: Qwen/QwQ-32B-Preview
60
+ - model: tanliboy/lambda-qwen2.5-32b-dpo-test
61
+ merge_method: model_stock
62
+ base_model: Qwen/Qwen2.5-32B-Instruct
63
+ normalize: true
64
+ int8_mask: true
65
+ dtype: bfloat16
66
+
67
+ ```