Files changed (1) hide show
  1. README.md +49 -37
README.md CHANGED
@@ -1,37 +1,49 @@
1
- ---
2
- base_model: Qwen/Qwen2.5-32B-Instruct
3
- license: apache-2.0
4
- license_link: https://huggingface.co/Qwen/Qwen2.5-32B-Instruct/blob/main/LICENSE
5
- model_creator: Qwen
6
- model_name: Qwen2.5-32B-Instruct
7
- quantized_by: Second State Inc.
8
- language:
9
- - en
10
- pipeline_tag: text-generation
11
- tags:
12
- - chat
13
- ---
14
-
15
- # Qwen2.5-32B-Instruct-GGUF
16
-
17
- ## Original Model
18
-
19
- [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct)
20
-
21
- ## Run with Gaianet
22
-
23
- **Prompt template**
24
-
25
- prompt template: `chatml`
26
-
27
- **Context size**
28
-
29
- chat_ctx_size: `128000`
30
-
31
- **Run with GaiaNet**
32
-
33
- - Quick start: https://docs.gaianet.ai/node-guide/quick-start
34
-
35
- - Customize your node: https://docs.gaianet.ai/node-guide/customize
36
-
37
- *Quantized with llama.cpp b3751*
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-32B-Instruct
3
+ license: apache-2.0
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-32B-Instruct/blob/main/LICENSE
5
+ model_creator: Qwen
6
+ model_name: Qwen2.5-32B-Instruct
7
+ quantized_by: Second State Inc.
8
+ language:
9
+ - zho
10
+ - eng
11
+ - fra
12
+ - spa
13
+ - por
14
+ - deu
15
+ - ita
16
+ - rus
17
+ - jpn
18
+ - kor
19
+ - vie
20
+ - tha
21
+ - ara
22
+ pipeline_tag: text-generation
23
+ tags:
24
+ - chat
25
+ ---
26
+
27
+ # Qwen2.5-32B-Instruct-GGUF
28
+
29
+ ## Original Model
30
+
31
+ [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct)
32
+
33
+ ## Run with Gaianet
34
+
35
+ **Prompt template**
36
+
37
+ prompt template: `chatml`
38
+
39
+ **Context size**
40
+
41
+ chat_ctx_size: `128000`
42
+
43
+ **Run with GaiaNet**
44
+
45
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
46
+
47
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
48
+
49
+ *Quantized with llama.cpp b3751*