lbourdois commited on
Commit
2c97224
·
verified ·
1 Parent(s): 91cad51

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +99 -87
README.md CHANGED
@@ -1,88 +1,100 @@
1
- ---
2
- license: apache-2.0
3
- license_link: https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct-GGUF/blob/main/LICENSE
4
- language:
5
- - en
6
- pipeline_tag: text-generation
7
- base_model: Qwen/Qwen2.5-1.5B-Instruct
8
- tags:
9
- - chat
10
- ---
11
-
12
- # Qwen2.5-1.5B-Instruct-GGUF
13
-
14
- ## Introduction
15
-
16
- Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:
17
-
18
- - Significantly **more knowledge** and has greatly improved capabilities in **coding** and **mathematics**, thanks to our specialized expert models in these domains.
19
- - Significant improvements in **instruction following**, **generating long texts** (over 8K tokens), **understanding structured data** (e.g, tables), and **generating structured outputs** especially JSON. **More resilient to the diversity of system prompts**, enhancing role-play implementation and condition-setting for chatbots.
20
- - **Long-context Support** up to 128K tokens and can generate up to 8K tokens.
21
- - **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
22
-
23
- **This repo contains the instruction-tuned 1.5B Qwen2.5 model in the GGUF Format**, which has the following features:
24
- - Type: Causal Language Models
25
- - Training Stage: Pretraining & Post-training
26
- - Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings
27
- - Number of Parameters: 1.54B
28
- - Number of Paramaters (Non-Embedding): 1.31B
29
- - Number of Layers: 28
30
- - Number of Attention Heads (GQA): 12 for Q and 2 for KV
31
- - Context Length: Full 32,768 tokens and generation 8192 tokens
32
- - Quantization: q2_K, q3_K_M, q4_0, q4_K_M, q5_0, q5_K_M, q6_K, q8_0
33
-
34
- For more details, please refer to our [blog](https://qwenlm.github.io/blog/qwen2.5/), [GitHub](https://github.com/QwenLM/Qwen2.5), and [Documentation](https://qwen.readthedocs.io/en/latest/).
35
-
36
- ## Quickstart
37
-
38
- Check out our [llama.cpp documentation](https://qwen.readthedocs.io/en/latest/run_locally/llama.cpp.html) for more usage guide.
39
-
40
- We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and install it following the official guide. We follow the latest version of llama.cpp.
41
- In the following demonstration, we assume that you are running commands under the repository `llama.cpp`.
42
-
43
- Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use `huggingface-cli`:
44
- 1. Install
45
- ```shell
46
- pip install -U huggingface_hub
47
- ```
48
- 2. Download:
49
- ```shell
50
- huggingface-cli download Qwen/Qwen2.5-1.5B-Instruct-GGUF qwen2.5-1.5b-instruct-q5_k_m.gguf --local-dir . --local-dir-use-symlinks False
51
- ```
52
-
53
- For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
54
-
55
- ```shell
56
- ./llama-cli -m <gguf-file-path> \
57
- -co -cnv -p "You are Qwen, created by Alibaba Cloud. You are a helpful assistant." \
58
- -fa -ngl 80 -n 512
59
- ```
60
-
61
-
62
- ## Evaluation & Performance
63
-
64
- Detailed evaluation results are reported in this [📑 blog](https://qwenlm.github.io/blog/qwen2.5/).
65
-
66
- For quantized models, the benchmark results against the original bfloat16 models can be found [here](https://qwen.readthedocs.io/en/latest/benchmark/quantization_benchmark.html)
67
-
68
- For requirements on GPU memory and the respective throughput, see results [here](https://qwen.readthedocs.io/en/latest/benchmark/speed_benchmark.html).
69
-
70
- ## Citation
71
-
72
- If you find our work helpful, feel free to give us a cite.
73
-
74
- ```
75
- @misc{qwen2.5,
76
- title = {Qwen2.5: A Party of Foundation Models},
77
- url = {https://qwenlm.github.io/blog/qwen2.5/},
78
- author = {Qwen Team},
79
- month = {September},
80
- year = {2024}
81
- }
82
- @article{qwen2,
83
- title={Qwen2 Technical Report},
84
- author={An Yang and Baosong Yang and Binyuan Hui and Bo Zheng and Bowen Yu and Chang Zhou and Chengpeng Li and Chengyuan Li and Dayiheng Liu and Fei Huang and Guanting Dong and Haoran Wei and Huan Lin and Jialong Tang and Jialin Wang and Jian Yang and Jianhong Tu and Jianwei Zhang and Jianxin Ma and Jin Xu and Jingren Zhou and Jinze Bai and Jinzheng He and Junyang Lin and Kai Dang and Keming Lu and Keqin Chen and Kexin Yang and Mei Li and Mingfeng Xue and Na Ni and Pei Zhang and Peng Wang and Ru Peng and Rui Men and Ruize Gao and Runji Lin and Shijie Wang and Shuai Bai and Sinan Tan and Tianhang Zhu and Tianhao Li and Tianyu Liu and Wenbin Ge and Xiaodong Deng and Xiaohuan Zhou and Xingzhang Ren and Xinyu Zhang and Xipin Wei and Xuancheng Ren and Yang Fan and Yang Yao and Yichang Zhang and Yu Wan and Yunfei Chu and Yuqiong Liu and Zeyu Cui and Zhenru Zhang and Zhihao Fan},
85
- journal={arXiv preprint arXiv:2407.10671},
86
- year={2024}
87
- }
 
 
 
 
 
 
 
 
 
 
 
 
88
  ```
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct-GGUF/blob/main/LICENSE
4
+ language:
5
+ - zho
6
+ - eng
7
+ - fra
8
+ - spa
9
+ - por
10
+ - deu
11
+ - ita
12
+ - rus
13
+ - jpn
14
+ - kor
15
+ - vie
16
+ - tha
17
+ - ara
18
+ pipeline_tag: text-generation
19
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
20
+ tags:
21
+ - chat
22
+ ---
23
+
24
+ # Qwen2.5-1.5B-Instruct-GGUF
25
+
26
+ ## Introduction
27
+
28
+ Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:
29
+
30
+ - Significantly **more knowledge** and has greatly improved capabilities in **coding** and **mathematics**, thanks to our specialized expert models in these domains.
31
+ - Significant improvements in **instruction following**, **generating long texts** (over 8K tokens), **understanding structured data** (e.g, tables), and **generating structured outputs** especially JSON. **More resilient to the diversity of system prompts**, enhancing role-play implementation and condition-setting for chatbots.
32
+ - **Long-context Support** up to 128K tokens and can generate up to 8K tokens.
33
+ - **Multilingual support** for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.
34
+
35
+ **This repo contains the instruction-tuned 1.5B Qwen2.5 model in the GGUF Format**, which has the following features:
36
+ - Type: Causal Language Models
37
+ - Training Stage: Pretraining & Post-training
38
+ - Architecture: transformers with RoPE, SwiGLU, RMSNorm, Attention QKV bias and tied word embeddings
39
+ - Number of Parameters: 1.54B
40
+ - Number of Paramaters (Non-Embedding): 1.31B
41
+ - Number of Layers: 28
42
+ - Number of Attention Heads (GQA): 12 for Q and 2 for KV
43
+ - Context Length: Full 32,768 tokens and generation 8192 tokens
44
+ - Quantization: q2_K, q3_K_M, q4_0, q4_K_M, q5_0, q5_K_M, q6_K, q8_0
45
+
46
+ For more details, please refer to our [blog](https://qwenlm.github.io/blog/qwen2.5/), [GitHub](https://github.com/QwenLM/Qwen2.5), and [Documentation](https://qwen.readthedocs.io/en/latest/).
47
+
48
+ ## Quickstart
49
+
50
+ Check out our [llama.cpp documentation](https://qwen.readthedocs.io/en/latest/run_locally/llama.cpp.html) for more usage guide.
51
+
52
+ We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and install it following the official guide. We follow the latest version of llama.cpp.
53
+ In the following demonstration, we assume that you are running commands under the repository `llama.cpp`.
54
+
55
+ Since cloning the entire repo may be inefficient, you can manually download the GGUF file that you need or use `huggingface-cli`:
56
+ 1. Install
57
+ ```shell
58
+ pip install -U huggingface_hub
59
+ ```
60
+ 2. Download:
61
+ ```shell
62
+ huggingface-cli download Qwen/Qwen2.5-1.5B-Instruct-GGUF qwen2.5-1.5b-instruct-q5_k_m.gguf --local-dir . --local-dir-use-symlinks False
63
+ ```
64
+
65
+ For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
66
+
67
+ ```shell
68
+ ./llama-cli -m <gguf-file-path> \
69
+ -co -cnv -p "You are Qwen, created by Alibaba Cloud. You are a helpful assistant." \
70
+ -fa -ngl 80 -n 512
71
+ ```
72
+
73
+
74
+ ## Evaluation & Performance
75
+
76
+ Detailed evaluation results are reported in this [📑 blog](https://qwenlm.github.io/blog/qwen2.5/).
77
+
78
+ For quantized models, the benchmark results against the original bfloat16 models can be found [here](https://qwen.readthedocs.io/en/latest/benchmark/quantization_benchmark.html)
79
+
80
+ For requirements on GPU memory and the respective throughput, see results [here](https://qwen.readthedocs.io/en/latest/benchmark/speed_benchmark.html).
81
+
82
+ ## Citation
83
+
84
+ If you find our work helpful, feel free to give us a cite.
85
+
86
+ ```
87
+ @misc{qwen2.5,
88
+ title = {Qwen2.5: A Party of Foundation Models},
89
+ url = {https://qwenlm.github.io/blog/qwen2.5/},
90
+ author = {Qwen Team},
91
+ month = {September},
92
+ year = {2024}
93
+ }
94
+ @article{qwen2,
95
+ title={Qwen2 Technical Report},
96
+ author={An Yang and Baosong Yang and Binyuan Hui and Bo Zheng and Bowen Yu and Chang Zhou and Chengpeng Li and Chengyuan Li and Dayiheng Liu and Fei Huang and Guanting Dong and Haoran Wei and Huan Lin and Jialong Tang and Jialin Wang and Jian Yang and Jianhong Tu and Jianwei Zhang and Jianxin Ma and Jin Xu and Jingren Zhou and Jinze Bai and Jinzheng He and Junyang Lin and Kai Dang and Keming Lu and Keqin Chen and Kexin Yang and Mei Li and Mingfeng Xue and Na Ni and Pei Zhang and Peng Wang and Ru Peng and Rui Men and Ruize Gao and Runji Lin and Shijie Wang and Shuai Bai and Sinan Tan and Tianhang Zhu and Tianhao Li and Tianyu Liu and Wenbin Ge and Xiaodong Deng and Xiaohuan Zhou and Xingzhang Ren and Xinyu Zhang and Xipin Wei and Xuancheng Ren and Yang Fan and Yang Yao and Yichang Zhang and Yu Wan and Yunfei Chu and Yuqiong Liu and Zeyu Cui and Zhenru Zhang and Zhihao Fan},
97
+ journal={arXiv preprint arXiv:2407.10671},
98
+ year={2024}
99
+ }
100
  ```