Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
|
|
8 |
### INT4 Inference
|
9 |
```bash
|
10 |
>>> text="9.11和9.8哪个数字大"
|
11 |
-
>>> ./llama-cli -m
|
12 |
## Generated:
|
13 |
## 要比较 **9.11** 和 **9.8** 的大小,可以将它们转化为小数形式以便比较。
|
14 |
## 1. **9.11** 已经是小数形式。
|
@@ -22,7 +22,7 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
|
|
22 |
|
23 |
|
24 |
>>> text="strawberry中有几个r?"
|
25 |
-
>>> ./llama-cli -m
|
26 |
## Generated:
|
27 |
## The word "strawberry" contains two 'r' characters. Here's the breakdown:
|
28 |
## - **S**
|
@@ -39,7 +39,7 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
|
|
39 |
|
40 |
|
41 |
>>> text="There is a girl who likes adventure,"
|
42 |
-
>>> ./llama-cli -m
|
43 |
## Generated:
|
44 |
## That’s great! Adventures can be thrilling and enriching experiences. Here are a few ideas to inspire her adventurous spirit:
|
45 |
## ### Outdoor Adventures:
|
@@ -76,7 +76,7 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
|
|
76 |
|
77 |
|
78 |
>>> text="Please give a brief introduction of DeepSeek company."
|
79 |
-
>>> ./llama-cli -m
|
80 |
## Generated:
|
81 |
## DeepSeek is a Chinese company specializing in artificial intelligence (AI) technologies and applications. Founded in 2023, DeepSeek focuses on developing advanced AI solutions for various industries, including finance, healthcare, education, and entertainment. The company emphasizes innovation in natural language processing (NLP), machine learning, and data analytics to create intelligent systems that enhance decision-making and efficiency. DeepSeek aims to bridge the gap between cutting-edge AI research and practical applications, contributing to technological advancements and digital transformation across sectors. [end of text]
|
82 |
```
|
|
|
8 |
### INT4 Inference
|
9 |
```bash
|
10 |
>>> text="9.11和9.8哪个数字大"
|
11 |
+
>>> ./llama-cli -m DeepSeek-V3-bf16-256x20B-Q4_0.gguf-00001-of-00009.gguf -p "<|begin▁of▁sentence|>You are a helpful assistant.<|User|>$text\n<|Assistant|>" -n 512 --threads 16 -no-cnv
|
12 |
## Generated:
|
13 |
## 要比较 **9.11** 和 **9.8** 的大小,可以将它们转化为小数形式以便比较。
|
14 |
## 1. **9.11** 已经是小数形式。
|
|
|
22 |
|
23 |
|
24 |
>>> text="strawberry中有几个r?"
|
25 |
+
>>> ./llama-cli -m DeepSeek-V3-bf16-256x20B-Q4_0.gguf-00001-of-00009.gguf -p "<|begin▁of▁sentence|>You are a helpful assistant.<|User|>$text\n<|Assistant|>" -n 512 --threads 16 -no-cnv
|
26 |
## Generated:
|
27 |
## The word "strawberry" contains two 'r' characters. Here's the breakdown:
|
28 |
## - **S**
|
|
|
39 |
|
40 |
|
41 |
>>> text="There is a girl who likes adventure,"
|
42 |
+
>>> ./llama-cli -m DeepSeek-V3-bf16-256x20B-Q4_0.gguf-00001-of-00009.gguf -p "<|begin▁of▁sentence|>You are a helpful assistant.<|User|>$text\n<|Assistant|>" -n 512 --threads 16 -no-cnv
|
43 |
## Generated:
|
44 |
## That’s great! Adventures can be thrilling and enriching experiences. Here are a few ideas to inspire her adventurous spirit:
|
45 |
## ### Outdoor Adventures:
|
|
|
76 |
|
77 |
|
78 |
>>> text="Please give a brief introduction of DeepSeek company."
|
79 |
+
>>> ./llama-cli -m DeepSeek-V3-bf16-256x20B-Q4_0.gguf-00001-of-00009.gguf -p "<|begin▁of▁sentence|>You are a helpful assistant.<|User|>$text\n<|Assistant|>" -n 512 --threads 16 -no-cnv
|
80 |
## Generated:
|
81 |
## DeepSeek is a Chinese company specializing in artificial intelligence (AI) technologies and applications. Founded in 2023, DeepSeek focuses on developing advanced AI solutions for various industries, including finance, healthcare, education, and entertainment. The company emphasizes innovation in natural language processing (NLP), machine learning, and data analytics to create intelligent systems that enhance decision-making and efficiency. DeepSeek aims to bridge the gap between cutting-edge AI research and practical applications, contributing to technological advancements and digital transformation across sectors. [end of text]
|
82 |
```
|