Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,30 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
---
|
4 |
+
### 模型说明
|
5 |
+
#### 基于RWKV6-v2.1-1B6 基模微调的超小模型,模型基于[此语料](https://modelscope.cn/datasets/Moemuu/Muice-Dataset/summary)进行pissa微调,并微调了embedding层
|
6 |
+
#### 非常感谢<b style="color:red">Moemuu</b>提供的开源语料支持
|
7 |
+
#### 此模型因参数较少,应该可以在安卓系统中使用[RWKV.CPP](https://github.com/RWKV/rwkv.cpp)在拥有6G运行内存的安卓手机中进行部署聊天
|
8 |
+
#### 效果如下:
|
9 |
+
|
10 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/OKx-5n3vIzfn27YUslzEx.png)
|
11 |
+
|
12 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/9PGE0iQcwl3zvVf0GAEY3.png)
|
13 |
+
|
14 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/uU_dgKpYlCz6nlA1HjtH0.png)
|
15 |
+
|
16 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/bjr1edAXN5cE7qu3gJCs1.png)
|
17 |
+
|
18 |
+
### 补充说明
|
19 |
+
#### 因此模型参数量较少,逻辑不够清晰是很正常的,并且使用默认角色对话即可,即:
|
20 |
+
```
|
21 |
+
System:
|
22 |
+
User:
|
23 |
+
Assistant:
|
24 |
+
```
|
25 |
+
### 推荐参数如下:
|
26 |
+
#### Temperature=2
|
27 |
+
#### Top_P=0.55
|
28 |
+
#### Presence Penalty=0.4-0之间
|
29 |
+
#### Frequency Penalty=0.8-1.2之间
|
30 |
+
|