Seikaijyu commited on
Commit
fc07e47
·
verified ·
1 Parent(s): a164670

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,3 +1,30 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+ ### 模型说明
5
+ #### 基于RWKV6-v2.1-1B6 基模微调的超小模型,模型基于[此语料](https://modelscope.cn/datasets/Moemuu/Muice-Dataset/summary)进行pissa微调,并微调了embedding层
6
+ #### 非常感谢<b style="color:red">Moemuu</b>提供的开源语料支持
7
+ #### 此模型因参数较少,应该可以在安卓系统中使用[RWKV.CPP](https://github.com/RWKV/rwkv.cpp)在拥有6G运行内存的安卓手机中进行部署聊天
8
+ #### 效果如下:
9
+
10
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/OKx-5n3vIzfn27YUslzEx.png)
11
+
12
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/9PGE0iQcwl3zvVf0GAEY3.png)
13
+
14
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/uU_dgKpYlCz6nlA1HjtH0.png)
15
+
16
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6417b108b03817ada6444bb8/bjr1edAXN5cE7qu3gJCs1.png)
17
+
18
+ ### 补充说明
19
+ #### 因此模型参数量较少,逻辑不够清晰是很正常的,并且使用默认角色对话即可,即:
20
+ ```
21
+ System:
22
+ User:
23
+ Assistant:
24
+ ```
25
+ ### 推荐参数如下:
26
+ #### Temperature=2
27
+ #### Top_P=0.55
28
+ #### Presence Penalty=0.4-0之间
29
+ #### Frequency Penalty=0.8-1.2之间
30
+