Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,33 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
2 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
### Custom format:
|
4 |
```
|
5 |
### Instruction:
|
@@ -10,4 +38,6 @@ This is a test
|
|
10 |
|
11 |
### Response:
|
12 |
{reply}
|
13 |
-
```
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
tags:
|
4 |
+
- not-for-all-audiences
|
5 |
+
- nsfw
|
6 |
+
---
|
7 |
|
8 |
+
First experimental merge of Noromaid 8x7b (Instruct) and dolphin 8x7b. The idea behind this is to add a little more IQ to the model, because Noromaid was only trained on RP/ERP data. Dolphin 2.7 is the only real Mixtral finetune I consider "usable", and so the merging quest begin again kek.
|
9 |
+
|
10 |
+
Merged Dolphin 2.7 with Mixtral Base (Dolphin was at 1.0 weight) to get rid of ChatLM, and then I merged Noromaid 8x7b with the output, SLERP method.
|
11 |
+
|
12 |
+
This model feel better on the IQ chart and have the ~same average score than Noromaid 8x7b, but it's softer and more prude too, it also have the typical Mixtral repeat issue at some point. Choose your poison.
|
13 |
+
|
14 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/uZlU0PEPtKPZPLzXcoqJ_.png)
|
15 |
+
|
16 |
+
<!-- description start -->
|
17 |
+
## Description
|
18 |
+
|
19 |
+
This repo contains fp16 files of FlatDolphinMaid-8x7B.
|
20 |
+
|
21 |
+
<!-- description end -->
|
22 |
+
<!-- description start -->
|
23 |
+
## Models used
|
24 |
+
|
25 |
+
- [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)
|
26 |
+
- [cognitivecomputations/dolphin-2.7-mixtral-8x7b](https://huggingface.co/cognitivecomputations/dolphin-2.7-mixtral-8x7b)
|
27 |
+
- [NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)
|
28 |
+
|
29 |
+
<!-- description end -->
|
30 |
+
<!-- prompt-template start -->
|
31 |
### Custom format:
|
32 |
```
|
33 |
### Instruction:
|
|
|
38 |
|
39 |
### Response:
|
40 |
{reply}
|
41 |
+
```
|
42 |
+
|
43 |
+
If you want to support me, you can [here](https://ko-fi.com/undiai).
|