Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- Sao10K/MN-12B-Lyra-v1
|
| 4 |
+
- Sao10K/MN-12B-Lyra-v3
|
| 5 |
+
- unsloth/Mistral-Nemo-Instruct-2407
|
| 6 |
+
library_name: transformers
|
| 7 |
+
tags:
|
| 8 |
+
- merge
|
| 9 |
+
- mistral
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
Lyris-dev3-Mistral-Nemo-12B-2407
|
| 13 |
+
-----------------------------
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
*EXPERIMENTAL*
|
| 17 |
+
|
| 18 |
+
attempt to fix Sao10k's Lyra-V3 prompt format and stop token >and boost smarts. with strategic *LATCOS* vector similarity merging
|
| 19 |
+
|
| 20 |
+
prototype, unfinished, dev3
|
| 21 |
+
|
| 22 |
+
- Sao10K/MN-12B-Lyra-v1 <b>*Base*</b>
|
| 23 |
+
- Sao10K/MN-12B-Lyra-v3 <b>*x2 Sequential PASS, order: 1, 3*</b>
|
| 24 |
+
- unsloth/Mistral-Nemo-Instruct-2407 <b>*x2 Sequential PASS, order: 2, 4*</b>
|
| 25 |
+
- with z0.0001 value
|
| 26 |
+
|
| 27 |
+
# <b>Prompt format:</b>
|
| 28 |
+
*Mistral Instruct*
|
| 29 |
+
```
|
| 30 |
+
[INST] System Message [/INST]
|
| 31 |
+
|
| 32 |
+
[INST] Name: Let's get started. Please respond based on the information and instructions provided above. [/INST]
|
| 33 |
+
|
| 34 |
+
<s>[INST] Name: What is your favourite condiment? [/INST]
|
| 35 |
+
AssistantName: Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!</s>
|
| 36 |
+
[INST] Name: Do you have mayonnaise recipes? [/INST]
|
| 37 |
+
```
|