File size: 743 Bytes
3033a56 440fabb 3033a56 440fabb 3033a56 e896400 3033a56 e896400 3033a56 e896400 3033a56 df98d8f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
---
language:
- en
license: cc-by-nc-4.0
---
**Mistral Nemo 12B Lyra v2 - Stage 1**
This is Stage 1 of Lyra v2. Only SFT and 2-Step Merge has been performed at this stage.
This is still raw, there may be issues.
Kinda wordy and verbose like Claude is, but that is fixable in stage 2, hopefully.
Stage 2 Plans - RL currently TBD
---
\- `[/INST]` may leak, let's say that is an unintended side-effect. Just simply add it to your custom stopping strings. I tried adding it as an EOS in model config but that ruined the model somehow, so I didn't.
\- min_p value of 0.1 is a sane value to use. Temp? 0.7-1.2, up to you.
\- Prompt Format: ChatML
Have a day. |