metadata
base_model:
- Sao10K/MN-12B-Lyra-v1
- Sao10K/MN-12B-Lyra-v3
- unsloth/Mistral-Nemo-Instruct-2407
library_name: transformers
tags:
- merge
- mistral
license: cc-by-nc-4.0
Lyris-dev3-Mistral-Nemo-12B-2407
EXPERIMENTAL
attempt to fix Sao10k's Lyra-V3 prompt format and stop token >and boost smarts. with strategic LATCOS vector similarity merging
prototype, unfinished, dev3
- Sao10K/MN-12B-Lyra-v1 Base
- Sao10K/MN-12B-Lyra-v3 x2 Sequential PASS, order: 1, 3
- unsloth/Mistral-Nemo-Instruct-2407 x2 Sequential PASS, order: 2, 4
- with z0.0001 value
Prompt format:
Mistral Instruct
[INST] System Message [/INST]
[INST] Name: Let's get started. Please respond based on the information and instructions provided above. [/INST]
<s>[INST] Name: What is your favourite condiment? [/INST]
AssistantName: Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!</s>
[INST] Name: Do you have mayonnaise recipes? [/INST]