Lorge-2x7B / mergekit_moe_config.yml
Alsebay's picture
Upload
b50c045 verified
raw
history blame contribute delete
No virus
470 Bytes
base_model: NurtureAI/neural-chat-7b-v3-1-16k
dtype: bfloat16
gate_mode: cheap_embed
experts_per_token: 2
experts:
- source_model: NurtureAI/neural-chat-7b-v3-1-16k
positive_prompts:
- "You are an helpful general-pupose assistant."
- source_model: SanjiWatsuki/Kunoichi-DPO-v2-7B
positive_prompts:
- "You are an assistant good at Entertainment purpose."
- "storywriting"
- "write"
- "scene"
- "story"
- "character"