Breezeblossom-v4-mistral-2x7B / mergekit_moe_config.yml
sam-ezai's picture
Upload folder using huggingface_hub
d114c81 verified
raw
history blame contribute delete
620 Bytes
base_model: MediaTek-Research/Breeze-7B-Instruct-v0_1
gate_mode: hidden
dtype: float16
experts:
- source_model: MediaTek-Research/Breeze-7B-Instruct-v0_1
positive_prompts: [ "<s>You are a helpful AI assistant built by MediaTek Research. The user you are helping speaks Traditional Chinese and comes from Taiwan. [INST] 你好,請問你可以完成什麼任務? [/INST] "]
- source_model: Azure99/blossom-v4-mistral-7b
positive_prompts: ["A chat between a human and an artificial intelligence bot. The bot gives helpful, detailed, and polite answers to the human's questions. \n|Human|: hello\n|Bot|: "]