PhiMiX-2x2B / mergekit_moe_config.yml
paulilioaica's picture
Upload folder using huggingface_hub
7f751aa verified
raw
history blame
288 Bytes
base_model: rhysjones/phi-2-orange
gate_mode: cheap_embed
dtype: float16
experts:
- source_model: cognitivecomputations/dolphin-2_6-phi-2
positive_prompts: ["research, logic, math, science"]
- source_model: rhysjones/phi-2-orange
positive_prompts: ["programming, reasoning"]