Isotonic
/

smol_llama-4x220M-MoE

Text Generation

Mixture of Experts

BEE-spoke-data/smol_llama-220M-openhermes

BEE-spoke-data/beecoder-220M-python

BEE-spoke-data/zephyr-220m-sft-full

BEE-spoke-data/zephyr-220m-dpo-full

text-generation-inference

Model card Files Files and versions Community

Isotonic commited on Feb 7, 2024

Commit

3b388b3

·

verified ·

1 Parent(s): 62257b4

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "BEE-spoke-data/smol_llama-220M-openhermes",
   "architectures": [
     "MixtralForCausalLM"
   ],

 {
+  "_name_or_path": "Isotonic/smol_llama-4x220M-MoE",
   "architectures": [
     "MixtralForCausalLM"
   ],