nm-testing
/

TinyLlama-1.1B-Chat-v1.0-W4A16_channel-e2e

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

nm-autobot commited on Sep 27

Commit

15c14be

•

1 Parent(s): bb1b605

Upload LlamaForCausalLM

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -36,7 +36,7 @@
     "kv_cache_scheme": null,
     "quant_method": "compressed-tensors",
     "quantization_status": "compressed",
-    "version": "0.6.0.20240926"
   },
   "eos_token_id": 2,
   "head_dim": 64,

     "kv_cache_scheme": null,
     "quant_method": "compressed-tensors",
     "quantization_status": "compressed",
+    "version": "0.6.0.20240927"
   },
   "eos_token_id": 2,
   "head_dim": 64,