Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
compressed-tensors
Model card Files Community
nm-autobot commited on
Commit
14229a4
•
1 Parent(s): 984e19d

Upload LlamaForCausalLM

Browse files
Files changed (2) hide show
  1. config.json +2 -1
  2. model.safetensors +1 -1
config.json CHANGED
@@ -46,7 +46,8 @@
46
  ],
47
  "kv_cache_scheme": null,
48
  "quant_method": "compressed-tensors",
49
- "quantization_status": "compressed"
 
50
  },
51
  "eos_token_id": 2,
52
  "hidden_act": "silu",
 
46
  ],
47
  "kv_cache_scheme": null,
48
  "quant_method": "compressed-tensors",
49
+ "quantization_status": "compressed",
50
+ "version": "0.6.0.20240925"
51
  },
52
  "eos_token_id": 2,
53
  "hidden_act": "silu",
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9431a505d3b5ea7b6dfaab9f4381d463654f463b4f2a1ebb0fda32bfadc660cb
3
  size 1232059012
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e7dd01f726bae94988a632b681bcdbbfe122ae602b680c5a207f21a9c93f7e
3
  size 1232059012