File size: 589 Bytes
de192a9 2e54548 de192a9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |
---
library_name: transformers
model_name: shisa-v2-llama3.1-405b-W8A8-INT8
license: llama3.1
datasets:
- shisa-ai/shisa-v2-sharegpt
- shisa-ai/deepseekv3-ultrafeedback-armorm
language:
- ja
- en
- ko
- zh
base_model:
- shisa-ai/shisa-v2-llama3.1-405b
pipeline_tag: text-generation
---
Quantized w/ [llm-compressor](https://github.com/vllm-project/llm-compressor) using [shisa-ai/shisa-v2-sharegpt](https://huggingface.co/datasets/shisa-ai/shisa-v2-sharegpt) as the calibration set.
Original model: [shisa-ai/shisa-v2-llama3.1-405b](https://huggingface.co/shisa-ai/shisa-v2-llama3.1-405b) |