---
library_name: transformers
model_name: shisa-v2-llama3.1-405b-W8A8-INT8
license: llama3.1
datasets:
- shisa-ai/shisa-v2-sharegpt
- shisa-ai/deepseekv3-ultrafeedback-armorm
language:
- ja
- en
- ko
- zh
base_model:
- shisa-ai/shisa-v2-llama3.1-405b
pipeline_tag: text-generation
---
Quantized w/ [llm-compressor](https://github.com/vllm-project/llm-compressor) using [shisa-ai/shisa-v2-sharegpt](https://huggingface.co/datasets/shisa-ai/shisa-v2-sharegpt) as the calibration set.

Original model: [shisa-ai/shisa-v2-llama3.1-405b](https://huggingface.co/shisa-ai/shisa-v2-llama3.1-405b)