|
|
--- |
|
|
library_name: transformers |
|
|
model_name: shisa-v2-llama3.1-405b-W8A8-INT8 |
|
|
license: llama3.1 |
|
|
datasets: |
|
|
- shisa-ai/shisa-v2-sharegpt |
|
|
- shisa-ai/deepseekv3-ultrafeedback-armorm |
|
|
language: |
|
|
- ja |
|
|
- en |
|
|
- ko |
|
|
- zh |
|
|
base_model: |
|
|
- shisa-ai/shisa-v2-llama3.1-405b |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
Quantized w/ [llm-compressor](https://github.com/vllm-project/llm-compressor) using [shisa-ai/shisa-v2-sharegpt](https://huggingface.co/datasets/shisa-ai/shisa-v2-sharegpt) as the calibration set. |
|
|
|
|
|
Original model: [shisa-ai/shisa-v2-llama3.1-405b](https://huggingface.co/shisa-ai/shisa-v2-llama3.1-405b) |
