--- library_name: transformers model_name: shisa-v2-llama3.1-405b-FP8-Dynamic license: llama3.1 datasets: - shisa-ai/shisa-v2-sharegpt - shisa-ai/deepseekv3-ultrafeedback-armorm language: - ja - en - ko - zh base_model: - shisa-ai/shisa-v2-llama3.1-405b pipeline_tag: text-generation --- Quantized w/ [llm-compressor](https://github.com/vllm-project/llm-compressor) using [shisa-ai/shisa-v2-sharegpt](https://huggingface.co/datasets/shisa-ai/shisa-v2-sharegpt) as the calibration set. Original model: [shisa-ai/shisa-v2-llama3.1-405b](https://huggingface.co/shisa-ai/shisa-v2-llama3.1-405b)