Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
compressed-tensors
leonardlin's picture
Create README.md
8c51ad5 verified
metadata
library_name: transformers
model_name: shisa-v2-llama3.1-405b-FP8-Dynamic
license: llama3.1
datasets:
  - shisa-ai/shisa-v2-sharegpt
  - shisa-ai/deepseekv3-ultrafeedback-armorm
language:
  - ja
  - en
  - ko
  - zh
base_model:
  - shisa-ai/shisa-v2-llama3.1-405b
pipeline_tag: text-generation

Quantized w/ llm-compressor using shisa-ai/shisa-v2-sharegpt as the calibration set.

Original model: shisa-ai/shisa-v2-llama3.1-405b