Sinensis
/

Harbinger-24B-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

FP8-Dynamic (llmcompressor oneshot) quant of LatitudeGames/Harbinger-24B

Downloads last month: 8

Safetensors

Model size

23.6B params

Tensor type

BF16

·

F8_E4M3

·

Model tree for Sinensis/Harbinger-24B-FP8-Dynamic

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503

Finetuned

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Finetuned

LatitudeGames/Harbinger-24B

Quantized

(24)

this model