NoorNizar
/

Llama-3.2-3B-Instruct-WINT8

Text Generation

text-generation-inference

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.2-3B-Instruct-WINT8 / tokenizer_config.json

Commit History

Upload 8-bit int quantized model via script

40de26b
verified

NoorNizar commited on Apr 21

Upload 8-bit quantized weights via llmcompressor script

8b9566a
verified

NoorNizar commited on Apr 20