Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
xmadai
/
Llama-3.2-3B-Instruct-xMADai-INT4
like
6
Follow
xMAD.ai
14
Text Generation
Transformers
llama
conversational
Inference Endpoints
4-bit precision
gptq
License:
llama3.2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.2-3B-Instruct-xMADai-INT4
2 contributors
History:
11 commits
onebitquantized
Upload of AutoGPTQ quantized model
04ea4b7
verified
20 days ago
.gitattributes
Safe
1.52 kB
initial commit
28 days ago
README.md
Safe
3.33 kB
Upload of AutoGPTQ quantized model
20 days ago
config.json
Safe
1.29 kB
Upload of AutoGPTQ quantized model
20 days ago
gptq_model-4bit--1g.safetensors
Safe
2.99 GB
LFS
Upload of AutoGPTQ quantized model
28 days ago
gptq_model-4bit-128g.safetensors
Safe
3.04 GB
LFS
Upload of AutoGPTQ quantized model
20 days ago
quantize_config.json
Safe
312 Bytes
Upload of AutoGPTQ quantized model
20 days ago
special_tokens_map.json
Safe
296 Bytes
Upload tokenizer
28 days ago
tokenizer.json
Safe
9.09 MB
Upload tokenizer
28 days ago
tokenizer_config.json
Safe
54.6 kB
Upload tokenizer
28 days ago