Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TobDeBer
/
SmartQuant
like
0
GGUF
imatrix
conversational
License:
llama3.3
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
4885b4c
SmartQuant
27.2 GB
3 contributors
History:
12 commits
TobDeBer
Upload Tiny-Moe.Q6_K_T3.gguf with huggingface_hub
4885b4c
verified
2 months ago
.gitattributes
Safe
2.01 kB
Upload Tiny-Moe.Q6_K_T3.gguf with huggingface_hub
2 months ago
README.md
Safe
405 Bytes
Update README.md
6 months ago
SmartQuant-Falcon-H1-0.5B-Instruct.gguf
275 MB
xet
Upload SmartQuant-Falcon-H1-0.5B-Instruct.gguf with huggingface_hub
4 months ago
SmartQuant-Llama-3.3-70B-Instruct.gguf
Safe
21 GB
xet
Rename Llama-3.3-70B-Instruct-SmartQuant.gguf to SmartQuant-Llama-3.3-70B-Instruct.gguf
6 months ago
SmartQuant-granite-3.3-8b-instruct.gguf
Safe
5.84 GB
xet
Rename granite-3.3-8b-instruct-SmartQuant.gguf to SmartQuant-granite-3.3-8b-instruct.gguf
6 months ago
Tiny-Moe.Q6_K_T3.gguf
Safe
84.7 MB
xet
Upload Tiny-Moe.Q6_K_T3.gguf with huggingface_hub
2 months ago
calibration_datav3.txt
Safe
280 kB
add quantization tool
6 months ago
llama-quantize
Safe
2.78 MB
xet
add quantization tool
6 months ago
