Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
matrixportal
/
Gemmasutra-Small-4B-v1-GGUF
like
0
Text Generation
GGUF
Gemmasutra-Small-4B-v1
llama.cpp
quantized
conversational
License:
other
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Gemmasutra-Small-4B-v1-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
39 commits
matrixportal
Delete README.md.bak
7f02795
verified
about 2 months ago
.gitattributes
3.06 kB
Upload gemmasutra-small-4b-v1.q4_k_s.gguf with huggingface_hub
about 2 months ago
README.md
2.71 kB
Update README with 8 models (20250409-164721)
about 2 months ago
gemmasutra-small-4b-v1.f16.gguf
7.73 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.fp16.gguf
7.73 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q2-k.gguf
1.69 GB
xet
Upload gemmasutra-small-4b-v1.q2-k.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q2_k.gguf
1.69 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3-k-l.gguf
2.2 GB
xet
Upload gemmasutra-small-4b-v1.q3-k-l.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3-k-m.gguf
2.06 GB
xet
Upload gemmasutra-small-4b-v1.q3-k-m.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3-k-s.gguf
1.9 GB
xet
Upload gemmasutra-small-4b-v1.q3-k-s.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3_k_l.gguf
2.2 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3_k_m.gguf
2.06 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q3_k_s.gguf
1.9 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4-0.gguf
Safe
2.33 GB
xet
Upload gemmasutra-small-4b-v1.q4-0.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4-k-m.gguf
Safe
2.46 GB
xet
Upload gemmasutra-small-4b-v1.q4-k-m.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4-k-s.gguf
Safe
2.35 GB
xet
Upload gemmasutra-small-4b-v1.q4-k-s.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4_0.gguf
Safe
2.33 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4_k_m.gguf
Safe
2.46 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q4_k_s.gguf
Safe
2.35 GB
xet
Upload gemmasutra-small-4b-v1.q4_k_s.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q5-k-m.gguf
Safe
2.81 GB
xet
Upload gemmasutra-small-4b-v1.q5-k-m.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q5_k_m.gguf
Safe
2.81 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q6-k.gguf
3.17 GB
xet
Upload gemmasutra-small-4b-v1.q6-k.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q6_k.gguf
3.17 GB
xet
Upload folder using huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q8-0.gguf
4.11 GB
xet
Upload gemmasutra-small-4b-v1.q8-0.gguf with huggingface_hub
about 2 months ago
gemmasutra-small-4b-v1.q8_0.gguf
4.11 GB
xet
Upload folder using huggingface_hub
about 2 months ago