Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Lewdiculous
/
firefly-gemma-7b-GGUF-IQ-Imatrix
like
2
GGUF
gemma
quantized
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Use this model
2ec0189
firefly-gemma-7b-GGUF-IQ-Imatrix
1 contributor
History:
7 commits
Lewdiculous
Update README.md
2ec0189
verified
8 months ago
.gitattributes
Safe
2.74 kB
Upload 6 files
8 months ago
README.md
Safe
4.48 kB
Update README.md
8 months ago
firefly-gemma-7b-F16.gguf
Safe
17.1 GB
LFS
Upload 7 files
8 months ago
firefly-gemma-7b-IQ2_M-imatrix.gguf
Safe
3.13 GB
LFS
Upload 7 files
8 months ago
firefly-gemma-7b-IQ2_S-imatrix.gguf
Safe
2.92 GB
LFS
Upload 7 files
8 months ago
firefly-gemma-7b-IQ2_XS-imatrix.gguf
Safe
2.81 GB
LFS
Upload 7 files
8 months ago
firefly-gemma-7b-IQ2_XXS-imatrix.gguf
Safe
2.59 GB
LFS
Upload 7 files
8 months ago
firefly-gemma-7b-IQ3_M-imatrix.gguf
Safe
4.11 GB
LFS
Upload 6 files
8 months ago
firefly-gemma-7b-IQ3_S-imatrix.gguf
Safe
3.98 GB
LFS
Upload 6 files
8 months ago
firefly-gemma-7b-IQ3_XS-imatrix.gguf
Safe
3.8 GB
LFS
Upload 6 files
8 months ago
firefly-gemma-7b-IQ3_XXS-imatrix.gguf
Safe
3.49 GB
LFS
Upload 6 files
8 months ago
firefly-gemma-7b-IQ4_XS-imatrix.gguf
Safe
4.77 GB
LFS
Upload 5 files
8 months ago
firefly-gemma-7b-Q3_K_M-imatrix.gguf
Safe
4.37 GB
LFS
Upload 6 files
8 months ago
firefly-gemma-7b-Q4_K_S-imatrix.gguf
Safe
5.05 GB
LFS
Upload 5 files
8 months ago
firefly-gemma-7b-Q5_K_M-imatrix.gguf
Safe
6.14 GB
LFS
Upload 5 files
8 months ago
firefly-gemma-7b-Q5_K_S-imatrix.gguf
Safe
5.98 GB
LFS
Upload 5 files
8 months ago
firefly-gemma-7b-Q6_K-imatrix.gguf
Safe
7.01 GB
LFS
Upload 5 files
8 months ago
firefly-gemma-7b-Q8_0-imatrix.gguf
Safe
9.08 GB
LFS
Upload 6 files
8 months ago
imatrix-firefly-gemma-7b-F16.dat
Safe
4.94 MB
LFS
Upload 7 files
8 months ago
kalomaze's-groups_merged.txt
Safe
201 kB
Upload 7 files
8 months ago