Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Ayla-Light-12B-v2-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
Ayla-Light-12B-v2-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
MaziyarPanahi
64f8c1b2924383b8a59d8830c3ae0ccb45ee30ce670367204c3264ab9fc1b526
f00379f
verified
3 months ago
.gitattributes
1.91 kB
64f8c1b2924383b8a59d8830c3ae0ccb45ee30ce670367204c3264ab9fc1b526
3 months ago
Ayla-Light-12B-v2-GGUF_imatrix.dat
7.05 MB
LFS
64f8c1b2924383b8a59d8830c3ae0ccb45ee30ce670367204c3264ab9fc1b526
3 months ago
Ayla-Light-12B-v2.Q5_K_M.gguf
8.73 GB
LFS
678f078fda15539f0cbb1b10c6de7d2f6bd9796717552710fcbbeb5d836963b4
3 months ago
Ayla-Light-12B-v2.Q5_K_S.gguf
8.52 GB
LFS
f7efa7ee4a3010fe42ac07dd0fd4e9dbe583165904ddf2dabf8933364f1778f0
3 months ago
Ayla-Light-12B-v2.Q6_K.gguf
10.1 GB
LFS
36d3e1e4bc0a4b0a3fe6f6a3d8aa4a1b58e67bf2a513d92848020d326e63bffa
3 months ago
Ayla-Light-12B-v2.Q8_0.gguf
13 GB
LFS
1151676bc177525b272c1968938d5e018bab6f8b4252637f1edeb2ab7ad3e041
3 months ago
Ayla-Light-12B-v2.fp16.gguf
24.5 GB
LFS
ff6a77a2ad2382890ace1c3041582c9522e0a0efcbf6c93c3c89403d14fc1b57
3 months ago
README.md
2.94 kB
64f8c1b2924383b8a59d8830c3ae0ccb45ee30ce670367204c3264ab9fc1b526
3 months ago
