Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
EXAONE-3.5-7.8B-Instruct-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
bfa466a
EXAONE-3.5-7.8B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
MaziyarPanahi
4bfea6dbfbdcf739d448a8c8fc2a95c1c35429f4dcccf9175606f61319156c15
bfa466a
verified
9 months ago
.gitattributes
2.17 kB
4bfea6dbfbdcf739d448a8c8fc2a95c1c35429f4dcccf9175606f61319156c15
9 months ago
EXAONE-3.5-7.8B-Instruct.Q2_K.gguf
3.05 GB
LFS
373623a125b385a844c03dc257ce00bb441f0fece7787193c9d4fc2c419c9e22
9 months ago
EXAONE-3.5-7.8B-Instruct.Q3_K_L.gguf
4.19 GB
LFS
db9150ba097bbdc59677f7a7d1723f9c38741d28b802201f834f64bb20f8af73
9 months ago
EXAONE-3.5-7.8B-Instruct.Q3_K_M.gguf
3.88 GB
LFS
62dceac34acff662d462858fefc66076b2bb12a56124adb9c85c5d29fc4b487d
9 months ago
EXAONE-3.5-7.8B-Instruct.Q3_K_S.gguf
3.53 GB
LFS
1c0d22f9573b9b669047af38c974dde4cd6560f5a8c88101626db598eded03a5
9 months ago
EXAONE-3.5-7.8B-Instruct.Q4_K_M.gguf
4.77 GB
LFS
3d906b19ca13582241da4ee8b49ad11a2d561aa5240953341753c2b2f3fb94ff
9 months ago
EXAONE-3.5-7.8B-Instruct.Q4_K_S.gguf
4.54 GB
LFS
88f22d32286de2c699a6d956bda0e2471d3a4ae33e11e43b24424685b0cdb605
9 months ago
EXAONE-3.5-7.8B-Instruct.Q5_K_M.gguf
5.57 GB
LFS
a556703249746ecbd1ba78e3ba2cb0f4e61d9740d3a2b789c7d7d464ac3301ec
9 months ago
EXAONE-3.5-7.8B-Instruct.Q5_K_S.gguf
5.44 GB
LFS
b46a9e99eaded32151659ebe7381bb257e5104d38878bbfc75a6191397036460
9 months ago
EXAONE-3.5-7.8B-Instruct.Q6_K.gguf
6.42 GB
LFS
4bfea6dbfbdcf739d448a8c8fc2a95c1c35429f4dcccf9175606f61319156c15
9 months ago
