Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
StructLM-7B-GGUF
like
3
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
en
dataset:TIGER-Lab/SKGInstruct
arxiv:2402.16671
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
592b9b1
StructLM-7B-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
b56794709420ba19278832ecb1f50f8c04d275ba427b8acf43075bf952d05417
592b9b1
verified
9 months ago
.gitattributes
2 kB
b56794709420ba19278832ecb1f50f8c04d275ba427b8acf43075bf952d05417
9 months ago
StructLM-7B.Q2_K.gguf
2.53 GB
LFS
c825d097fba57b5568bded1108907b31405f038c13107faf4dcddb11a4573723
9 months ago
StructLM-7B.Q3_K_L.gguf
3.6 GB
LFS
c5b0ff3037f63666dd9e38ab1df6621263c93197331a8d30ac7d64f49f2d130f
9 months ago
StructLM-7B.Q3_K_M.gguf
3.3 GB
LFS
3630e7b130065a4ec03e16052bae20ffeaaef6543a6383cce009281128d92f3f
9 months ago
StructLM-7B.Q3_K_S.gguf
2.95 GB
LFS
f660410a0bed888b589a8d8407856a21df8b476047867b0d520d03e213d70d2f
9 months ago
StructLM-7B.Q4_K_M.gguf
4.08 GB
LFS
5cd63d4079a574303d973f023cdca5110b5685ad572c11e3109f174ab694fd0d
9 months ago
StructLM-7B.Q4_K_S.gguf
3.86 GB
LFS
43e1ee0e697a162496646ab43690e2bbb3dc76d21f80851fab0acbb8b271452f
9 months ago
StructLM-7B.Q5_K_M.gguf
4.78 GB
LFS
50c84056b7b5dccd334c0d45d98e564377ee86fed8daf309c16f7ff9952d0fa7
9 months ago
StructLM-7B.Q5_K_S.gguf
4.65 GB
LFS
b56794709420ba19278832ecb1f50f8c04d275ba427b8acf43075bf952d05417
9 months ago
