Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
StructLM-7B-GGUF
like
3
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
en
dataset:TIGER-Lab/SKGInstruct
arxiv:2402.16671
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
2af8a95
StructLM-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
b0a48bc9630c90c28df9d4ca150e15eaf25773612df254eecec1ff6db8e28c78
2af8a95
verified
7 months ago
.gitattributes
2.17 kB
b0a48bc9630c90c28df9d4ca150e15eaf25773612df254eecec1ff6db8e28c78
7 months ago
StructLM-7B.Q2_K.gguf
2.53 GB
LFS
c825d097fba57b5568bded1108907b31405f038c13107faf4dcddb11a4573723
7 months ago
StructLM-7B.Q3_K_L.gguf
3.6 GB
LFS
c5b0ff3037f63666dd9e38ab1df6621263c93197331a8d30ac7d64f49f2d130f
7 months ago
StructLM-7B.Q3_K_M.gguf
3.3 GB
LFS
3630e7b130065a4ec03e16052bae20ffeaaef6543a6383cce009281128d92f3f
7 months ago
StructLM-7B.Q3_K_S.gguf
2.95 GB
LFS
f660410a0bed888b589a8d8407856a21df8b476047867b0d520d03e213d70d2f
7 months ago
StructLM-7B.Q4_K_M.gguf
4.08 GB
LFS
5cd63d4079a574303d973f023cdca5110b5685ad572c11e3109f174ab694fd0d
7 months ago
StructLM-7B.Q4_K_S.gguf
3.86 GB
LFS
43e1ee0e697a162496646ab43690e2bbb3dc76d21f80851fab0acbb8b271452f
7 months ago
StructLM-7B.Q5_K_M.gguf
4.78 GB
LFS
50c84056b7b5dccd334c0d45d98e564377ee86fed8daf309c16f7ff9952d0fa7
7 months ago
StructLM-7B.Q5_K_S.gguf
4.65 GB
LFS
b56794709420ba19278832ecb1f50f8c04d275ba427b8acf43075bf952d05417
7 months ago
StructLM-7B.Q6_K.gguf
5.53 GB
LFS
9066d59f23c0190a584dd8a71c8092b71e6fa488869e3375b06577225030d15f
7 months ago
StructLM-7B.Q8_0.gguf
7.16 GB
LFS
b8125f52248460c7a348070b4763507b638064f2a08dd1c06ae4eb1af6bb3309
7 months ago
StructLM-7B.fp16.gguf
13.5 GB
LFS
b0a48bc9630c90c28df9d4ca150e15eaf25773612df254eecec1ff6db8e28c78
7 months ago
