Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
StructLM-7B-GGUF
like
3
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
en
dataset:TIGER-Lab/SKGInstruct
arxiv:2402.16671
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
1d0d74a
StructLM-7B-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
5cd63d4079a574303d973f023cdca5110b5685ad572c11e3109f174ab694fd0d
1d0d74a
verified
9 months ago
.gitattributes
1.82 kB
5cd63d4079a574303d973f023cdca5110b5685ad572c11e3109f174ab694fd0d
9 months ago
StructLM-7B.Q2_K.gguf
2.53 GB
LFS
c825d097fba57b5568bded1108907b31405f038c13107faf4dcddb11a4573723
9 months ago
StructLM-7B.Q3_K_L.gguf
3.6 GB
LFS
c5b0ff3037f63666dd9e38ab1df6621263c93197331a8d30ac7d64f49f2d130f
9 months ago
StructLM-7B.Q3_K_M.gguf
3.3 GB
LFS
3630e7b130065a4ec03e16052bae20ffeaaef6543a6383cce009281128d92f3f
9 months ago
StructLM-7B.Q3_K_S.gguf
2.95 GB
LFS
f660410a0bed888b589a8d8407856a21df8b476047867b0d520d03e213d70d2f
9 months ago
StructLM-7B.Q4_K_M.gguf
4.08 GB
LFS
5cd63d4079a574303d973f023cdca5110b5685ad572c11e3109f174ab694fd0d
9 months ago
