Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
YamExperiment28-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
YamExperiment28-7B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
13 commits
MaziyarPanahi
9d11be24623f9bae473913f09c35f6d39cedbe2f4bd2d8ed14b17f0b7f591b14
b00f8fc
verified
about 1 year ago
.gitattributes
Safe
2.25 kB
5b786b795ffc4f2b558beeb2481f2abd9ff98fea4b37c1c8c700275868381677
about 1 year ago
README.md
Safe
10.9 kB
9d11be24623f9bae473913f09c35f6d39cedbe2f4bd2d8ed14b17f0b7f591b14
about 1 year ago
YamExperiment28-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
bcf3a1cd04714a015604b8ed0879213e9a5ee188900bc95ecc4e56bdbf21a7d1
about 1 year ago
YamExperiment28-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
67d1386ccc559c2ed077409bfc10b9b425ddcd71904dcd3c1deb32937ac604fa
about 1 year ago
YamExperiment28-7B.Q2_K.gguf
Safe
2.72 GB
LFS
abe3d9c79cc983b3b2d562b4453a55519a985faf96c71f3c45797e806788e081
about 1 year ago
YamExperiment28-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
c1ffcea16f99a9c6d2e55da3f96c74d6c2603b240856a23c88c1e0032fbe646a
about 1 year ago
YamExperiment28-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
a54e5f3f14c080f61207c1b9d9ea60ad783fbef4e83efb6e7c90d5e00b73e7f5
about 1 year ago
YamExperiment28-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
60bb727e53972b0927e5f065222fb92dac1c3e0464c95bbb17d8dbc0083426cc
about 1 year ago
YamExperiment28-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
fd762ee6c51c752f6301cdd6e1d47ad917fba2fe152b96baf107d18923063e42
about 1 year ago
YamExperiment28-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
ec0a9432ccb1742088850e0c90de277c5d671682de88946511ecc640223bbf05
about 1 year ago
YamExperiment28-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
a650bb62f36693a18cd81fbf2fbb59bca885afba778eefc8f375ae08e6b4b539
about 1 year ago
YamExperiment28-7B.Q5_K_S.gguf
Safe
5 GB
LFS
60b34013ca9e360dbc9eadb6cc8c541b17be47ad96e4edcb3b7cde8d69fde7ae
about 1 year ago
YamExperiment28-7B.Q6_K.gguf
Safe
5.94 GB
LFS
5b786b795ffc4f2b558beeb2481f2abd9ff98fea4b37c1c8c700275868381677
about 1 year ago