Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qT3qm7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
dd734f6
T3qT3qm7-7B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
6 commits
MaziyarPanahi
2e140139e1f19ba8892c9dd06d386c559df591592cd844a9ba56cad6ecf59704
dd734f6
verified
about 1 year ago
.gitattributes
1.82 kB
2e140139e1f19ba8892c9dd06d386c559df591592cd844a9ba56cad6ecf59704
about 1 year ago
T3qT3qm7-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
4cb6b987a78ad0f7d4dc23e7319bfb8cf5d1c495abb5622a94de08bea664254e
about 1 year ago
T3qT3qm7-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
62f17f21210cb7ee1fd556d94402889ab9439a8dd55ff788e856513bec254792
about 1 year ago
T3qT3qm7-7B.Q2_K.gguf
Safe
2.72 GB
LFS
7ed977bf7856da6187b3d141d1b05f9ad30784029ee435fcab9d0ec2a1515292
about 1 year ago
T3qT3qm7-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
e15fea4a89eeb6e8fca58464df1f0a4faf73ad6cbcd03eb73b155b64f36af4e3
about 1 year ago
T3qT3qm7-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
2e140139e1f19ba8892c9dd06d386c559df591592cd844a9ba56cad6ecf59704
about 1 year ago
