Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qM7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
17b5fdf
T3qM7-7B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
12 commits
MaziyarPanahi
366e90eb272bcea01ab6eca95a7f77e2c9b603bf80c7266c66d364d7a6f940da
17b5fdf
verified
about 1 year ago
.gitattributes
Safe
2.14 kB
366e90eb272bcea01ab6eca95a7f77e2c9b603bf80c7266c66d364d7a6f940da
about 1 year ago
T3qM7-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
06d27a57ae4faa630d37db371ca496489e0b8f8cc8e7d3e6734058de1a9cdfbe
about 1 year ago
T3qM7-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
2f490240ad21a2c6c70a613bc948b028e44390d59f2b8a7a5eda169105c8ced5
about 1 year ago
T3qM7-7B.Q2_K.gguf
Safe
2.72 GB
LFS
1074a2f9a67ccbd1551a6661a8f3694678680ae838723c375dbca6db35b3a029
about 1 year ago
T3qM7-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
847fb60ae3fb601682e45a0c46a9df19f227ad08bae44ab6eb55ac18a5a86bdf
about 1 year ago
T3qM7-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
1763c1b38b13a0dda4c562eb7d4eb0fe6d2846436224cf6caff03013c1ca168d
about 1 year ago
T3qM7-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
7054f84fee3043ec6f033e788cc915039c85e99a6255d0159351c2bd6049b679
about 1 year ago
T3qM7-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
6fe53f5ba3ed946c33ef9b36ed2ae50a4b34df0a84141885baa964badbd002a0
about 1 year ago
T3qM7-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
896b8f7802fbf4695f33faa99d2f778978d7f3fa373862a3d50439abaf1caff5
about 1 year ago
T3qM7-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
80cd6f50b58a07ac6661637f03914790f88dec3bc58c372e9d72b9b6395df5a1
about 1 year ago
T3qM7-7B.Q5_K_S.gguf
Safe
5 GB
LFS
ca4d656a0d0350ee738b1c62cf6c89ff992b90836cddc9c2dcc183c2660ddb3f
about 1 year ago
T3qM7-7B.Q6_K.gguf
Safe
5.94 GB
LFS
366e90eb272bcea01ab6eca95a7f77e2c9b603bf80c7266c66d364d7a6f940da
about 1 year ago
