Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-7B-Instruct-GGUF
like
9
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
8c3dbda
Qwen2.5-7B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
MaziyarPanahi
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
8c3dbda
verified
7 months ago
.gitattributes
1.73 kB
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
7 months ago
Qwen2.5-7B-Instruct-GGUF_imatrix.dat
4.54 MB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
7 months ago
Qwen2.5-7B-Instruct.IQ1_M.gguf
Safe
2.04 GB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
7 months ago
Qwen2.5-7B-Instruct.IQ2_XS.gguf
Safe
2.47 GB
LFS
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
7 months ago