Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubergarm
/
Qwen3-30B-A3B-Instruct-2507-GGUF
like
11
Text Generation
GGUF
imatrix
conversational
qwen3_moe
ik_llama.cpp
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Deploy
Use this model
main
Qwen3-30B-A3B-Instruct-2507-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
19 commits
ubergarm
add perplexity comparison with intel auto-round quant
de2a086
about 1 month ago
images
add perplexity comparison with intel auto-round quant
about 1 month ago
.gitattributes
Safe
1.65 kB
initial commit
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ1_KT.gguf
Safe
8.15 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ1_KT.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ2_KL.gguf
Safe
12.4 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ2_KL.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ2_KT.gguf
Safe
10.2 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ2_KT.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ3_K.gguf
Safe
15.6 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ3_K.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ3_KS.gguf
Safe
14.6 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ3_KS.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ4_K.gguf
Safe
19.2 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ4_K.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ4_KSS.gguf
Safe
16.7 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ4_KSS.gguf with huggingface_hub
about 1 month ago
Qwen3-30B-A3B-Instruct-2507-IQ5_K.gguf
Safe
22.9 GB
LFS
Upload Qwen3-30B-A3B-Instruct-2507-IQ5_K.gguf with huggingface_hub
about 1 month ago
README.md
14.8 kB
still testing vulkan backend added note
about 1 month ago
imatrix-eaddario-combined-all-medium-Qwen3-30B-A3B-Instruct-2507-BF16.dat
122 MB
LFS
Upload imatrix-eaddario-combined-all-medium-Qwen3-30B-A3B-Instruct-2507-BF16.dat with huggingface_hub
about 1 month ago
