4, 5, and 6 bit quants of nisten/zelensky-78b

use this as a commander model

no speculative decoding support

Downloads last month
53
GGUF
Model size
78B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for nisten/zelensky-78b-gguf

Base model

Qwen/Qwen2.5-72B
Quantized
(3)
this model