4, 5, and 6 bit quants of nisten/zelensky-78b

use this as a commander model

no speculative decoding support

Downloads last month
195
GGUF
Model size
78B params
Architecture
qwen2

16-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for nisten/zelensky-78b-gguf

Base model

Qwen/Qwen2.5-72B
Quantized
(1)
this model