Static quantization of ToriiGate-v0.4-7B

File Notes

ToriiGate-v0.4-7B.Q8_0.gguf

Q8_0
Quantized from BF16

ToriiGate-v0.4-7B.mmproj-bf16.gguf

BF16
Native precision
Downloads last month
16
GGUF
Model size
8B params
Architecture
qwen2vl
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Valeciela/ToriiGate-v0.4-7B-Q8_0-GGUF

Base model

Qwen/Qwen2-VL-7B
Quantized
(7)
this model