The original model can be accessed at this link: https://huggingface.co/AIDC-AI/Ovis1.6-Gemma2-9B

The model was quantized to a 4-bit version using bitsandbytes.

Downloads last month
14
Safetensors
Model size
5.82B params
Tensor type
F32
FP16
U8
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for ThetaCursed/Ovis1.6-Gemma2-9B-bnb-4bit

Quantized
(2)
this model