The original model can be accessed at this link: https://huggingface.co/AIDC-AI/Ovis1.6-Gemma2-9B

The model was quantized to a 4-bit version using bitsandbytes.

Downloads last month
10
Safetensors
Model size
5.82B params
Tensor type
F32
FP16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for ThetaCursed/Ovis1.6-Gemma2-9B-bnb-4bit

Quantized
(2)
this model