Quantize the weights to 4 bits using bitsandbytes from huihui-ai/Huihui-gemma-3n-E4B-it-abliterated

Downloads last month
20
Safetensors
Model size
7.85B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Qwe1325/Huihui-gemma-3n-E4B-it-abliterated-bnb-4bit

Quantized
(10)
this model