isogen's picture
Upload folder using huggingface_hub
0f27bea verified
metadata
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v1

EXL3 quantization of Josiefied-Qwen3-0.6B-abliterated-v1, 8 bits per weight, including output layers.

HumanEval (argmax)

Model Q4 Q6 Q8 FP16
Josiefied-Qwen3-0.6B-abliterated-v1-exl3-8bpw-h8 0.0% 34.8% 35.4% 34.8%
Qwen3-0.6B-exl3-8bpw-h8 0.0% 38.4% 40.9% 40.2%
Qwen3-0.6B-Base-exl3-8bpw-h8 0.0% 36.0% 37.2% 36.6%