---
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1
---

[EXL3](https://github.com/turboderp-org/exllamav3) quantization of [Josiefied-Qwen3-8B-abliterated-v1](https://huggingface.co/Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1), 4 bits per weight.

## HumanEval (argmax)

| Model                                                                                                                          | Q4   | Q6   | Q8   | FP16 |
| ------------------------------------------------------------------------------------------------------------------------------ | ---- | ---- | ---- | ---- |
| [Josiefied-Qwen3-8B-abliterated-v1-exl3-4bpw](https://huggingface.co/isogen/Josiefied-Qwen3-8B-abliterated-v1-exl3-4bpw)       | 84.1 | 85.4 | 86.0 | 85.4 |
| [Josiefied-Qwen3-8B-abliterated-v1-exl3-6bpw](https://huggingface.co/isogen/Josiefied-Qwen3-8B-abliterated-v1-exl3-6bpw)       | 86.6 | 85.4 | 86.0 | 85.4 |
| [Josiefied-Qwen3-8B-abliterated-v1-exl3-8bpw-h8](https://huggingface.co/isogen/Josiefied-Qwen3-8B-abliterated-v1-exl3-8bpw-h8) | 85.4 | 86.6 | 85.4 | 86.6 |
| [Qwen3-8B-exl3-4bpw](https://huggingface.co/turboderp/Qwen3-8B-exl3)                                                           | 86.0 | 85.4 | 86.0 | 87.2 |
| [Qwen3-8B-exl3-6bpw](https://huggingface.co/turboderp/Qwen3-8B-exl3)                                                           | 84.8 | 86.0 | 87.2 | 87.2 |
| [Qwen3-8B-exl3-8bpw-h8](https://huggingface.co/turboderp/Qwen3-8B-exl3)                                                        | 86.0 | 87.2 | 86.6 | 86.6 |