Abliterated version of Qwen/Qwen2.5-72B-Instruct, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

Downloads last month
587
GGUF
Model size
72.7B params
Architecture
qwen2

3-bit

4-bit

6-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for zetasepic/Qwen2.5-72B-Instruct-abliterated-GGUF

Base model

Qwen/Qwen2.5-72B
Quantized
(75)
this model