Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Abliterated version of Qwen/Qwen2.5-72B-Instruct, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

Try harder to remove admonition and moral appeal

This model is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.

Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2

Base model

Qwen/Qwen2.5-72B
Quantized
(43)
this model