AWQ Quant of nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B

Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 128.

Safetensors

Model size

11.9B params

Tensor type

I32

BF16

F16

Model tree for ArtusDev/nbeerbower_EVA-abliterated-TIES-Qwen2.5-72B-AWQ

Base model

Quantized

(3)

this model