metadata
base_model:
- ReadyArt/Broken-Tutu-24B-Transgression-v2.0
base_model_relation: quantized
quantized_by: frenzybiscuit
tags:
- awq
- 4-bit
Broken Tutu 24B Transgression v2.0
Released by ReadyArt
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64