metadata
base_model:
- sophosympatheia/StrawberryLemonade-L3-70B-v1.0
base_model_relation: quantized
quantized_by: frenzybiscuit
tags:
- awq
- 4-bit
StrawberryLemonade-L3-70B-v1.0
Released by Sophosympatheia
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64