AWQ quantization of Steelskull/L3.3-Electra-R1-70b

"quantization_config": { "bits": 4, "group_size": 128, "modules_to_not_convert": null, "quant_method": "awq", "version": "gemm", "zero_point": true }

Downloads last month
3
Safetensors
Model size
11.3B params
Tensor type
I32
BF16
FP16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Sinensis/L3.3-Electra-R1-70b-AWQ