AWQ quantization of Steelskull/L3.3-MS-Nevoria-70b
"quantization_config": { "bits": 4, "group_size": 128, "modules_to_not_convert": null, "quant_method": "awq", "version": "gemm", "zero_point": true }
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support
Model tree for Sinensis/L3.3-MS-Nevoria-70b-AWQ
Base model
Steelskull/L3.3-MS-Nevoria-70b