cgus
/

DeepSeek-R1-Distill-Qwen-14B-exl2

4-bit precision

Model card Files Files and versions Community

cgus commited on Jan 22

Commit

2e1409c

·

verified ·

1 Parent(s): 6df5128

Upload config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -27,7 +27,7 @@
     "quantization_config": {
         "quant_method": "exl2",
         "version": "0.2.7",
-        "bits": 4.0,
         "head_bits": 6,
         "calibration": {
             "rows": 115,

     "quantization_config": {
         "quant_method": "exl2",
         "version": "0.2.7",
+        "bits": 6.0,
         "head_bits": 6,
         "calibration": {
             "rows": 115,