OPEA
/

Molmo-7B-D-0924-int4-sym-inc

4-bit precision

Model card Files Files and versions

cicdatopea commited on Apr 30

Commit

c6a8735

·

verified ·

1 Parent(s): bd2eeeb

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -43,7 +43,7 @@
     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": true,
-    "to_quant_block_names": "model.transformer.blocks"
   },
   "rope_theta": 1000000.0,
   "tie_word_embeddings": false,

     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": true,
+    "block_name_to_quantize": "model.transformer.blocks"
   },
   "rope_theta": 1000000.0,
   "tie_word_embeddings": false,