Writer
/

bdiff-test

melisa commited on 13 days ago

Commit

d7a0c42

verified ·

1 Parent(s): a15bca6

Update config_diff_qwen-0-5b.json

Files changed (1) hide show

config_diff_qwen-0-5b.json CHANGED Viewed

@@ -25,5 +25,6 @@
       "use_mrope": false,
       "use_sliding_window": false,
       "vocab_size": 151936,
-      "lowrank_dim": 128
   }

       "use_mrope": false,
       "use_sliding_window": false,
       "vocab_size": 151936,
+      "lowrank_dim": 128,
+      "roll_negative_heads": false
   }