ai-sage
/

Giga-Retrieval-instruct

Feature Extraction

Model card Files Files and versions Community

ekolodin commited on about 1 month ago

Commit

19645f0

·

verified ·

1 Parent(s): 16b574b

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -70,7 +70,7 @@
     "length_penalty": 1.0,
     "loss_inplace_backward": true,
     "max_length": 20,
-    "max_position_embeddings": 32768,
     "max_window_layers": 36,
     "min_length": 0,
     "mlp_bias": false,

     "length_penalty": 1.0,
     "loss_inplace_backward": true,
     "max_length": 20,
+    "max_position_embeddings": 4096,
     "max_window_layers": 36,
     "min_length": 0,
     "mlp_bias": false,