nomic-ai
/

nomic-embed-text-v2-moe

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Model card Files Files and versions

zpn commited on Feb 15

Commit

11920f9

·

verified ·

1 Parent(s): 13dae9b

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -49,7 +49,7 @@
   "prenorm": false,
   "qkv_proj_bias": true,
   "reorder_and_upcast_attn": false,
-  "resid_pdrop": 0.1,
   "rotary_emb_base": 10000,
   "rotary_emb_fraction": 1.0,
   "rotary_emb_interleaved": false,

   "prenorm": false,
   "qkv_proj_bias": true,
   "reorder_and_upcast_attn": false,
+  "resid_pdrop": 0.0,
   "rotary_emb_base": 10000,
   "rotary_emb_fraction": 1.0,
   "rotary_emb_interleaved": false,