ybelkada
/

mpt-7b-transformers

Text Generation

text-generation-inference

Model card Files Files and versions Community

ybelkada commited on Jul 10, 2023

Commit

9311958

·

1 Parent(s): 0a25285

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -78,7 +78,7 @@
     "typical_p": 1.0,
     "use_bfloat16": false
   },
-  "d_model": 2048,
   "emb_pdrop": 0.0,
   "embedding_fraction": 1.0,
   "expansion_ratio": 4,

     "typical_p": 1.0,
     "use_bfloat16": false
   },
+  "d_model": 4096,
   "emb_pdrop": 0.0,
   "embedding_fraction": 1.0,
   "expansion_ratio": 4,