tencent
/

Hunyuan-MT-7B-fp8

hunyuan_v1_dense

text-generation

compressed-tensors

Model card Files Files and versions

hhoh commited on 1 day ago

Commit

7f9009e

·

verified ·

1 Parent(s): 2318cc7

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
   "initializer_range": 0.02,
   "intermediate_size": 14336,
   "mask_init_id": 12,
-  "max_position_embeddings": 10240,
   "mlp_bias": false,
   "model_type": "hunyuan_v1_dense",
   "norm_type": "rms",

   "initializer_range": 0.02,
   "intermediate_size": 14336,
   "mask_init_id": 12,
+  "max_position_embeddings": 32768,
   "mlp_bias": false,
   "model_type": "hunyuan_v1_dense",
   "norm_type": "rms",