Eren-Senoglu
/

llava-med-v1.5-mistral-7b-hf

Image-Text-to-Text

text-generation

Model card Files Files and versions

add head_dim

#1

by xk-huang - opened Jul 19

base: refs/heads/main

←

from: refs/pr/1

Discussion Files changed

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -14,7 +14,7 @@
       "MistralForCausalLM"
     ],
     "attention_dropout": 0.0,
-    "head_dim": null,
     "hidden_act": "silu",
     "hidden_size": 4096,
     "initializer_range": 0.02,

       "MistralForCausalLM"
     ],
     "attention_dropout": 0.0,
+    "head_dim": 128,
     "hidden_act": "silu",
     "hidden_size": 4096,
     "initializer_range": 0.02,