model: add fixed config and model sample

Files changed (3) hide show

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
   "max_position_embeddings": 32768,
   "model_type": "mistral",
   "num_attention_heads": 96,
-  "num_hidden_layers": 88,
   "num_key_value_heads": 8,
   "rms_norm_eps": 1e-05,
   "rope_theta": 1000000.0,

   "max_position_embeddings": 32768,
   "model_type": "mistral",
   "num_attention_heads": 96,
+  "num_hidden_layers": 157,
   "num_key_value_heads": 8,
   "rms_norm_eps": 1e-05,
   "rope_theta": 1000000.0,

model-00158-of-00158.safetensors ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:1c8013a4e4e727416606361fa0b3ac4d9bee32b9bfe517c590ab0411652a6831
+size 805331128

model.safetensors.index.json ADDED Viewed

The diff for this file is too large to render. See raw diff