Training in progress, step 2000

README.md

@@ -1,6 +1,6 @@
 ---
-library_name: transformers
-tags: []
+base_model: unsloth/gemma-7b-it
+library_name: peft
 ---
 
 # Model Card for Model ID
@@ -15,7 +15,7 @@ tags: []
 
 <!-- Provide a longer summary of what this model is. -->
 
-This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
 
 - **Developed by:** [More Information Needed]
 - **Funded by [optional]:** [More Information Needed]
@@ -196,4 +196,7 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 
 ## Model Card Contact
 
-[More Information Needed]
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.13.2

adapter_config.json

@@ -20,13 +20,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
-    "v_proj",
+    "down_proj",
     "up_proj",
-    "k_proj",
+    "q_proj",
     "o_proj",
-    "down_proj",
-    "gate_proj"
+    "v_proj",
+    "gate_proj",
+    "k_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:79b9729475c1b18a5e4b5b1f6e96fc6c30dc926281cbc51537bee293fd111be7
+oid sha256:1b9cac774c3bc6e6e0ba319d3f684c3de74b73ce8a8e3aec2d2ef104f3b88f71
 size 800116456

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:338ccdbafe5a7ecf6acfde03c1c194ca80b5ce8898ca8b44e1f0fb2df9dc2191
+oid sha256:b31d7bd999250eadb225c5eef0013606097c2561c454aaa8c6827e46e0d5b2f6
 size 7096