End of training

README.md

@@ -95,7 +95,7 @@ xformers_attention: true
 
 This model is a fine-tuned version of [peft-internal-testing/tiny-dummy-qwen2](https://huggingface.co/peft-internal-testing/tiny-dummy-qwen2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 11.9305
+- Loss: 11.9307
 
 ## Model description
 
@@ -133,8 +133,8 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 11.9314       | 0.0009 | 1    | 11.9316         |
-| 11.9265       | 0.0221 | 25   | 11.9308         |
-| 11.9277       | 0.0442 | 50   | 11.9305         |
+| 11.9266       | 0.0221 | 25   | 11.9309         |
+| 11.9282       | 0.0442 | 50   | 11.9307         |
 
 
 ### Framework versions

adapter_config.json

@@ -20,11 +20,11 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "k_proj",
     "v_proj",
-    "down_proj",
-    "o_proj",
     "q_proj",
-    "k_proj",
+    "o_proj",
+    "down_proj",
     "up_proj",
     "gate_proj"
   ],

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:30045b4a1c7bba513667889e6ddadfca3e589657436c2a73e551ef44de75e8f7
+oid sha256:c546a929dd0cfb01006cbd5e7618ed5d9a703a68d7463c9cd02df8c87f082914
 size 55170

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dc53c144558ee904873659330389a0945b7e7b5e498309a90bcd1648852f9e6d
+oid sha256:e5f3f6dfe09555a9918947eae02e1bee9477e06d5c745fa0e77cbbfe9c669525
 size 48552

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:34dd7bd0811ed6d68d82cf0b98d7b29f79f74683cfc455f458407a01e3eb2776
+oid sha256:108c5f3f22adcc9d16d2953e63cd5d58fc20f404970f68f6bcd270a66e117481
 size 6776