Hugging Face's logo

Daewon0808
/
prm800keval_qwen_lora

PEFT
Safetensors
Generated from Trainer
Model card Files
xet
Community

prm800keval_qwen_lora

This model is a fine-tuned version of Qwen/Qwen2.5-Math-7B-Instruct on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4388
  • Prm accuracy: 0.8675
  • Prm precision: 0.8413
  • Prm recall: 0.9815
  • Prm specificty: 0.6552
  • Prm npv: 0.95
  • Prm f1: 0.9060
  • Prm f1 neg: 0.7755
  • Prm f1 auc: 0.8844

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 2
  • eval_batch_size: 2
  • seed: 908932403
  • distributed_type: multi-GPU
  • num_devices: 8
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 32
  • total_eval_batch_size: 16
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: cosine
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 1

Training results

Training Loss Epoch Step Validation Loss Prm accuracy Prm precision Prm recall Prm specificty Prm npv Prm f1 Prm f1 neg Prm f1 auc
No log 0 0 0.9031 0.4940 0.6579 0.4630 0.5517 0.3556 0.5435 0.4324 0.5077
1.2883 0.0040 20 0.9037 0.4940 0.6579 0.4630 0.5517 0.3556 0.5435 0.4324 0.5077
1.1524 0.0080 40 0.8974 0.4940 0.6579 0.4630 0.5517 0.3556 0.5435 0.4324 0.5067
0.7294 0.0120 60 0.8764 0.5301 0.6744 0.5370 0.5172 0.375 0.5979 0.4348 0.5083
0.6833 0.0160 80 0.8383 0.5542 0.6604 0.6481 0.3793 0.3667 0.6542 0.3729 0.5083
0.8078 0.0200 100 0.8155 0.6506 0.6761 0.8889 0.2069 0.5 0.768 0.2927 0.5115
0.8976 0.0240 120 0.7952 0.6627 0.6806 0.9074 0.2069 0.5455 0.7778 0.3 0.5118
0.8938 0.0280 140 0.7749 0.6867 0.6944 0.9259 0.2414 0.6364 0.7937 0.35 0.5032
0.5947 0.0320 160 0.7227 0.7108 0.7206 0.9074 0.3448 0.6667 0.8033 0.4545 0.4965
0.7701 0.0361 180 0.7288 0.7108 0.7206 0.9074 0.3448 0.6667 0.8033 0.4545 0.5179
0.5089 0.0401 200 0.6864 0.7108 0.7206 0.9074 0.3448 0.6667 0.8033 0.4545 0.5287
0.5228 0.0441 220 0.6275 0.7108 0.7344 0.8704 0.4138 0.6316 0.7966 0.5 0.5329
0.5115 0.0481 240 0.6397 0.6867 0.7121 0.8704 0.3448 0.5882 0.7833 0.4348 0.5377
0.6867 0.0521 260 0.7298 0.6747 0.6753 0.9630 0.1379 0.6667 0.7939 0.2286 0.5431
0.4993 0.0561 280 0.6167 0.7229 0.7246 0.9259 0.3448 0.7143 0.8130 0.4651 0.5421
0.4695 0.0601 300 0.6883 0.7229 0.7123 0.9630 0.2759 0.8 0.8189 0.4103 0.5463
0.6154 0.0641 320 0.5743 0.7590 0.7576 0.9259 0.4483 0.7647 0.8333 0.5652 0.5463
0.415 0.0681 340 0.7099 0.7229 0.7183 0.9444 0.3103 0.75 0.816 0.4390 0.5658
0.5873 0.0721 360 0.6796 0.7349 0.7286 0.9444 0.3448 0.7692 0.8226 0.4762 0.5607
0.6415 0.0761 380 0.6328 0.7590 0.7429 0.9630 0.3793 0.8462 0.8387 0.5238 0.5476
0.4557 0.0801 400 0.5134 0.8434 0.8361 0.9444 0.6552 0.8636 0.8870 0.7451 0.5211
0.4276 0.0841 420 0.5272 0.8434 0.8361 0.9444 0.6552 0.8636 0.8870 0.7451 0.6149
0.6741 0.0881 440 0.6879 0.7711 0.7465 0.9815 0.3793 0.9167 0.848 0.5366 0.6861
0.3928 0.0921 460 0.6081 0.8072 0.7714 1.0 0.4483 1.0 0.8710 0.6190 0.6759
0.4151 0.0961 480 0.4305 0.8313 0.8448 0.9074 0.6897 0.8 0.875 0.7407 0.6402
0.3536 0.1002 500 0.4164 0.8434 0.8596 0.9074 0.7241 0.8077 0.8829 0.7636 0.6695
0.5806 0.1042 520 0.5095 0.8795 0.8438 1.0 0.6552 1.0 0.9153 0.7917 0.6309
0.7672 0.1082 540 0.4741 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.6392
0.3182 0.1122 560 0.4393 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.7168
0.4617 0.1162 580 0.4849 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.6954
0.3887 0.1202 600 0.4793 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.6603
0.4769 0.1242 620 0.4803 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.6383
0.333 0.1282 640 0.4383 0.8434 0.8361 0.9444 0.6552 0.8636 0.8870 0.7451 0.6261
0.5424 0.1322 660 0.4878 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.6370
0.6846 0.1362 680 0.5720 0.8313 0.8030 0.9815 0.5517 0.9412 0.8833 0.6957 0.6737
0.2907 0.1402 700 0.4201 0.8313 0.8226 0.9444 0.6207 0.8571 0.8793 0.72 0.7350
0.5914 0.1442 720 0.4610 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.7334
0.3916 0.1482 740 0.4434 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.7107
0.5391 0.1522 760 0.3638 0.8675 0.8909 0.9074 0.7931 0.8214 0.8991 0.8070 0.6459
0.4689 0.1562 780 0.3755 0.8675 0.8772 0.9259 0.7586 0.8462 0.9009 0.8 0.5840
0.3021 0.1602 800 0.3870 0.8313 0.8226 0.9444 0.6207 0.8571 0.8793 0.72 0.7002
0.3076 0.1642 820 0.3627 0.8554 0.8621 0.9259 0.7241 0.84 0.8929 0.7778 0.7637
0.5284 0.1683 840 0.3702 0.8795 0.9074 0.9074 0.8276 0.8276 0.9074 0.8276 0.7257
0.4397 0.1723 860 0.4523 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.7775
0.4129 0.1763 880 0.3841 0.8916 0.8689 0.9815 0.7241 0.9545 0.9217 0.8235 0.7899
0.5547 0.1803 900 0.3870 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.7494
0.3724 0.1843 920 0.4132 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.7685
0.4414 0.1883 940 0.4034 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.7902
0.2892 0.1923 960 0.4688 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8135
0.3067 0.1963 980 0.4609 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8209
0.2989 0.2003 1000 0.4377 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.7896
0.3089 0.2043 1020 0.3871 0.8554 0.875 0.9074 0.7586 0.8148 0.8909 0.7857 0.7928
0.2096 0.2083 1040 0.4127 0.9036 0.8833 0.9815 0.7586 0.9565 0.9298 0.8462 0.7985
0.3804 0.2123 1060 0.5072 0.8193 0.7910 0.9815 0.5172 0.9375 0.8760 0.6667 0.8126
0.5507 0.2163 1080 0.4363 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.7720
0.4174 0.2203 1100 0.4633 0.8313 0.8030 0.9815 0.5517 0.9412 0.8833 0.6957 0.7832
0.2566 0.2243 1120 0.4250 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.8052
0.3978 0.2283 1140 0.4768 0.8193 0.7910 0.9815 0.5172 0.9375 0.8760 0.6667 0.8388
0.3969 0.2323 1160 0.3790 0.8795 0.8793 0.9444 0.7586 0.88 0.9107 0.8148 0.8167
0.4321 0.2364 1180 0.4427 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.8065
0.3728 0.2404 1200 0.4507 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8250
0.3618 0.2444 1220 0.4237 0.8193 0.7910 0.9815 0.5172 0.9375 0.8760 0.6667 0.8432
0.4221 0.2484 1240 0.3726 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.8202
0.3878 0.2524 1260 0.5150 0.8193 0.7826 1.0 0.4828 1.0 0.8780 0.6512 0.7985
0.4642 0.2564 1280 0.4120 0.8193 0.7910 0.9815 0.5172 0.9375 0.8760 0.6667 0.7832
0.3381 0.2604 1300 0.4079 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.8091
0.4609 0.2644 1320 0.4191 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.8113
0.4112 0.2684 1340 0.3999 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.7928
0.3296 0.2724 1360 0.3748 0.8916 0.8814 0.9630 0.7586 0.9167 0.9204 0.8302 0.7941
0.2761 0.2764 1380 0.4620 0.8313 0.8030 0.9815 0.5517 0.9412 0.8833 0.6957 0.8180
0.2821 0.2804 1400 0.4101 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8116
0.4467 0.2844 1420 0.4157 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8311
0.3031 0.2884 1440 0.3918 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.8056
0.247 0.2924 1460 0.3989 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.7791
0.5016 0.2964 1480 0.4289 0.8313 0.8030 0.9815 0.5517 0.9412 0.8833 0.6957 0.7858
0.4987 0.3005 1500 0.4040 0.8313 0.8125 0.9630 0.5862 0.8947 0.8814 0.7083 0.7829
0.2891 0.3045 1520 0.3826 0.8434 0.8254 0.9630 0.6207 0.9 0.8889 0.7347 0.7848
0.293 0.3085 1540 0.3391 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.8126
0.4155 0.3125 1560 0.5249 0.8072 0.7714 1.0 0.4483 1.0 0.8710 0.6190 0.8471
0.4221 0.3165 1580 0.3196 0.9036 0.8966 0.9630 0.7931 0.92 0.9286 0.8519 0.8592
0.4662 0.3205 1600 0.3777 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8611
0.3024 0.3245 1620 0.4629 0.8193 0.7826 1.0 0.4828 1.0 0.8780 0.6512 0.8397
0.3639 0.3285 1640 0.3286 0.9157 0.9123 0.9630 0.8276 0.9231 0.9369 0.8727 0.8279
0.3307 0.3325 1660 0.3802 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8375
0.4623 0.3365 1680 0.3560 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8365
0.4875 0.3405 1700 0.4775 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8573
0.2345 0.3445 1720 0.4407 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8487
0.3247 0.3485 1740 0.3520 0.9036 0.8833 0.9815 0.7586 0.9565 0.9298 0.8462 0.8774
0.4873 0.3525 1760 0.4534 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8349
0.339 0.3565 1780 0.3771 0.8554 0.8387 0.9630 0.6552 0.9048 0.8966 0.76 0.8024
0.3834 0.3605 1800 0.4660 0.8313 0.7941 1.0 0.5172 1.0 0.8852 0.6818 0.8190
0.2915 0.3645 1820 0.3881 0.8554 0.8387 0.9630 0.6552 0.9048 0.8966 0.76 0.8263
0.6166 0.3686 1840 0.4657 0.8193 0.7910 0.9815 0.5172 0.9375 0.8760 0.6667 0.8068
0.4838 0.3726 1860 0.3681 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8036
0.4657 0.3766 1880 0.4089 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.7835
0.4501 0.3806 1900 0.4105 0.8434 0.8254 0.9630 0.6207 0.9 0.8889 0.7347 0.7931
0.3224 0.3846 1920 0.4092 0.8434 0.8254 0.9630 0.6207 0.9 0.8889 0.7347 0.7941
0.2305 0.3886 1940 0.4204 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8352
0.3151 0.3926 1960 0.4660 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8330
0.3787 0.3966 1980 0.5124 0.8313 0.7941 1.0 0.5172 1.0 0.8852 0.6818 0.8656
0.6283 0.4006 2000 0.4603 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8784
0.4044 0.4046 2020 0.3812 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8988
0.2399 0.4086 2040 0.4670 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8911
0.2474 0.4126 2060 0.4326 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8662
0.3843 0.4166 2080 0.4768 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8522
0.2923 0.4206 2100 0.4391 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8461
0.312 0.4246 2120 0.5964 0.8072 0.7714 1.0 0.4483 1.0 0.8710 0.6190 0.8439
0.3649 0.4286 2140 0.4273 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8659
0.4103 0.4326 2160 0.4991 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8598
0.3842 0.4367 2180 0.4052 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8519
0.36 0.4407 2200 0.4594 0.8554 0.8387 0.9630 0.6552 0.9048 0.8966 0.76 0.8199
0.363 0.4447 2220 0.3802 0.8675 0.8644 0.9444 0.7241 0.875 0.9027 0.7925 0.8269
0.3116 0.4487 2240 0.4593 0.8795 0.8438 1.0 0.6552 1.0 0.9153 0.7917 0.8365
0.4595 0.4527 2260 0.4104 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.8040
0.3984 0.4567 2280 0.5390 0.8193 0.7826 1.0 0.4828 1.0 0.8780 0.6512 0.7966
0.2215 0.4607 2300 0.4369 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.7934
0.5154 0.4647 2320 0.4723 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8145
0.3779 0.4687 2340 0.4398 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.7982
0.2479 0.4727 2360 0.4362 0.8313 0.8226 0.9444 0.6207 0.8571 0.8793 0.72 0.8282
0.3481 0.4767 2380 0.4969 0.8193 0.8 0.9630 0.5517 0.8889 0.8739 0.6809 0.8279
0.3153 0.4807 2400 0.4726 0.8313 0.8030 0.9815 0.5517 0.9412 0.8833 0.6957 0.8244
0.4298 0.4847 2420 0.4474 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8400
0.174 0.4887 2440 0.4762 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8372
0.4563 0.4927 2460 0.4218 0.8675 0.8525 0.9630 0.6897 0.9091 0.9043 0.7843 0.8324
0.3213 0.4967 2480 0.4909 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8519
0.2033 0.5008 2500 0.4507 0.8193 0.8095 0.9444 0.5862 0.85 0.8718 0.6939 0.8365
0.4639 0.5048 2520 0.5030 0.8193 0.8 0.9630 0.5517 0.8889 0.8739 0.6809 0.8439
0.3689 0.5088 2540 0.4541 0.8313 0.8226 0.9444 0.6207 0.8571 0.8793 0.72 0.8378
0.256 0.5128 2560 0.4385 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.8340
0.2772 0.5168 2580 0.4127 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.8333
0.4022 0.5208 2600 0.3925 0.8795 0.8793 0.9444 0.7586 0.88 0.9107 0.8148 0.8455
0.5802 0.5248 2620 0.4113 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.8627
0.3382 0.5288 2640 0.4564 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8758
0.5055 0.5328 2660 0.4202 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8755
0.2831 0.5368 2680 0.4510 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8656
0.2436 0.5408 2700 0.4555 0.8313 0.8125 0.9630 0.5862 0.8947 0.8814 0.7083 0.8579
0.3599 0.5448 2720 0.4113 0.8675 0.8644 0.9444 0.7241 0.875 0.9027 0.7925 0.8506
0.2546 0.5488 2740 0.4460 0.8313 0.8125 0.9630 0.5862 0.8947 0.8814 0.7083 0.8493
0.1984 0.5528 2760 0.4155 0.8795 0.8667 0.9630 0.7241 0.9130 0.9123 0.8077 0.8493
0.3205 0.5568 2780 0.4399 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8608
0.2424 0.5608 2800 0.4831 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8675
0.33 0.5648 2820 0.4177 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8493
0.4516 0.5689 2840 0.4200 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8547
0.2917 0.5729 2860 0.4399 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8592
0.2146 0.5769 2880 0.4361 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8633
0.401 0.5809 2900 0.4176 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8605
0.5318 0.5849 2920 0.3939 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.8550
0.6033 0.5889 2940 0.4036 0.8554 0.8387 0.9630 0.6552 0.9048 0.8966 0.76 0.8697
0.5108 0.5929 2960 0.4906 0.8434 0.8060 1.0 0.5517 1.0 0.8926 0.7111 0.8675
0.3439 0.5969 2980 0.4691 0.8434 0.8154 0.9815 0.5862 0.9444 0.8908 0.7234 0.8630
0.3314 0.6009 3000 0.3902 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.8630
0.1932 0.6049 3020 0.4649 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8611
0.2745 0.6089 3040 0.3967 0.8554 0.85 0.9444 0.6897 0.8696 0.8947 0.7692 0.8566
0.3382 0.6129 3060 0.4849 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8614
0.2525 0.6169 3080 0.4120 0.8916 0.8689 0.9815 0.7241 0.9545 0.9217 0.8235 0.8633
0.4468 0.6209 3100 0.4389 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8691
0.2046 0.6249 3120 0.4040 0.8795 0.8548 0.9815 0.6897 0.9524 0.9138 0.8 0.8707
0.2258 0.6289 3140 0.4150 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8729
0.3143 0.6329 3160 0.3929 0.8916 0.8814 0.9630 0.7586 0.9167 0.9204 0.8302 0.8761
0.2847 0.6370 3180 0.4687 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8838
0.2858 0.6410 3200 0.4126 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8867
0.4629 0.6450 3220 0.4697 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8953
0.5232 0.6490 3240 0.4333 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8914
0.4795 0.6530 3260 0.4384 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8940
0.4527 0.6570 3280 0.4311 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8997
0.4735 0.6610 3300 0.4535 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8930
0.2225 0.6650 3320 0.4591 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8918
0.2244 0.6690 3340 0.5006 0.8554 0.8182 1.0 0.5862 1.0 0.9 0.7391 0.8825
0.4231 0.6730 3360 0.4261 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8892
0.3491 0.6770 3380 0.4218 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8879
0.3298 0.6810 3400 0.4430 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8803
0.3845 0.6850 3420 0.4379 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8831
0.3771 0.6890 3440 0.4508 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8902
0.2274 0.6930 3460 0.4452 0.8795 0.8438 1.0 0.6552 1.0 0.9153 0.7917 0.8911
0.2564 0.6970 3480 0.4335 0.8795 0.8438 1.0 0.6552 1.0 0.9153 0.7917 0.8905
0.3972 0.7011 3500 0.4168 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8873
0.272 0.7051 3520 0.4696 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8867
0.2218 0.7091 3540 0.4582 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8870
0.2053 0.7131 3560 0.4369 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8966
0.5064 0.7171 3580 0.4183 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8927
0.4101 0.7211 3600 0.4354 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8953
0.5063 0.7251 3620 0.4206 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8835
0.2506 0.7291 3640 0.4267 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8876
0.585 0.7331 3660 0.4140 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8892
0.21 0.7371 3680 0.4329 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8857
0.5262 0.7411 3700 0.4695 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8956
0.5345 0.7451 3720 0.4494 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8940
0.5624 0.7491 3740 0.4251 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8847
0.2683 0.7531 3760 0.4436 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8863
0.3931 0.7571 3780 0.4411 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8886
0.3078 0.7611 3800 0.4278 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8863
0.3047 0.7651 3820 0.4183 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8857
0.2206 0.7692 3840 0.4196 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8953
0.3965 0.7732 3860 0.4508 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8905
0.2288 0.7772 3880 0.4297 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8873
0.2246 0.7812 3900 0.4305 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8934
0.2925 0.7852 3920 0.4287 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8927
0.2391 0.7892 3940 0.4188 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8914
0.5415 0.7932 3960 0.4443 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8902
0.3726 0.7972 3980 0.4344 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8886
0.1943 0.8012 4000 0.4301 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8857
0.4098 0.8052 4020 0.4344 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8854
0.1275 0.8092 4040 0.4369 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8841
0.2874 0.8132 4060 0.4461 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8911
0.2679 0.8172 4080 0.4447 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8863
0.3807 0.8212 4100 0.4408 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8927
0.2482 0.8252 4120 0.4421 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8895
0.436 0.8292 4140 0.4436 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8879
0.3668 0.8332 4160 0.4405 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8835
0.2697 0.8373 4180 0.4275 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8863
0.1993 0.8413 4200 0.4284 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8838
0.3895 0.8453 4220 0.4421 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8867
0.4151 0.8493 4240 0.4404 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8867
0.4336 0.8533 4260 0.4401 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8918
0.3609 0.8573 4280 0.4347 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8854
0.3905 0.8613 4300 0.4288 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8892
0.3131 0.8653 4320 0.4387 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8847
0.3842 0.8693 4340 0.4417 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8924
0.4715 0.8733 4360 0.4369 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8914
0.3951 0.8773 4380 0.4433 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8902
0.2645 0.8813 4400 0.4410 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8886
0.3875 0.8853 4420 0.4499 0.8554 0.8281 0.9815 0.6207 0.9474 0.8983 0.75 0.8921
0.5184 0.8893 4440 0.4467 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8940
0.4713 0.8933 4460 0.4441 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8943
0.259 0.8973 4480 0.4397 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8914
0.2879 0.9014 4500 0.4432 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8927
0.5289 0.9054 4520 0.4499 0.8795 0.8438 1.0 0.6552 1.0 0.9153 0.7917 0.8953
0.2335 0.9094 4540 0.4473 0.8675 0.8308 1.0 0.6207 1.0 0.9076 0.7660 0.8943
0.2248 0.9134 4560 0.4445 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8905
0.4024 0.9174 4580 0.4427 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8921
0.3856 0.9214 4600 0.4404 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8918
0.295 0.9254 4620 0.4367 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8918
0.3109 0.9294 4640 0.4389 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8930
0.2301 0.9334 4660 0.4395 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8930
0.3217 0.9374 4680 0.4386 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8911
0.3847 0.9414 4700 0.4406 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8898
0.218 0.9454 4720 0.4414 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8860
0.3361 0.9494 4740 0.4396 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8857
0.3383 0.9534 4760 0.4398 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8924
0.4341 0.9574 4780 0.4391 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8902
0.3864 0.9614 4800 0.4400 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8905
0.1534 0.9654 4820 0.4361 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8908
0.3314 0.9695 4840 0.4373 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8854
0.4314 0.9735 4860 0.4370 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8940
0.402 0.9775 4880 0.4381 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8902
0.2056 0.9815 4900 0.4377 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8895
0.3263 0.9855 4920 0.4378 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8902
0.3026 0.9895 4940 0.4391 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8905
0.2732 0.9935 4960 0.4376 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8886
0.2818 0.9975 4980 0.4388 0.8675 0.8413 0.9815 0.6552 0.95 0.9060 0.7755 0.8844

Framework versions

  • PEFT 0.12.0
  • Transformers 4.46.0
  • Pytorch 2.4.0+cu118
  • Datasets 3.0.0
  • Tokenizers 0.20.1
Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Daewon0808/prm800keval_qwen_lora

Base model

Qwen/Qwen2.5-7B
Finetuned
Qwen/Qwen2.5-Math-7B
Finetuned
Qwen/Qwen2.5-Math-7B-Instruct
Adapter
(309)
this model

Evaluation results

Metadata error: specify a dataset to view leaderboard