v7_onlyaugs800k_llama_lora

This model is a fine-tuned version of Daewon0808/prm800k_llama_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.7421
• Prm accuracy: 0.8585
• Prm precision: 0.8542
• Prm recall: 0.9880
• Prm specificty: 0.3913
• Prm npv: 0.9
• Prm f1: 0.9162
• Prm f1 neg: 0.5455
• Prm f1 auc: 0.6896
• Prm f1 auc (fixed): 0.8764

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 2
• eval_batch_size: 4
• seed: 908932403
• distributed_type: multi-GPU
• num_devices: 8
• gradient_accumulation_steps: 4
• total_train_batch_size: 64
• total_eval_batch_size: 32
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc	Prm f1 auc (fixed)
No log	0	0	0.3310	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8882
0.3047	0.0034	5	0.3311	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8884
0.4606	0.0068	10	0.3322	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8879
0.286	0.0103	15	0.3358	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8855
0.3772	0.0137	20	0.3360	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8863
0.3027	0.0171	25	0.3531	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8858
0.286	0.0205	30	0.3754	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.8811
0.2655	0.0239	35	0.3708	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8803
0.2527	0.0273	40	0.3488	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8745
0.2438	0.0308	45	0.3333	0.8208	0.8902	0.8795	0.6087	0.5833	0.8848	0.5957	0.7441	0.8693
0.2004	0.0342	50	0.3444	0.8208	0.8902	0.8795	0.6087	0.5833	0.8848	0.5957	0.7441	0.8638
0.1488	0.0376	55	0.3503	0.8208	0.8902	0.8795	0.6087	0.5833	0.8848	0.5957	0.7441	0.8667
0.3164	0.0410	60	0.3831	0.8302	0.8824	0.9036	0.5652	0.6190	0.8929	0.5909	0.7344	0.8717
0.0904	0.0444	65	0.3784	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8811
0.1637	0.0478	70	0.3934	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8790
0.1695	0.0513	75	0.4358	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8787
0.1636	0.0547	80	0.3949	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8774
0.1476	0.0581	85	0.3867	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8850
0.1489	0.0615	90	0.4466	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8829
0.1618	0.0649	95	0.3740	0.8302	0.8824	0.9036	0.5652	0.6190	0.8929	0.5909	0.7344	0.8748
0.1273	0.0684	100	0.4023	0.8302	0.8824	0.9036	0.5652	0.6190	0.8929	0.5909	0.7344	0.8701
0.0904	0.0718	105	0.4350	0.8113	0.8621	0.9036	0.4783	0.5789	0.8824	0.5238	0.6909	0.8677
0.2435	0.0752	110	0.3726	0.8302	0.8824	0.9036	0.5652	0.6190	0.8929	0.5909	0.7344	0.8601
0.1942	0.0786	115	0.3985	0.8208	0.8721	0.9036	0.5217	0.6	0.8876	0.5581	0.7127	0.8609
0.1095	0.0820	120	0.4085	0.8208	0.8721	0.9036	0.5217	0.6	0.8876	0.5581	0.7127	0.8664
0.1453	0.0854	125	0.3609	0.8208	0.8810	0.8916	0.5652	0.5909	0.8862	0.5778	0.7284	0.8664
0.0727	0.0889	130	0.3872	0.8208	0.8721	0.9036	0.5217	0.6	0.8876	0.5581	0.7127	0.8730
0.0675	0.0923	135	0.4686	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8777
0.0944	0.0957	140	0.4060	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8821
0.1039	0.0991	145	0.3940	0.8302	0.8736	0.9157	0.5217	0.6316	0.8941	0.5714	0.7187	0.8782
0.1686	0.1025	150	0.4301	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.8719
0.2349	0.1059	155	0.4113	0.8302	0.8736	0.9157	0.5217	0.6316	0.8941	0.5714	0.7187	0.8612
0.1013	0.1094	160	0.4580	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.8672
0.1596	0.1128	165	0.4551	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8761
0.1019	0.1162	170	0.3867	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.8829
0.0961	0.1196	175	0.4175	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.8756
0.0854	0.1230	180	0.5206	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8900
0.1176	0.1265	185	0.4292	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8913
0.1388	0.1299	190	0.4188	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.8821
0.1331	0.1333	195	0.4987	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8842
0.1323	0.1367	200	0.5469	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8837
0.0761	0.1401	205	0.4361	0.8302	0.8571	0.9398	0.4348	0.6667	0.8966	0.5263	0.6873	0.8819
0.1126	0.1435	210	0.3948	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.8798
0.1166	0.1470	215	0.4283	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8827
0.0923	0.1504	220	0.4840	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8706
0.0841	0.1538	225	0.5191	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8724
0.1104	0.1572	230	0.6394	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8709
0.0894	0.1606	235	0.4392	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8787
0.1124	0.1640	240	0.4610	0.8396	0.8511	0.9639	0.3913	0.75	0.9040	0.5143	0.6776	0.8777
0.1425	0.1675	245	0.4917	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8662
0.1399	0.1709	250	0.4197	0.8019	0.8523	0.9036	0.4348	0.5556	0.8772	0.4878	0.6692	0.8559
0.0903	0.1743	255	0.4612	0.8113	0.8539	0.9157	0.4348	0.5882	0.8837	0.5	0.6752	0.8510
0.0781	0.1777	260	0.5636	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8596
0.1473	0.1811	265	0.4658	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8803
0.1972	0.1846	270	0.3861	0.8208	0.8556	0.9277	0.4348	0.625	0.8902	0.5128	0.6812	0.8722
0.0671	0.1880	275	0.5289	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8782
0.0925	0.1914	280	0.5614	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8724
0.1337	0.1948	285	0.4754	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.8688
0.1818	0.1982	290	0.5275	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8774
0.1782	0.2016	295	0.4674	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8740
0.11	0.2051	300	0.4573	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8779
0.049	0.2085	305	0.4794	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8759
0.1203	0.2119	310	0.4807	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8832
0.0426	0.2153	315	0.4546	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8811
0.0574	0.2187	320	0.4260	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8706
0.1269	0.2221	325	0.4567	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8633
0.0974	0.2256	330	0.5057	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.8541
0.1406	0.2290	335	0.5598	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8604
0.0397	0.2324	340	0.5421	0.8302	0.8571	0.9398	0.4348	0.6667	0.8966	0.5263	0.6873	0.8575
0.0535	0.2358	345	0.5430	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8552
0.0849	0.2392	350	0.6316	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8659
0.0806	0.2427	355	0.6025	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8756
0.1188	0.2461	360	0.4695	0.8113	0.8316	0.9518	0.3043	0.6364	0.8876	0.4118	0.6281	0.8730
0.1327	0.2495	365	0.4782	0.8208	0.8333	0.9639	0.3043	0.7	0.8939	0.4242	0.6341	0.8803
0.0493	0.2529	370	0.4984	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8884
0.0551	0.2563	375	0.5787	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8782
0.1343	0.2597	380	0.6094	0.8208	0.8333	0.9639	0.3043	0.7	0.8939	0.4242	0.6341	0.8722
0.0989	0.2632	385	0.5283	0.8302	0.8571	0.9398	0.4348	0.6667	0.8966	0.5263	0.6873	0.8656
0.0591	0.2666	390	0.4828	0.8302	0.8571	0.9398	0.4348	0.6667	0.8966	0.5263	0.6873	0.8717
0.1244	0.2700	395	0.5355	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8782
0.058	0.2734	400	0.5811	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8777
0.1357	0.2768	405	0.5588	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8717
0.0932	0.2802	410	0.5477	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8727
0.145	0.2837	415	0.5606	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8774
0.1001	0.2871	420	0.5436	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8858
0.0567	0.2905	425	0.4719	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8834
0.0592	0.2939	430	0.5934	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8840
0.139	0.2973	435	0.5495	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.8698
0.1031	0.3008	440	0.5134	0.8113	0.8387	0.9398	0.3478	0.6154	0.8864	0.4444	0.6438	0.8635
0.1501	0.3042	445	0.6131	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8732
0.0729	0.3076	450	0.6283	0.7925	0.8144	0.9518	0.2174	0.5556	0.8778	0.3125	0.5846	0.8727
0.1346	0.3110	455	0.6885	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8845
0.1733	0.3144	460	0.5625	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8795
0.0809	0.3178	465	0.4548	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8751
0.0509	0.3213	470	0.5571	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8842
0.063	0.3247	475	0.5680	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8876
0.0289	0.3281	480	0.5248	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8882
0.0895	0.3315	485	0.6036	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8944
0.0901	0.3349	490	0.5205	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8971
0.0203	0.3383	495	0.4117	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8931
0.0784	0.3418	500	0.4453	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.9020
0.1178	0.3452	505	0.4341	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.9013
0.1051	0.3486	510	0.4122	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.9013
0.0705	0.3520	515	0.4643	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8976
0.0677	0.3554	520	0.5266	0.8208	0.8333	0.9639	0.3043	0.7	0.8939	0.4242	0.6341	0.8929
0.0583	0.3589	525	0.5269	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8876
0.0869	0.3623	530	0.6354	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8921
0.1229	0.3657	535	0.5939	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8939
0.0806	0.3691	540	0.6530	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8960
0.0552	0.3725	545	0.6961	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8968
0.0653	0.3759	550	0.6764	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8908
0.142	0.3794	555	0.5897	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8811
0.0371	0.3828	560	0.5902	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8759
0.0785	0.3862	565	0.5875	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8745
0.0752	0.3896	570	0.5983	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8779
0.0953	0.3930	575	0.6039	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.8743
0.047	0.3964	580	0.6740	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8753
0.1296	0.3999	585	0.7777	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8756
0.0698	0.4033	590	0.7082	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8769
0.122	0.4067	595	0.6492	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8782
0.0535	0.4101	600	0.6460	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8863
0.1596	0.4135	605	0.7507	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8929
0.065	0.4170	610	0.6561	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8958
0.0563	0.4204	615	0.6423	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8889
0.0408	0.4238	620	0.6456	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8861
0.0407	0.4272	625	0.6552	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8853
0.0652	0.4306	630	0.6272	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8861
0.0886	0.4340	635	0.5521	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8882
0.1189	0.4375	640	0.5524	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8913
0.0362	0.4409	645	0.5443	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8971
0.1589	0.4443	650	0.5366	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8960
0.0671	0.4477	655	0.5002	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8937
0.1053	0.4511	660	0.5138	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8931
0.0535	0.4545	665	0.5496	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8989
0.0536	0.4580	670	0.5594	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.9057
0.0733	0.4614	675	0.5836	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.9057
0.0554	0.4648	680	0.4974	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.9015
0.0922	0.4682	685	0.5055	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.9015
0.0485	0.4716	690	0.6065	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.9023
0.0623	0.4751	695	0.6448	0.8208	0.8333	0.9639	0.3043	0.7	0.8939	0.4242	0.6341	0.8997
0.0644	0.4785	700	0.6359	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8900
0.0442	0.4819	705	0.6968	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8819
0.0741	0.4853	710	0.7060	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8785
0.0311	0.4887	715	0.7774	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8785
0.0643	0.4921	720	0.8750	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8803
0.0503	0.4956	725	0.8895	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8848
0.0389	0.4990	730	0.8712	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8842
0.0602	0.5024	735	0.7992	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8913
0.0648	0.5058	740	0.6407	0.8113	0.8247	0.9639	0.2609	0.6667	0.8889	0.375	0.6124	0.8913
0.0406	0.5092	745	0.6189	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8884
0.1618	0.5126	750	0.5599	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8832
0.0859	0.5161	755	0.6138	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8800
0.0831	0.5195	760	0.6729	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8808
0.0892	0.5229	765	0.7443	0.8019	0.8163	0.9639	0.2174	0.625	0.8840	0.3226	0.5906	0.8779
0.045	0.5263	770	0.8153	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8876
0.0998	0.5297	775	0.7530	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8889
0.0761	0.5332	780	0.6338	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8908
0.052	0.5366	785	0.5878	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8950
0.0828	0.5400	790	0.6082	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8979
0.057	0.5434	795	0.6252	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8905
0.0917	0.5468	800	0.5796	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8918
0.0335	0.5502	805	0.5677	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8913
0.1046	0.5537	810	0.6292	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8947
0.066	0.5571	815	0.6409	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8931
0.0685	0.5605	820	0.6772	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8918
0.0594	0.5639	825	0.6890	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8981
0.064	0.5673	830	0.6692	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8929
0.0715	0.5707	835	0.6307	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8887
0.044	0.5742	840	0.6192	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8884
0.038	0.5776	845	0.6335	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8871
0.0429	0.5810	850	0.6731	0.8113	0.8182	0.9759	0.2174	0.7143	0.8901	0.3333	0.5966	0.8916
0.083	0.5844	855	0.7071	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8960
0.0851	0.5878	860	0.6540	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8926
0.0678	0.5913	865	0.5978	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8918
0.097	0.5947	870	0.5596	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8918
0.0624	0.5981	875	0.5668	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8963
0.0553	0.6015	880	0.6039	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8968
0.0692	0.6049	885	0.6500	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8944
0.0256	0.6083	890	0.6352	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8900
0.0501	0.6118	895	0.6635	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8869
0.0507	0.6152	900	0.6868	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8845
0.0422	0.6186	905	0.7153	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8879
0.0808	0.6220	910	0.7123	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8876
0.0254	0.6254	915	0.6462	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8866
0.115	0.6288	920	0.6135	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8874
0.0884	0.6323	925	0.5816	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8876
0.1059	0.6357	930	0.5626	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8879
0.0794	0.6391	935	0.5632	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8882
0.0901	0.6425	940	0.5684	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8889
0.0465	0.6459	945	0.6066	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8895
0.0721	0.6494	950	0.6238	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8874
0.0932	0.6528	955	0.6010	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8853
0.085	0.6562	960	0.5866	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8871
0.0532	0.6596	965	0.5836	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8910
0.1039	0.6630	970	0.5929	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8892
0.0845	0.6664	975	0.5875	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8897
0.0589	0.6699	980	0.6089	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8866
0.0479	0.6733	985	0.6400	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8871
0.0791	0.6767	990	0.6556	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8848
0.0398	0.6801	995	0.6882	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8855
0.0506	0.6835	1000	0.7136	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8850
0.1157	0.6869	1005	0.7535	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8855
0.0476	0.6904	1010	0.7553	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8840
0.0319	0.6938	1015	0.7874	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8834
0.0433	0.6972	1020	0.7550	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8827
0.0221	0.7006	1025	0.7476	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8834
0.0817	0.7040	1030	0.7155	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8832
0.0639	0.7075	1035	0.7033	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8821
0.0714	0.7109	1040	0.6866	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8834
0.089	0.7143	1045	0.6336	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8840
0.0498	0.7177	1050	0.5992	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8806
0.0673	0.7211	1055	0.5874	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8827
0.0845	0.7245	1060	0.6070	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8829
0.0884	0.7280	1065	0.6407	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8845
0.0403	0.7314	1070	0.6636	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8832
0.0574	0.7348	1075	0.6753	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8814
0.0593	0.7382	1080	0.6604	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8774
0.0594	0.7416	1085	0.6488	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8782
0.048	0.7450	1090	0.6511	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8777
0.0303	0.7485	1095	0.6768	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8766
0.0582	0.7519	1100	0.6740	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8793
0.0695	0.7553	1105	0.6969	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8811
0.047	0.7587	1110	0.7120	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8800
0.0387	0.7621	1115	0.7251	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8787
0.0292	0.7656	1120	0.7302	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8787
0.0462	0.7690	1125	0.7322	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8795
0.0422	0.7724	1130	0.7205	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8790
0.0779	0.7758	1135	0.7145	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8824
0.1064	0.7792	1140	0.7078	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8824
0.047	0.7826	1145	0.6872	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8827
0.0546	0.7861	1150	0.6789	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8814
0.0565	0.7895	1155	0.6728	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8795
0.0347	0.7929	1160	0.6701	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8774
0.072	0.7963	1165	0.6821	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8779
0.0442	0.7997	1170	0.7019	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8795
0.0218	0.8031	1175	0.7218	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8785
0.0313	0.8066	1180	0.7193	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8782
0.0628	0.8100	1185	0.7271	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8769
0.0736	0.8134	1190	0.7238	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8777
0.0557	0.8168	1195	0.7212	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8764
0.0169	0.8202	1200	0.7279	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8766
0.0323	0.8237	1205	0.7277	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8772
0.0601	0.8271	1210	0.7339	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8759
0.0563	0.8305	1215	0.7383	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764
0.0716	0.8339	1220	0.7357	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8753
0.0433	0.8373	1225	0.7343	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8743
0.0553	0.8407	1230	0.7284	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8759
0.0971	0.8442	1235	0.7311	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8748
0.0262	0.8476	1240	0.7361	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8756
0.0403	0.8510	1245	0.7362	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8766
0.0284	0.8544	1250	0.7356	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8748
0.0406	0.8578	1255	0.7414	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8753
0.076	0.8612	1260	0.7377	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8779
0.0656	0.8647	1265	0.7380	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8772
0.0265	0.8681	1270	0.7486	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764
0.0405	0.8715	1275	0.7478	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8777
0.0439	0.8749	1280	0.7421	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8761
0.0705	0.8783	1285	0.7352	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8769
0.0584	0.8817	1290	0.7274	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8777
0.0606	0.8852	1295	0.7246	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8761
0.0534	0.8886	1300	0.7282	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8745
0.0561	0.8920	1305	0.7305	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8759
0.0535	0.8954	1310	0.7342	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8751
0.0689	0.8988	1315	0.7323	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8774
0.0448	0.9023	1320	0.7341	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8759
0.0242	0.9057	1325	0.7441	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8753
0.0255	0.9091	1330	0.7465	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8759
0.0503	0.9125	1335	0.7470	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764
0.0474	0.9159	1340	0.7481	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8769
0.0589	0.9193	1345	0.7505	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8785
0.0553	0.9228	1350	0.7465	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8772
0.0396	0.9262	1355	0.7458	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8777
0.0617	0.9296	1360	0.7423	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8766
0.0895	0.9330	1365	0.7444	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8751
0.0426	0.9364	1370	0.7422	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8777
0.1007	0.9398	1375	0.7425	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8761
0.0907	0.9433	1380	0.7437	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8766
0.015	0.9467	1385	0.7465	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8772
0.1828	0.9501	1390	0.7418	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8761
0.0842	0.9535	1395	0.7418	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764
0.0628	0.9569	1400	0.7380	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8772
0.0468	0.9604	1405	0.7432	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8777
0.0899	0.9638	1410	0.7392	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8772
0.0735	0.9672	1415	0.7451	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8777
0.0567	0.9706	1420	0.7416	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8785
0.0977	0.9740	1425	0.7418	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8772
0.0689	0.9774	1430	0.7440	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8764
0.0226	0.9809	1435	0.7415	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8761
0.0663	0.9843	1440	0.7463	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8772
0.0494	0.9877	1445	0.7450	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764
0.0764	0.9911	1450	0.7413	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8772
0.0799	0.9945	1455	0.7433	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8766
0.0926	0.9979	1460	0.7421	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8764

Framework versions

• PEFT 0.12.0
• Transformers 4.46.0
• Pytorch 2.4.0+cu118
• Datasets 3.0.0
• Tokenizers 0.20.1