v7sciqqa_onlyaugs800k_llama_lora

This model is a fine-tuned version of Daewon0808/prm800k_llama_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.8627
• Prm accuracy: 0.8491
• Prm precision: 0.8454
• Prm recall: 0.9880
• Prm specificty: 0.3478
• Prm npv: 0.8889
• Prm f1: 0.9111
• Prm f1 neg: 0.5
• Prm f1 auc: 0.6679
• Prm f1 auc (fixed): 0.8892

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 2
• eval_batch_size: 4
• seed: 908932403
• distributed_type: multi-GPU
• num_devices: 8
• gradient_accumulation_steps: 4
• total_train_batch_size: 64
• total_eval_batch_size: 32
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc	Prm f1 auc (fixed)
No log	0	0	0.3310	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8882
0.3287	0.0021	5	0.3307	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8869
0.3189	0.0041	10	0.3331	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8869
0.3183	0.0062	15	0.3299	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8897
0.2457	0.0083	20	0.3328	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8882
0.3225	0.0104	25	0.3398	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8850
0.2912	0.0124	30	0.3424	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8842
0.2493	0.0145	35	0.3493	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8827
0.2013	0.0166	40	0.3509	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8790
0.2792	0.0187	45	0.3368	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8740
0.195	0.0207	50	0.3437	0.8208	0.8810	0.8916	0.5652	0.5909	0.8862	0.5778	0.7284	0.8664
0.1991	0.0228	55	0.3714	0.8208	0.8810	0.8916	0.5652	0.5909	0.8862	0.5778	0.7284	0.8654
0.1698	0.0249	60	0.4057	0.8208	0.8721	0.9036	0.5217	0.6	0.8876	0.5581	0.7127	0.8601
0.1469	0.0270	65	0.4068	0.8113	0.8706	0.8916	0.5217	0.5714	0.8810	0.5455	0.7067	0.8617
0.1067	0.0290	70	0.4154	0.8113	0.8706	0.8916	0.5217	0.5714	0.8810	0.5455	0.7067	0.8620
0.161	0.0311	75	0.4179	0.8113	0.8706	0.8916	0.5217	0.5714	0.8810	0.5455	0.7067	0.8669
0.1008	0.0332	80	0.4170	0.8113	0.8706	0.8916	0.5217	0.5714	0.8810	0.5455	0.7067	0.8669
0.1481	0.0353	85	0.4219	0.8113	0.8706	0.8916	0.5217	0.5714	0.8810	0.5455	0.7067	0.8599
0.1064	0.0373	90	0.4535	0.8208	0.8721	0.9036	0.5217	0.6	0.8876	0.5581	0.7127	0.8617
0.1315	0.0394	95	0.4746	0.8019	0.8523	0.9036	0.4348	0.5556	0.8772	0.4878	0.6692	0.8489
0.1026	0.0415	100	0.5178	0.8208	0.8556	0.9277	0.4348	0.625	0.8902	0.5128	0.6812	0.8478
0.1033	0.0436	105	0.4548	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8502
0.1537	0.0456	110	0.4476	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8570
0.171	0.0477	115	0.4931	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8696
0.0934	0.0498	120	0.4486	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8659
0.1242	0.0519	125	0.4900	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8669
0.0754	0.0539	130	0.5176	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8669
0.1058	0.0560	135	0.4172	0.8396	0.8837	0.9157	0.5652	0.65	0.8994	0.6047	0.7404	0.8614
0.1257	0.0581	140	0.5528	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8654
0.0668	0.0601	145	0.5639	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8520
0.0691	0.0622	150	0.5653	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8528
0.0558	0.0643	155	0.6019	0.8019	0.8298	0.9398	0.3043	0.5833	0.8814	0.4	0.6221	0.8633
0.0742	0.0664	160	0.4479	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8669
0.1344	0.0684	165	0.4613	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8659
0.0852	0.0705	170	0.4798	0.8208	0.8556	0.9277	0.4348	0.625	0.8902	0.5128	0.6812	0.8685
0.0801	0.0726	175	0.3586	0.8302	0.8824	0.9036	0.5652	0.6190	0.8929	0.5909	0.7344	0.8669
0.0689	0.0747	180	0.4558	0.8208	0.8556	0.9277	0.4348	0.625	0.8902	0.5128	0.6812	0.8596
0.0775	0.0767	185	0.4082	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8667
0.1095	0.0788	190	0.4452	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8646
0.1867	0.0809	195	0.4499	0.8208	0.8333	0.9639	0.3043	0.7	0.8939	0.4242	0.6341	0.8753
0.1537	0.0830	200	0.3972	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8879
0.1292	0.0850	205	0.3720	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8884
0.087	0.0871	210	0.4661	0.8396	0.8511	0.9639	0.3913	0.75	0.9040	0.5143	0.6776	0.8814
0.1008	0.0892	215	0.4286	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8743
0.0999	0.0913	220	0.4140	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8743
0.1075	0.0933	225	0.3744	0.8302	0.8652	0.9277	0.4783	0.6471	0.8953	0.55	0.7030	0.8774
0.081	0.0954	230	0.4082	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8858
0.061	0.0975	235	0.4506	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8952
0.0936	0.0996	240	0.4367	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8785
0.0879	0.1016	245	0.5154	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8803
0.0691	0.1037	250	0.3965	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.8745
0.0832	0.1058	255	0.5016	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8696
0.1311	0.1079	260	0.4887	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8609
0.0947	0.1099	265	0.4920	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8635
0.0855	0.1120	270	0.5854	0.8208	0.8265	0.9759	0.2609	0.75	0.8950	0.3871	0.6184	0.8641
0.0942	0.1141	275	0.3956	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.8625
0.1229	0.1161	280	0.3816	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8641
0.0957	0.1182	285	0.5163	0.8113	0.8316	0.9518	0.3043	0.6364	0.8876	0.4118	0.6281	0.8701
0.0694	0.1203	290	0.4004	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8787
0.0735	0.1224	295	0.3798	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8803
0.071	0.1244	300	0.3771	0.8585	0.8864	0.9398	0.5652	0.7222	0.9123	0.6341	0.7525	0.8800
0.0664	0.1265	305	0.3769	0.8585	0.8864	0.9398	0.5652	0.7222	0.9123	0.6341	0.7525	0.8748
0.0493	0.1286	310	0.4270	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.8814
0.0748	0.1307	315	0.3685	0.8774	0.8889	0.9639	0.5652	0.8125	0.9249	0.6667	0.7645	0.8853
0.1153	0.1327	320	0.3516	0.8585	0.8864	0.9398	0.5652	0.7222	0.9123	0.6341	0.7525	0.8937
0.0719	0.1348	325	0.4527	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8908
0.0732	0.1369	330	0.4181	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8848
0.0383	0.1390	335	0.3481	0.8585	0.8864	0.9398	0.5652	0.7222	0.9123	0.6341	0.7525	0.8811
0.0638	0.1410	340	0.3862	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.8834
0.0802	0.1431	345	0.4820	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8834
0.0955	0.1452	350	0.5092	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8806
0.0696	0.1473	355	0.4627	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.8848
0.0881	0.1493	360	0.4671	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8879
0.072	0.1514	365	0.5021	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8858
0.0631	0.1535	370	0.3939	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.8824
0.2078	0.1556	375	0.3180	0.8585	0.8864	0.9398	0.5652	0.7222	0.9123	0.6341	0.7525	0.8926
0.0925	0.1576	380	0.3211	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8976
0.0882	0.1597	385	0.3596	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.9041
0.0841	0.1618	390	0.4109	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.9070
0.0856	0.1638	395	0.3373	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.9052
0.1342	0.1659	400	0.2954	0.8491	0.8941	0.9157	0.6087	0.6667	0.9048	0.6364	0.7622	0.9010
0.2708	0.1680	405	0.3095	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.8989
0.111	0.1701	410	0.2975	0.8491	0.8851	0.9277	0.5652	0.6842	0.9059	0.6190	0.7465	0.8955
0.0608	0.1721	415	0.3363	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8937
0.0737	0.1742	420	0.3667	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8929
0.0641	0.1763	425	0.3459	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.9041
0.1761	0.1784	430	0.3351	0.8208	0.8478	0.9398	0.3913	0.6429	0.8914	0.4865	0.6655	0.9039
0.0807	0.1804	435	0.3643	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.9031
0.0542	0.1825	440	0.3529	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.9052
0.0441	0.1846	445	0.3589	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.9120
0.1028	0.1867	450	0.3719	0.8113	0.8387	0.9398	0.3478	0.6154	0.8864	0.4444	0.6438	0.9130
0.0904	0.1887	455	0.4047	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.9201
0.0378	0.1908	460	0.4347	0.8302	0.8351	0.9759	0.3043	0.7778	0.9	0.4375	0.6401	0.9196
0.0724	0.1929	465	0.3743	0.8396	0.8511	0.9639	0.3913	0.75	0.9040	0.5143	0.6776	0.9149
0.1044	0.1950	470	0.3351	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.9146
0.054	0.1970	475	0.3231	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.9086
0.045	0.1991	480	0.3653	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.8976
0.1678	0.2012	485	0.4850	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8950
0.0552	0.2033	490	0.3843	0.8774	0.8804	0.9759	0.5217	0.8571	0.9257	0.6486	0.7488	0.8989
0.0624	0.2053	495	0.3116	0.8396	0.875	0.9277	0.5217	0.6667	0.9006	0.5854	0.7247	0.9062
0.0655	0.2074	500	0.3324	0.8679	0.8791	0.9639	0.5217	0.8	0.9195	0.6316	0.7428	0.9096
0.0558	0.2095	505	0.3804	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.9109
0.0441	0.2116	510	0.3838	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.9086
0.0844	0.2136	515	0.3642	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.9086
0.1025	0.2157	520	0.4175	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.9094
0.0323	0.2178	525	0.3490	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.9075
0.0827	0.2198	530	0.3358	0.8491	0.8764	0.9398	0.5217	0.7059	0.9070	0.6	0.7307	0.9065
0.0857	0.2219	535	0.3833	0.8679	0.8791	0.9639	0.5217	0.8	0.9195	0.6316	0.7428	0.9073
0.0838	0.2240	540	0.4655	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.9089
0.062	0.2261	545	0.4238	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.9020
0.0734	0.2281	550	0.3711	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.8929
0.0472	0.2302	555	0.4409	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8973
0.0675	0.2323	560	0.4214	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8960
0.0507	0.2344	565	0.3954	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8976
0.0794	0.2364	570	0.3965	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8955
0.0613	0.2385	575	0.4033	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8968
0.1129	0.2406	580	0.4419	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8984
0.0643	0.2427	585	0.4492	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8955
0.0347	0.2447	590	0.5300	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8950
0.0283	0.2468	595	0.5043	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.8947
0.0402	0.2489	600	0.6294	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.9005
0.1796	0.2510	605	0.6349	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8992
0.0895	0.2530	610	0.4635	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8884
0.0217	0.2551	615	0.4397	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.8965
0.0833	0.2572	620	0.4752	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.9018
0.0963	0.2593	625	0.3938	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.8989
0.0579	0.2613	630	0.3748	0.8585	0.8778	0.9518	0.5217	0.75	0.9133	0.6154	0.7368	0.8986
0.0339	0.2634	635	0.4246	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8950
0.2012	0.2655	640	0.5412	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8937
0.0364	0.2676	645	0.4985	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.9018
0.0705	0.2696	650	0.4429	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8981
0.0266	0.2717	655	0.5134	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8973
0.096	0.2738	660	0.6330	0.8113	0.8058	1.0	0.1304	1.0	0.8925	0.2308	0.5652	0.9112
0.0584	0.2758	665	0.4517	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.9154
0.0286	0.2779	670	0.3623	0.8396	0.8587	0.9518	0.4348	0.7143	0.9029	0.5405	0.6933	0.9151
0.0548	0.2800	675	0.4414	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.9185
0.0821	0.2821	680	0.3909	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.9141
0.1173	0.2841	685	0.3906	0.8396	0.8667	0.9398	0.4783	0.6875	0.9017	0.5641	0.7090	0.9065
0.1098	0.2862	690	0.4767	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.9157
0.0649	0.2883	695	0.4147	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.9149
0.098	0.2904	700	0.4628	0.8491	0.8681	0.9518	0.4783	0.7333	0.9080	0.5789	0.7150	0.9172
0.0484	0.2924	705	0.4681	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.9243
0.0695	0.2945	710	0.4422	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.9214
0.0511	0.2966	715	0.4510	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.9212
0.1271	0.2987	720	0.4549	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.9225
0.0841	0.3007	725	0.4981	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.9269
0.1258	0.3028	730	0.5123	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.9288
0.0395	0.3049	735	0.5031	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.9201
0.0754	0.3070	740	0.5261	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.9154
0.0565	0.3090	745	0.4923	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.9070
0.0771	0.3111	750	0.4773	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8979
0.1387	0.3132	755	0.4803	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8989
0.0809	0.3153	760	0.3913	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8992
0.1048	0.3173	765	0.3918	0.8585	0.8696	0.9639	0.4783	0.7857	0.9143	0.5946	0.7211	0.9020
0.0342	0.3194	770	0.4224	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8979
0.0814	0.3215	775	0.4773	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8910
0.0539	0.3236	780	0.6049	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8892
0.0588	0.3256	785	0.5914	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8848
0.0189	0.3277	790	0.6033	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8939
0.0984	0.3298	795	0.5804	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8950
0.0673	0.3318	800	0.5436	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8934
0.0731	0.3339	805	0.5220	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8926
0.0245	0.3360	810	0.4458	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8952
0.081	0.3381	815	0.4861	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8989
0.0798	0.3401	820	0.5855	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.9002
0.0745	0.3422	825	0.5728	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8952
0.0736	0.3443	830	0.5283	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8882
0.0333	0.3464	835	0.5390	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8748
0.0935	0.3484	840	0.5076	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8669
0.0622	0.3505	845	0.4826	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8714
0.0668	0.3526	850	0.5116	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8714
0.0496	0.3547	855	0.5730	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8777
0.04	0.3567	860	0.5582	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8816
0.0635	0.3588	865	0.7577	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8861
0.0134	0.3609	870	0.7749	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8958
0.0123	0.3630	875	0.6865	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8968
0.052	0.3650	880	0.6625	0.8113	0.8119	0.9880	0.1739	0.8	0.8913	0.2857	0.5809	0.8971
0.0206	0.3671	885	0.6831	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8942
0.0196	0.3692	890	0.5975	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8981
0.0922	0.3713	895	0.5608	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8947
0.0438	0.3733	900	0.5618	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8934
0.0777	0.3754	905	0.6317	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8892
0.0808	0.3775	910	0.6478	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8960
0.1276	0.3795	915	0.5462	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8887
0.0673	0.3816	920	0.5451	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8855
0.0326	0.3837	925	0.5602	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8806
0.0444	0.3858	930	0.5914	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8740
0.0285	0.3878	935	0.6689	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8724
0.0453	0.3899	940	0.6642	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8753
0.0397	0.3920	945	0.6612	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8738
0.0536	0.3941	950	0.6904	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8751
0.0516	0.3961	955	0.6668	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8654
0.0421	0.3982	960	0.6539	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8596
0.0817	0.4003	965	0.6712	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8596
0.0503	0.4024	970	0.6049	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8562
0.0425	0.4044	975	0.6028	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8567
0.0729	0.4065	980	0.6759	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8588
0.0371	0.4086	985	0.7157	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8617
0.0345	0.4107	990	0.6894	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8717
0.0572	0.4127	995	0.6342	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8680
0.0731	0.4148	1000	0.6471	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8659
0.0323	0.4169	1005	0.7406	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8693
0.0394	0.4190	1010	0.7176	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8696
0.0967	0.4210	1015	0.6921	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8680
0.1005	0.4231	1020	0.6307	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8690
0.042	0.4252	1025	0.6184	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8690
0.1011	0.4273	1030	0.5448	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8669
0.0458	0.4293	1035	0.5357	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8740
0.0397	0.4314	1040	0.5776	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8837
0.0818	0.4335	1045	0.6051	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8897
0.0372	0.4355	1050	0.5688	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8861
0.0985	0.4376	1055	0.5221	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8819
0.0378	0.4397	1060	0.5198	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8764
0.0345	0.4418	1065	0.6397	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8806
0.0885	0.4438	1070	0.7147	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8821
0.0712	0.4459	1075	0.6113	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8722
0.0428	0.4480	1080	0.5046	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8696
0.087	0.4501	1085	0.5347	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8772
0.0298	0.4521	1090	0.6146	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8840
0.0386	0.4542	1095	0.5938	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0678	0.4563	1100	0.5505	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8858
0.1054	0.4584	1105	0.5532	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8816
0.0923	0.4604	1110	0.5879	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8834
0.062	0.4625	1115	0.5714	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.1085	0.4646	1120	0.5217	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8814
0.0433	0.4667	1125	0.5204	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8795
0.0841	0.4687	1130	0.5789	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8821
0.0331	0.4708	1135	0.6411	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0571	0.4729	1140	0.6044	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8821
0.0735	0.4750	1145	0.5556	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8761
0.0517	0.4770	1150	0.5474	0.8679	0.8710	0.9759	0.4783	0.8462	0.9205	0.6111	0.7271	0.8745
0.0563	0.4791	1155	0.5878	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8774
0.0706	0.4812	1160	0.6050	0.8491	0.8526	0.9759	0.3913	0.8182	0.9101	0.5294	0.6836	0.8803
0.0389	0.4833	1165	0.6466	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8871
0.0323	0.4853	1170	0.5922	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8829
0.0435	0.4874	1175	0.6055	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8766
0.0164	0.4895	1180	0.6592	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8745
0.0399	0.4915	1185	0.6988	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8774
0.0709	0.4936	1190	0.7006	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8811
0.0336	0.4957	1195	0.6461	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8853
0.0359	0.4978	1200	0.5754	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8834
0.0839	0.4998	1205	0.6191	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8855
0.0654	0.5019	1210	0.6630	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8842
0.0561	0.5040	1215	0.7266	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8840
0.0798	0.5061	1220	0.7436	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8869
0.0481	0.5081	1225	0.7056	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8842
0.0294	0.5102	1230	0.7186	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8769
0.0363	0.5123	1235	0.7466	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8766
0.0542	0.5144	1240	0.7663	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8811
0.1217	0.5164	1245	0.8402	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8806
0.0565	0.5185	1250	0.7922	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8748
0.0285	0.5206	1255	0.7587	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8677
0.0347	0.5227	1260	0.6931	0.8396	0.8438	0.9759	0.3478	0.8	0.9050	0.4848	0.6619	0.8641
0.0997	0.5247	1265	0.5833	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8667
0.1003	0.5268	1270	0.5166	0.8208	0.8404	0.9518	0.3478	0.6667	0.8927	0.4571	0.6498	0.8711
0.0377	0.5289	1275	0.4817	0.8302	0.8495	0.9518	0.3913	0.6923	0.8977	0.5	0.6716	0.8724
0.0339	0.5310	1280	0.5173	0.8302	0.8421	0.9639	0.3478	0.7273	0.8989	0.4706	0.6558	0.8819
0.0503	0.5330	1285	0.5414	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8814
0.0389	0.5351	1290	0.5990	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8837
0.0277	0.5372	1295	0.6577	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8827
0.0834	0.5393	1300	0.6517	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8782
0.0804	0.5413	1305	0.6736	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8766
0.1086	0.5434	1310	0.7031	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8774
0.0239	0.5455	1315	0.7098	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8753
0.071	0.5475	1320	0.7273	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8772
0.1237	0.5496	1325	0.6858	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8798
0.1072	0.5517	1330	0.5780	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8806
0.0536	0.5538	1335	0.5315	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8803
0.0558	0.5558	1340	0.5196	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8793
0.0523	0.5579	1345	0.5321	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8808
0.0532	0.5600	1350	0.5411	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8800
0.1016	0.5621	1355	0.5373	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8795
0.1297	0.5641	1360	0.5608	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8793
0.0121	0.5662	1365	0.5764	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8777
0.0096	0.5683	1370	0.6760	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8827
0.0157	0.5704	1375	0.6754	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8861
0.0342	0.5724	1380	0.6414	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8863
0.0624	0.5745	1385	0.6091	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8863
0.0412	0.5766	1390	0.5846	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8897
0.0292	0.5787	1395	0.5859	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8889
0.0499	0.5807	1400	0.5773	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8850
0.0412	0.5828	1405	0.5690	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8853
0.0355	0.5849	1410	0.5856	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8814
0.06	0.5870	1415	0.6194	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8764
0.0607	0.5890	1420	0.6695	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8751
0.0386	0.5911	1425	0.7070	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8709
0.0346	0.5932	1430	0.6961	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8704
0.0168	0.5953	1435	0.6903	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8688
0.0434	0.5973	1440	0.7482	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8740
0.0323	0.5994	1445	0.8018	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8808
0.0624	0.6015	1450	0.7526	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8827
0.0628	0.6035	1455	0.6303	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8829
0.0509	0.6056	1460	0.5785	0.8491	0.8602	0.9639	0.4348	0.7692	0.9091	0.5556	0.6993	0.8861
0.0736	0.6077	1465	0.5849	0.8585	0.8617	0.9759	0.4348	0.8333	0.9153	0.5714	0.7053	0.8874
0.0167	0.6098	1470	0.6343	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.024	0.6118	1475	0.6705	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8908
0.0295	0.6139	1480	0.6888	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8889
0.0634	0.6160	1485	0.7170	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0471	0.6181	1490	0.6531	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8850
0.0452	0.6201	1495	0.6418	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8814
0.0253	0.6222	1500	0.6700	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8832
0.0673	0.6243	1505	0.6763	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0303	0.6264	1510	0.7042	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8832
0.0785	0.6284	1515	0.7400	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8858
0.0252	0.6305	1520	0.7578	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0843	0.6326	1525	0.7748	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8900
0.0448	0.6347	1530	0.7503	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8853
0.0486	0.6367	1535	0.7678	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8855
0.0807	0.6388	1540	0.7976	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8874
0.0145	0.6409	1545	0.8145	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8866
0.0406	0.6430	1550	0.7974	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8924
0.0132	0.6450	1555	0.7565	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8897
0.028	0.6471	1560	0.6685	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8903
0.0619	0.6492	1565	0.6507	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0402	0.6512	1570	0.6610	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8900
0.0519	0.6533	1575	0.6697	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8905
0.0799	0.6554	1580	0.6608	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8939
0.024	0.6575	1585	0.6780	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8965
0.0445	0.6595	1590	0.7095	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8997
0.0187	0.6616	1595	0.7696	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8989
0.0307	0.6637	1600	0.8062	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8955
0.066	0.6658	1605	0.8022	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8939
0.0486	0.6678	1610	0.7896	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.068	0.6699	1615	0.7391	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0684	0.6720	1620	0.6943	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8832
0.0233	0.6741	1625	0.6772	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8858
0.0265	0.6761	1630	0.7216	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.0401	0.6782	1635	0.7593	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0623	0.6803	1640	0.7830	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.06	0.6824	1645	0.7987	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8897
0.027	0.6844	1650	0.7965	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8892
0.0295	0.6865	1655	0.7847	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8861
0.028	0.6886	1660	0.7458	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8858
0.0143	0.6907	1665	0.7097	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8848
0.0555	0.6927	1670	0.7049	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0475	0.6948	1675	0.6965	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0159	0.6969	1680	0.7175	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0426	0.6990	1685	0.7478	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8900
0.0363	0.7010	1690	0.7719	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8910
0.0107	0.7031	1695	0.7687	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8939
0.0346	0.7052	1700	0.7615	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8934
0.0732	0.7072	1705	0.7429	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8955
0.0648	0.7093	1710	0.7332	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8992
0.0243	0.7114	1715	0.7256	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8979
0.0159	0.7135	1720	0.7220	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8994
0.0129	0.7155	1725	0.7001	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8997
0.0182	0.7176	1730	0.6949	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9002
0.1356	0.7197	1735	0.6709	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8999
0.0208	0.7218	1740	0.6286	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8989
0.0213	0.7238	1745	0.6172	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8984
0.0331	0.7259	1750	0.6254	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8984
0.0301	0.7280	1755	0.6587	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8999
0.0482	0.7301	1760	0.6755	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.9010
0.017	0.7321	1765	0.7023	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8986
0.0907	0.7342	1770	0.7168	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9007
0.0528	0.7363	1775	0.7149	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9015
0.0663	0.7384	1780	0.6953	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8999
0.0658	0.7404	1785	0.6888	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9005
0.1435	0.7425	1790	0.6809	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9005
0.0231	0.7446	1795	0.6657	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8999
0.0427	0.7467	1800	0.6813	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9010
0.1062	0.7487	1805	0.6997	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9005
0.0299	0.7508	1810	0.6971	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8997
0.0527	0.7529	1815	0.7083	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9005
0.0231	0.7550	1820	0.7228	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.9010
0.0211	0.7570	1825	0.7684	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.9013
0.016	0.7591	1830	0.7915	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8999
0.062	0.7612	1835	0.8087	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.9020
0.0441	0.7632	1840	0.8023	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8997
0.0109	0.7653	1845	0.7983	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8986
0.1153	0.7674	1850	0.7504	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8950
0.0325	0.7695	1855	0.6915	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8944
0.0772	0.7715	1860	0.6688	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8900
0.0616	0.7736	1865	0.6601	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8921
0.1077	0.7757	1870	0.6697	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8913
0.0158	0.7778	1875	0.6822	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8910
0.0301	0.7798	1880	0.6755	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8895
0.0464	0.7819	1885	0.6627	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8910
0.0268	0.7840	1890	0.6624	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8905
0.0347	0.7861	1895	0.6865	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8897
0.0306	0.7881	1900	0.6869	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8887
0.0584	0.7902	1905	0.7012	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8921
0.0397	0.7923	1910	0.6963	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8918
0.0057	0.7944	1915	0.7063	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8921
0.1103	0.7964	1920	0.6920	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8921
0.0703	0.7985	1925	0.6815	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8863
0.0432	0.8006	1930	0.6857	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8863
0.0772	0.8027	1935	0.6692	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8924
0.0392	0.8047	1940	0.6897	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8903
0.0336	0.8068	1945	0.7067	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8929
0.0563	0.8089	1950	0.7114	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8931
0.0335	0.8110	1955	0.7474	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8921
0.0638	0.8130	1960	0.7557	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8955
0.0259	0.8151	1965	0.7641	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8924
0.011	0.8172	1970	0.7736	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8944
0.0212	0.8192	1975	0.7687	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8947
0.047	0.8213	1980	0.7756	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8942
0.0238	0.8234	1985	0.7719	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8931
0.0467	0.8255	1990	0.7542	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8947
0.0483	0.8275	1995	0.7694	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8942
0.0082	0.8296	2000	0.7600	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8929
0.0593	0.8317	2005	0.7746	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8895
0.0128	0.8338	2010	0.7786	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8910
0.067	0.8358	2015	0.7772	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8944
0.035	0.8379	2020	0.7881	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8934
0.0179	0.8400	2025	0.7934	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8942
0.0154	0.8421	2030	0.8148	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8934
0.1764	0.8441	2035	0.8314	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8937
0.0254	0.8462	2040	0.8424	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8937
0.0296	0.8483	2045	0.8409	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8944
0.0478	0.8504	2050	0.8334	0.8208	0.82	0.9880	0.2174	0.8333	0.8962	0.3448	0.6027	0.8939
0.1236	0.8524	2055	0.8433	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8913
0.0241	0.8545	2060	0.8630	0.8302	0.8283	0.9880	0.2609	0.8571	0.9011	0.4	0.6244	0.8903
0.0551	0.8566	2065	0.8289	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8889
0.0287	0.8587	2070	0.8521	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0253	0.8607	2075	0.8405	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8866
0.0925	0.8628	2080	0.8662	0.8396	0.8367	0.9880	0.3043	0.875	0.9061	0.4516	0.6461	0.8871
0.0818	0.8649	2085	0.8615	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0546	0.8670	2090	0.8454	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0178	0.8690	2095	0.8381	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.056	0.8711	2100	0.8357	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8916
0.0922	0.8732	2105	0.8276	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8908
0.0121	0.8752	2110	0.8309	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8924
0.0352	0.8773	2115	0.8494	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.0232	0.8794	2120	0.8452	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8910
0.045	0.8815	2125	0.8776	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0372	0.8835	2130	0.8820	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8879
0.0494	0.8856	2135	0.8449	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8916
0.0441	0.8877	2140	0.8380	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8913
0.0408	0.8898	2145	0.8583	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0247	0.8918	2150	0.8517	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0328	0.8939	2155	0.8607	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8879
0.0436	0.8960	2160	0.8326	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8903
0.038	0.8981	2165	0.8321	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8903
0.0308	0.9001	2170	0.8475	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0316	0.9022	2175	0.8442	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8848
0.0558	0.9043	2180	0.8493	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8887
0.0928	0.9064	2185	0.8185	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0123	0.9084	2190	0.8337	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0416	0.9105	2195	0.8496	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.1147	0.9126	2200	0.8454	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8863
0.0122	0.9147	2205	0.8540	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8892
0.0339	0.9167	2210	0.8597	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0238	0.9188	2215	0.8326	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0132	0.9209	2220	0.8500	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0425	0.9229	2225	0.8517	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0231	0.9250	2230	0.8412	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0549	0.9271	2235	0.8499	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0435	0.9292	2240	0.8498	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0318	0.9312	2245	0.8406	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8903
0.0223	0.9333	2250	0.8518	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0225	0.9354	2255	0.8540	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8842
0.1049	0.9375	2260	0.8525	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8863
0.0275	0.9395	2265	0.8597	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8861
0.0682	0.9416	2270	0.8476	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8887
0.0231	0.9437	2275	0.8410	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.037	0.9458	2280	0.8341	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.0414	0.9478	2285	0.8462	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8874
0.0734	0.9499	2290	0.8478	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8871
0.0185	0.9520	2295	0.8477	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0347	0.9541	2300	0.8576	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0131	0.9561	2305	0.8559	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8863
0.0186	0.9582	2310	0.8544	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8869
0.0325	0.9603	2315	0.8462	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0078	0.9624	2320	0.8518	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8855
0.0802	0.9644	2325	0.8511	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8889
0.0243	0.9665	2330	0.8405	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8916
0.0262	0.9686	2335	0.8553	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.043	0.9707	2340	0.8613	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.0167	0.9727	2345	0.8581	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8853
0.0235	0.9748	2350	0.8543	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0705	0.9769	2355	0.8527	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8889
0.0557	0.9789	2360	0.8523	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0235	0.9810	2365	0.8524	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8884
0.0336	0.9831	2370	0.8597	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8879
0.0478	0.9852	2375	0.8650	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8866
0.0065	0.9872	2380	0.8634	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8848
0.0131	0.9893	2385	0.8527	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8882
0.0416	0.9914	2390	0.8541	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8876
0.0435	0.9935	2395	0.8454	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8903
0.0659	0.9955	2400	0.8419	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8889
0.0151	0.9976	2405	0.8519	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8892
0.1103	0.9997	2410	0.8627	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8892

Framework versions

• PEFT 0.12.0
• Transformers 4.46.0
• Pytorch 2.4.0+cu118
• Datasets 3.0.0
• Tokenizers 0.20.1