mmlu_noaugs_nocs_llama_lora

This model is a fine-tuned version of Daewon0808/prm800k_llama_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.2428
• Prm accuracy: 0.8968
• Prm precision: 0.8983
• Prm recall: 0.9907
• Prm specificty: 0.3684
• Prm npv: 0.875
• Prm f1: 0.9422
• Prm f1 neg: 0.5185
• Prm f1 auc: 0.9228

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 2
• eval_batch_size: 4
• seed: 908932403
• distributed_type: multi-GPU
• num_devices: 8
• gradient_accumulation_steps: 2
• total_train_batch_size: 32
• total_eval_batch_size: 32
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc
No log	0	0	0.3535	0.8333	0.8772	0.9346	0.2632	0.4167	0.9050	0.3226	0.8195
0.3082	0.0020	5	0.3539	0.8333	0.8772	0.9346	0.2632	0.4167	0.9050	0.3226	0.8205
0.3298	0.0040	10	0.3534	0.8333	0.8772	0.9346	0.2632	0.4167	0.9050	0.3226	0.8178
0.3386	0.0061	15	0.3514	0.8333	0.8707	0.9439	0.2105	0.4	0.9058	0.2759	0.8190
0.3102	0.0081	20	0.3462	0.8413	0.8718	0.9533	0.2105	0.4444	0.9107	0.2857	0.8254
0.3106	0.0101	25	0.3497	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.8264
0.2711	0.0121	30	0.3780	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.8345
0.278	0.0141	35	0.3906	0.8571	0.856	1.0	0.0526	1.0	0.9224	0.1	0.8490
0.2918	0.0161	40	0.3541	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.8537
0.3213	0.0182	45	0.3249	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8564
0.2788	0.0202	50	0.3098	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8581
0.2519	0.0222	55	0.3041	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8623
0.2122	0.0242	60	0.3117	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.8689
0.2066	0.0262	65	0.3127	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.8743
0.2174	0.0282	70	0.2908	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.8733
0.2481	0.0303	75	0.2846	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.8719
0.2152	0.0323	80	0.2840	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.8751
0.204	0.0343	85	0.2947	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8741
0.2316	0.0363	90	0.2774	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8716
0.1951	0.0383	95	0.2810	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.8699
0.2304	0.0403	100	0.2807	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.8701
0.2363	0.0424	105	0.2791	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.8721
0.1915	0.0444	110	0.2829	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.8684
0.2191	0.0464	115	0.2992	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.8694
0.2977	0.0484	120	0.2956	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.8699
0.2662	0.0504	125	0.2992	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8682
0.2764	0.0525	130	0.3014	0.8333	0.8772	0.9346	0.2632	0.4167	0.9050	0.3226	0.8628
0.2222	0.0545	135	0.3210	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8650
0.1716	0.0565	140	0.3064	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.8652
0.2307	0.0585	145	0.2921	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.8625
0.2849	0.0605	150	0.3111	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8652
0.2093	0.0625	155	0.2971	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.8635
0.3399	0.0646	160	0.2850	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.8569
0.2387	0.0666	165	0.2999	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8606
0.2226	0.0686	170	0.3012	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8554
0.2149	0.0706	175	0.3068	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8603
0.2517	0.0726	180	0.2966	0.8492	0.8793	0.9533	0.2632	0.5	0.9148	0.3448	0.8606
0.228	0.0746	185	0.3029	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.8647
0.173	0.0767	190	0.2959	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.8672
0.2477	0.0787	195	0.2940	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.8711
0.1862	0.0807	200	0.2843	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.8719
0.2172	0.0827	205	0.2786	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8738
0.171	0.0847	210	0.2862	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8731
0.1639	0.0867	215	0.3032	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8662
0.2583	0.0888	220	0.2956	0.8571	0.8870	0.9533	0.3158	0.5455	0.9189	0.4	0.8625
0.2556	0.0908	225	0.2917	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.8588
0.1511	0.0928	230	0.3436	0.8571	0.8618	0.9907	0.1053	0.6667	0.9217	0.1818	0.8679
0.2451	0.0948	235	0.2787	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8674
0.1788	0.0968	240	0.2889	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8765
0.1993	0.0989	245	0.2784	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8802
0.2382	0.1009	250	0.2858	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.8856
0.2558	0.1029	255	0.2741	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8866
0.2293	0.1049	260	0.2960	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.8881
0.2089	0.1069	265	0.2861	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8888
0.1422	0.1089	270	0.2891	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.8896
0.1525	0.1110	275	0.2901	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.8810
0.1936	0.1130	280	0.2833	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.8800
0.2384	0.1150	285	0.2832	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8760
0.1815	0.1170	290	0.3100	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.8677
0.2735	0.1190	295	0.2858	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8672
0.2109	0.1210	300	0.3347	0.8571	0.8618	0.9907	0.1053	0.6667	0.9217	0.1818	0.8733
0.2372	0.1231	305	0.2800	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8731
0.1703	0.1251	310	0.3167	0.8571	0.8618	0.9907	0.1053	0.6667	0.9217	0.1818	0.8797
0.16	0.1271	315	0.2975	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8797
0.246	0.1291	320	0.2903	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.8815
0.1828	0.1311	325	0.3299	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8714
0.2407	0.1331	330	0.2848	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.8788
0.233	0.1352	335	0.2915	0.8492	0.8793	0.9533	0.2632	0.5	0.9148	0.3448	0.8851
0.2274	0.1372	340	0.2883	0.8492	0.8793	0.9533	0.2632	0.5	0.9148	0.3448	0.8859
0.1863	0.1392	345	0.2984	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.8866
0.1988	0.1412	350	0.2991	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8854
0.3286	0.1432	355	0.2918	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8883
0.2764	0.1452	360	0.2961	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8940
0.3155	0.1473	365	0.2908	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8928
0.2005	0.1493	370	0.2836	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.8903
0.1944	0.1513	375	0.3201	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.8918
0.2111	0.1533	380	0.2883	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8923
0.1355	0.1553	385	0.3173	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8908
0.1983	0.1574	390	0.2869	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9011
0.1647	0.1594	395	0.2682	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9019
0.1835	0.1614	400	0.2911	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8930
0.1505	0.1634	405	0.2822	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9031
0.1909	0.1654	410	0.2595	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9083
0.2739	0.1674	415	0.2890	0.8571	0.8618	0.9907	0.1053	0.6667	0.9217	0.1818	0.9053
0.376	0.1695	420	0.2822	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8984
0.2157	0.1715	425	0.2590	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8942
0.1188	0.1735	430	0.3022	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.9011
0.2229	0.1755	435	0.2882	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8977
0.1348	0.1775	440	0.2690	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8923
0.1271	0.1795	445	0.2950	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8910
0.2208	0.1816	450	0.3218	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.8972
0.2225	0.1836	455	0.2787	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8915
0.24	0.1856	460	0.2801	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8901
0.2376	0.1876	465	0.2973	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.8874
0.244	0.1896	470	0.2824	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8901
0.2142	0.1916	475	0.2728	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8945
0.2395	0.1937	480	0.2721	0.8413	0.8991	0.9159	0.4211	0.4706	0.9074	0.4444	0.8960
0.1617	0.1957	485	0.2965	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.9024
0.3219	0.1977	490	0.2637	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9122
0.1422	0.1997	495	0.2500	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9117
0.1838	0.2017	500	0.2559	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9137
0.1705	0.2038	505	0.2510	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9154
0.25	0.2058	510	0.2560	0.8651	0.9018	0.9439	0.4211	0.5714	0.9224	0.4848	0.9129
0.1552	0.2078	515	0.2630	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9105
0.1208	0.2098	520	0.2845	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.9107
0.1937	0.2118	525	0.2761	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9004
0.1751	0.2138	530	0.2765	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8972
0.1694	0.2159	535	0.2802	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8974
0.1644	0.2179	540	0.2810	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8896
0.1301	0.2199	545	0.2973	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8856
0.173	0.2219	550	0.2788	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8829
0.1023	0.2239	555	0.2960	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8810
0.2153	0.2259	560	0.3002	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8773
0.2901	0.2280	565	0.2887	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.8751
0.1854	0.2300	570	0.2997	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8733
0.1133	0.2320	575	0.3107	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.8753
0.231	0.2340	580	0.2879	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.8810
0.2711	0.2360	585	0.2878	0.8571	0.8870	0.9533	0.3158	0.5455	0.9189	0.4	0.8812
0.2494	0.2380	590	0.2821	0.8492	0.8929	0.9346	0.3684	0.5	0.9132	0.4242	0.8751
0.1563	0.2401	595	0.2873	0.8651	0.9018	0.9439	0.4211	0.5714	0.9224	0.4848	0.8741
0.1476	0.2421	600	0.2972	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8765
0.1635	0.2441	605	0.2907	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.8763
0.2071	0.2461	610	0.2953	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8817
0.2099	0.2481	615	0.3132	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8824
0.1185	0.2502	620	0.2951	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8837
0.132	0.2522	625	0.3447	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8810
0.2107	0.2542	630	0.3009	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8844
0.1483	0.2562	635	0.2904	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8775
0.1771	0.2582	640	0.3201	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8844
0.1313	0.2602	645	0.2791	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8920
0.1726	0.2623	650	0.2827	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8945
0.162	0.2643	655	0.3023	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8992
0.1493	0.2663	660	0.2723	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8979
0.1741	0.2683	665	0.2728	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9004
0.2129	0.2703	670	0.2921	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8994
0.1229	0.2723	675	0.2878	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8950
0.2251	0.2744	680	0.2875	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8940
0.2437	0.2764	685	0.2772	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8970
0.2537	0.2784	690	0.2743	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8977
0.2307	0.2804	695	0.2996	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8972
0.0955	0.2824	700	0.2793	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8861
0.1878	0.2844	705	0.3124	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8856
0.2411	0.2865	710	0.2938	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8854
0.1599	0.2885	715	0.2806	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8861
0.1779	0.2905	720	0.3187	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8807
0.1561	0.2925	725	0.2968	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8812
0.2199	0.2945	730	0.2819	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8856
0.1777	0.2966	735	0.2890	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8896
0.1267	0.2986	740	0.2727	0.8889	0.9266	0.9439	0.5789	0.6471	0.9352	0.6111	0.8839
0.2079	0.3006	745	0.2731	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8906
0.2542	0.3026	750	0.2642	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8942
0.1267	0.3046	755	0.2518	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.8987
0.1532	0.3066	760	0.2581	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9006
0.1777	0.3087	765	0.2519	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9019
0.1853	0.3107	770	0.2493	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8997
0.1479	0.3127	775	0.2479	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9031
0.1097	0.3147	780	0.2778	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8999
0.1822	0.3167	785	0.2731	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8930
0.1754	0.3187	790	0.2639	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8879
0.1341	0.3208	795	0.2718	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8856
0.1752	0.3228	800	0.2709	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8869
0.1506	0.3248	805	0.2671	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8896
0.1673	0.3268	810	0.2856	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8881
0.135	0.3288	815	0.3022	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8918
0.1494	0.3308	820	0.2785	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8859
0.1522	0.3329	825	0.2822	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8864
0.1669	0.3349	830	0.3121	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8869
0.1042	0.3369	835	0.3084	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8834
0.1255	0.3389	840	0.2944	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8859
0.1075	0.3409	845	0.2875	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8866
0.1953	0.3429	850	0.2844	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8906
0.1818	0.3450	855	0.3072	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8930
0.1834	0.3470	860	0.2857	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8945
0.1156	0.3490	865	0.2746	0.8651	0.9018	0.9439	0.4211	0.5714	0.9224	0.4848	0.8950
0.1549	0.3510	870	0.2772	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8950
0.199	0.3530	875	0.2826	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8883
0.1588	0.3551	880	0.2727	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8844
0.1994	0.3571	885	0.2873	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8839
0.1838	0.3591	890	0.2863	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8891
0.1793	0.3611	895	0.2800	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8842
0.1411	0.3631	900	0.3015	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8842
0.2113	0.3651	905	0.3167	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8792
0.1857	0.3672	910	0.2785	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8756
0.193	0.3692	915	0.2748	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.8709
0.206	0.3712	920	0.2926	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8760
0.1611	0.3732	925	0.2905	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8790
0.1779	0.3752	930	0.2762	0.8810	0.9107	0.9533	0.4737	0.6429	0.9315	0.5455	0.8790
0.2159	0.3772	935	0.2719	0.8810	0.9107	0.9533	0.4737	0.6429	0.9315	0.5455	0.8795
0.1541	0.3793	940	0.2689	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8824
0.1396	0.3813	945	0.2898	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8854
0.1743	0.3833	950	0.2603	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8861
0.1889	0.3853	955	0.2573	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8901
0.1378	0.3873	960	0.2775	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8891
0.2009	0.3893	965	0.2728	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8844
0.147	0.3914	970	0.2616	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.8856
0.194	0.3934	975	0.2797	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8942
0.1473	0.3954	980	0.2944	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8942
0.1306	0.3974	985	0.2727	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8923
0.143	0.3994	990	0.2847	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8923
0.1783	0.4015	995	0.2723	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8815
0.173	0.4035	1000	0.2738	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8792
0.2057	0.4055	1005	0.2885	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8832
0.1944	0.4075	1010	0.2742	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8876
0.1195	0.4095	1015	0.2595	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8886
0.1778	0.4115	1020	0.2671	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8930
0.1795	0.4136	1025	0.2784	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8906
0.1781	0.4156	1030	0.2659	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8891
0.1436	0.4176	1035	0.2583	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8938
0.1459	0.4196	1040	0.2610	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8923
0.1725	0.4216	1045	0.2783	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8940
0.1906	0.4236	1050	0.2763	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8967
0.1463	0.4257	1055	0.2620	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8970
0.163	0.4277	1060	0.2689	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8849
0.1924	0.4297	1065	0.2799	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8842
0.1238	0.4317	1070	0.2837	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8871
0.1854	0.4337	1075	0.2887	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.8888
0.1624	0.4357	1080	0.2668	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.8923
0.1871	0.4378	1085	0.2533	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8952
0.1982	0.4398	1090	0.2561	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.8957
0.1487	0.4418	1095	0.2650	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8972
0.1598	0.4438	1100	0.2564	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8962
0.1938	0.4458	1105	0.2545	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8989
0.1725	0.4479	1110	0.2522	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9004
0.1906	0.4499	1115	0.2495	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9011
0.166	0.4519	1120	0.2512	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8982
0.1226	0.4539	1125	0.2548	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8967
0.1717	0.4559	1130	0.2688	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8970
0.1569	0.4579	1135	0.2962	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8962
0.1804	0.4600	1140	0.2894	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8965
0.1154	0.4620	1145	0.2626	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8987
0.1323	0.4640	1150	0.2569	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8972
0.1534	0.4660	1155	0.2557	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8984
0.1897	0.4680	1160	0.2659	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9016
0.1949	0.4700	1165	0.2760	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9009
0.1783	0.4721	1170	0.2870	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8987
0.201	0.4741	1175	0.2942	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8989
0.1052	0.4761	1180	0.2718	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8955
0.1233	0.4781	1185	0.2635	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8957
0.1484	0.4801	1190	0.2771	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8950
0.1389	0.4821	1195	0.2735	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8965
0.1904	0.4842	1200	0.2674	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8967
0.1771	0.4862	1205	0.2685	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8957
0.108	0.4882	1210	0.2760	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8994
0.2544	0.4902	1215	0.2982	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9001
0.1588	0.4922	1220	0.3201	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9080
0.1302	0.4943	1225	0.2864	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9134
0.1322	0.4963	1230	0.2611	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9129
0.2593	0.4983	1235	0.2575	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.9181
0.0861	0.5003	1240	0.2686	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9122
0.1676	0.5023	1245	0.2677	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9120
0.1752	0.5043	1250	0.2610	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9078
0.1755	0.5064	1255	0.2660	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9083
0.0986	0.5084	1260	0.2835	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9078
0.227	0.5104	1265	0.2855	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9046
0.1015	0.5124	1270	0.2711	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9043
0.1623	0.5144	1275	0.2694	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9043
0.1908	0.5164	1280	0.2710	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9029
0.1017	0.5185	1285	0.2700	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9051
0.1499	0.5205	1290	0.2757	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9065
0.1221	0.5225	1295	0.2637	0.8571	0.9009	0.9346	0.4211	0.5333	0.9174	0.4706	0.9065
0.0794	0.5245	1300	0.2670	0.8492	0.9	0.9252	0.4211	0.5	0.9124	0.4571	0.9056
0.1736	0.5265	1305	0.2844	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.9058
0.1585	0.5285	1310	0.2977	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9075
0.1357	0.5306	1315	0.2713	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.9075
0.1688	0.5326	1320	0.2551	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9102
0.2437	0.5346	1325	0.2531	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9095
0.1494	0.5366	1330	0.2550	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9095
0.1411	0.5386	1335	0.2542	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9164
0.1054	0.5406	1340	0.2494	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9193
0.1274	0.5427	1345	0.2511	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9220
0.201	0.5447	1350	0.2596	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9201
0.1382	0.5467	1355	0.2686	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9161
0.2219	0.5487	1360	0.2573	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9124
0.1409	0.5507	1365	0.2671	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9068
0.2134	0.5528	1370	0.2703	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9036
0.1944	0.5548	1375	0.2594	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9053
0.1245	0.5568	1380	0.2513	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.9100
0.1865	0.5588	1385	0.2564	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.9107
0.1404	0.5608	1390	0.2590	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9117
0.1994	0.5628	1395	0.2576	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9097
0.134	0.5649	1400	0.2544	0.8968	0.9123	0.9720	0.4737	0.75	0.9412	0.5806	0.9033
0.1423	0.5669	1405	0.2544	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9048
0.1021	0.5689	1410	0.2557	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9065
0.1396	0.5709	1415	0.2539	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9102
0.1787	0.5729	1420	0.2494	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9080
0.2067	0.5749	1425	0.2475	0.8889	0.9115	0.9626	0.4737	0.6923	0.9364	0.5625	0.9102
0.1523	0.5770	1430	0.2506	0.8889	0.9115	0.9626	0.4737	0.6923	0.9364	0.5625	0.9061
0.1205	0.5790	1435	0.2563	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9078
0.1288	0.5810	1440	0.2575	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9095
0.1726	0.5830	1445	0.2544	0.8730	0.9099	0.9439	0.4737	0.6	0.9266	0.5294	0.9080
0.1512	0.5850	1450	0.2576	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9068
0.1852	0.5870	1455	0.2603	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9073
0.1622	0.5891	1460	0.2612	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.9090
0.1508	0.5911	1465	0.2581	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.9092
0.1151	0.5931	1470	0.2487	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9107
0.1367	0.5951	1475	0.2531	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9110
0.2025	0.5971	1480	0.2576	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9095
0.1841	0.5992	1485	0.2502	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.9073
0.2132	0.6012	1490	0.2511	0.8810	0.9107	0.9533	0.4737	0.6429	0.9315	0.5455	0.9014
0.1674	0.6032	1495	0.2520	0.8651	0.9091	0.9346	0.4737	0.5625	0.9217	0.5143	0.8987
0.196	0.6052	1500	0.2539	0.8571	0.9009	0.9346	0.4211	0.5333	0.9174	0.4706	0.8984
0.2004	0.6072	1505	0.2646	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.8967
0.1628	0.6092	1510	0.2790	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8965
0.3206	0.6113	1515	0.2854	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.8984
0.1827	0.6133	1520	0.2713	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.8947
0.1359	0.6153	1525	0.2646	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.8972
0.1743	0.6173	1530	0.2600	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8979
0.2095	0.6193	1535	0.2593	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9014
0.1216	0.6213	1540	0.2624	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9026
0.2846	0.6234	1545	0.2642	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9053
0.1453	0.6254	1550	0.2563	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9024
0.1289	0.6274	1555	0.2514	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9011
0.2143	0.6294	1560	0.2527	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9041
0.1242	0.6314	1565	0.2503	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.9041
0.0991	0.6334	1570	0.2504	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.9056
0.1688	0.6355	1575	0.2540	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9041
0.1311	0.6375	1580	0.2578	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9038
0.1157	0.6395	1585	0.2580	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.9051
0.2503	0.6415	1590	0.2639	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9033
0.178	0.6435	1595	0.2606	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.9033
0.1396	0.6456	1600	0.2643	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9026
0.1134	0.6476	1605	0.2654	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9024
0.1658	0.6496	1610	0.2675	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9011
0.1443	0.6516	1615	0.2645	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9006
0.1218	0.6536	1620	0.2608	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9016
0.1408	0.6556	1625	0.2637	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8984
0.0591	0.6577	1630	0.2690	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9004
0.1534	0.6597	1635	0.2751	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8987
0.1423	0.6617	1640	0.2755	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9004
0.1812	0.6637	1645	0.2711	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9009
0.1246	0.6657	1650	0.2773	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8972
0.1923	0.6677	1655	0.2830	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8982
0.2254	0.6698	1660	0.2715	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8974
0.1059	0.6718	1665	0.2573	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9016
0.1818	0.6738	1670	0.2584	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8977
0.119	0.6758	1675	0.2585	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.8987
0.129	0.6778	1680	0.2646	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.8957
0.1978	0.6798	1685	0.2667	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8965
0.1881	0.6819	1690	0.2671	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8979
0.1414	0.6839	1695	0.2670	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8979
0.1423	0.6859	1700	0.2720	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8960
0.2123	0.6879	1705	0.2728	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9014
0.2223	0.6899	1710	0.2681	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.8977
0.1323	0.6920	1715	0.2618	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9011
0.1533	0.6940	1720	0.2590	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9038
0.1749	0.6960	1725	0.2623	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9048
0.1937	0.6980	1730	0.2734	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9031
0.2048	0.7000	1735	0.2716	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9048
0.2074	0.7020	1740	0.2601	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9095
0.1462	0.7041	1745	0.2538	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9088
0.2085	0.7061	1750	0.2482	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9129
0.1426	0.7081	1755	0.2476	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9124
0.0992	0.7101	1760	0.2514	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9127
0.1229	0.7121	1765	0.2516	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9134
0.2117	0.7141	1770	0.2524	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9137
0.1672	0.7162	1775	0.2527	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9110
0.1827	0.7182	1780	0.2511	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9134
0.1404	0.7202	1785	0.2502	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9122
0.1115	0.7222	1790	0.2549	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9132
0.1542	0.7242	1795	0.2553	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9120
0.0756	0.7262	1800	0.2553	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9110
0.1469	0.7283	1805	0.2518	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9122
0.148	0.7303	1810	0.2515	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.9142
0.2083	0.7323	1815	0.2530	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9147
0.1562	0.7343	1820	0.2518	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9139
0.1443	0.7363	1825	0.2475	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9156
0.1539	0.7383	1830	0.2428	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.9142
0.1469	0.7404	1835	0.2441	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9142
0.1782	0.7424	1840	0.2484	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9144
0.1985	0.7444	1845	0.2489	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.9164
0.1936	0.7464	1850	0.2466	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9159
0.2091	0.7484	1855	0.2475	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.9159
0.1595	0.7505	1860	0.2478	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9183
0.1016	0.7525	1865	0.2473	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9161
0.1522	0.7545	1870	0.2481	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9161
0.0983	0.7565	1875	0.2499	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9179
0.1155	0.7585	1880	0.2571	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9161
0.134	0.7605	1885	0.2611	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9183
0.1007	0.7626	1890	0.2597	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9169
0.253	0.7646	1895	0.2535	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9164
0.1518	0.7666	1900	0.2473	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9164
0.1475	0.7686	1905	0.2463	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9152
0.1502	0.7706	1910	0.2424	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9169
0.1982	0.7726	1915	0.2428	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9152
0.1231	0.7747	1920	0.2469	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9174
0.1138	0.7767	1925	0.2540	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9161
0.1024	0.7787	1930	0.2600	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9161
0.1105	0.7807	1935	0.2654	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9181
0.1369	0.7827	1940	0.2637	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9174
0.1401	0.7847	1945	0.2610	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9171
0.1135	0.7868	1950	0.2583	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9169
0.1702	0.7888	1955	0.2535	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9174
0.151	0.7908	1960	0.2476	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9176
0.1146	0.7928	1965	0.2457	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9176
0.1225	0.7948	1970	0.2455	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9159
0.1354	0.7969	1975	0.2477	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9181
0.1408	0.7989	1980	0.2463	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9183
0.1742	0.8009	1985	0.2466	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9156
0.2154	0.8029	1990	0.2491	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9183
0.1394	0.8049	1995	0.2487	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9181
0.1223	0.8069	2000	0.2507	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9203
0.0704	0.8090	2005	0.2535	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9179
0.1123	0.8110	2010	0.2556	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9181
0.1599	0.8130	2015	0.2579	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9206
0.135	0.8150	2020	0.2547	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9218
0.1793	0.8170	2025	0.2535	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9188
0.1459	0.8190	2030	0.2529	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9201
0.1906	0.8211	2035	0.2515	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9203
0.1216	0.8231	2040	0.2471	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9186
0.1583	0.8251	2045	0.2450	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9181
0.1068	0.8271	2050	0.2430	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9179
0.1288	0.8291	2055	0.2402	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9203
0.1618	0.8311	2060	0.2392	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9196
0.1466	0.8332	2065	0.2393	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9198
0.1475	0.8352	2070	0.2395	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9220
0.1193	0.8372	2075	0.2407	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9228
0.1623	0.8392	2080	0.2397	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9223
0.268	0.8412	2085	0.2417	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9245
0.2241	0.8433	2090	0.2418	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9225
0.1577	0.8453	2095	0.2402	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9206
0.1193	0.8473	2100	0.2380	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.1036	0.8493	2105	0.2375	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9230
0.1271	0.8513	2110	0.2384	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9218
0.1094	0.8533	2115	0.2389	0.9127	0.9138	0.9907	0.4737	0.9	0.9507	0.6207	0.9211
0.141	0.8554	2120	0.2410	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.0752	0.8574	2125	0.2434	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9238
0.1206	0.8594	2130	0.2439	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9235
0.166	0.8614	2135	0.2469	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9223
0.2026	0.8634	2140	0.2466	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9235
0.1003	0.8654	2145	0.2454	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9213
0.1321	0.8675	2150	0.2433	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9228
0.2608	0.8695	2155	0.2417	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9233
0.1923	0.8715	2160	0.2417	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9225
0.1377	0.8735	2165	0.2416	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9223
0.1277	0.8755	2170	0.2414	0.8968	0.9123	0.9720	0.4737	0.75	0.9412	0.5806	0.9218
0.161	0.8775	2175	0.2426	0.8968	0.9123	0.9720	0.4737	0.75	0.9412	0.5806	0.9233
0.1918	0.8796	2180	0.2411	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9223
0.1297	0.8816	2185	0.2419	0.8968	0.9123	0.9720	0.4737	0.75	0.9412	0.5806	0.9228
0.1151	0.8836	2190	0.2412	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9228
0.1218	0.8856	2195	0.2425	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9218
0.1014	0.8876	2200	0.2433	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9215
0.1338	0.8897	2205	0.2439	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.1737	0.8917	2210	0.2456	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9211
0.1711	0.8937	2215	0.2471	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9206
0.094	0.8957	2220	0.2461	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.1732	0.8977	2225	0.2469	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9218
0.1903	0.8997	2230	0.2435	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9235
0.0863	0.9018	2235	0.2423	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9230
0.1592	0.9038	2240	0.2430	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9223
0.1453	0.9058	2245	0.2431	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.9233
0.1209	0.9078	2250	0.2418	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9235
0.1201	0.9098	2255	0.2421	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9218
0.2776	0.9118	2260	0.2414	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9218
0.1461	0.9139	2265	0.2416	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9245
0.1584	0.9159	2270	0.2418	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9230
0.1834	0.9179	2275	0.2398	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9228
0.1861	0.9199	2280	0.2414	0.9048	0.9130	0.9813	0.4737	0.8182	0.9459	0.6	0.9235
0.1412	0.9219	2285	0.2417	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9223
0.2316	0.9239	2290	0.2406	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9220
0.159	0.9260	2295	0.2416	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9228
0.1969	0.9280	2300	0.2414	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9218
0.1609	0.9300	2305	0.2405	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9228
0.1477	0.9320	2310	0.2410	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9223
0.2002	0.9340	2315	0.2424	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9228
0.1252	0.9361	2320	0.2417	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9230
0.1569	0.9381	2325	0.2412	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9228
0.134	0.9401	2330	0.2415	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9213
0.1564	0.9421	2335	0.2436	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.2182	0.9441	2340	0.2422	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9220
0.113	0.9461	2345	0.2406	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9233
0.1678	0.9482	2350	0.2419	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.1288	0.9502	2355	0.2414	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.219	0.9522	2360	0.2421	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.145	0.9542	2365	0.2430	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9218
0.1049	0.9562	2370	0.2417	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9211
0.1303	0.9582	2375	0.2434	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.9225
0.2016	0.9603	2380	0.2425	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9218
0.1242	0.9623	2385	0.2417	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9220
0.0873	0.9643	2390	0.2435	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9213
0.111	0.9663	2395	0.2431	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.1261	0.9683	2400	0.2420	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.1455	0.9703	2405	0.2413	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9230
0.1135	0.9724	2410	0.2433	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9213
0.1088	0.9744	2415	0.2425	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9230
0.118	0.9764	2420	0.2426	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9225
0.1347	0.9784	2425	0.2434	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9218
0.1994	0.9804	2430	0.2403	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9230
0.1532	0.9824	2435	0.2420	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9225
0.1617	0.9845	2440	0.2415	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9238
0.1455	0.9865	2445	0.2430	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9225
0.1708	0.9885	2450	0.2416	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9228
0.1752	0.9905	2455	0.2429	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9223
0.1019	0.9925	2460	0.2430	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9240
0.1609	0.9946	2465	0.2419	0.9048	0.9060	0.9907	0.4211	0.8889	0.9464	0.5714	0.9247
0.1157	0.9966	2470	0.2430	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9220
0.1387	0.9986	2475	0.2428	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.9228

Framework versions

• PEFT 0.12.0
• Transformers 4.46.0
• Pytorch 2.4.0+cu118
• Datasets 3.0.0
• Tokenizers 0.20.1