[2025-08-04 08:30:59,398] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) W0804 08:31:00.964000 3723091 site-packages/torch/distributed/run.py:792] W0804 08:31:00.964000 3723091 site-packages/torch/distributed/run.py:792] ***************************************** W0804 08:31:00.964000 3723091 site-packages/torch/distributed/run.py:792] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. W0804 08:31:00.964000 3723091 site-packages/torch/distributed/run.py:792] ***************************************** [2025-08-04 08:31:04,223] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) [2025-08-04 08:31:04,461] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) [2025-08-04 08:31:04,555] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) [2025-08-04 08:31:04,566] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) Loading base model: Qwen/Qwen3-32B Loading checkpoint shards: 0%| | 0/17 [00:00>> Printing the first sample of the first training batch <<< ================================================================================ [Input IDs]: [151644, 8948, 198, 7771, 3476, 438, 458, 17847, 17601, 26364, 23966, 4755, 1526, 264, 36438, 1293, 7274, 1882, 1573, 8241, 279, 1590, 23560, 323, 13382, 9904, 13, 1096, 7460, 22570, 304, 264, 15817, 10775, 315, 6358, 11, 28285, 4849, 11, 26403, 11, 31734, 23391, 11, 21844, 11, 1182, 376, 4527, 11, 323, 19569, 311, 2225, 1632, 12, 24712, 291, 7274, 1882, 13, 5209, 5944, 697, 2033, 1119, 1378, 1887, 14158, 25, 35187, 323, 12478, 13, 758, 279, 35187, 3772, 11, 7716, 697, 32711, 1882, 1667, 279, 5189, 3561, 25, 82639, 7265, 3575, 5854, 2450, 91, 29, 314, 60565, 448, 7354, 18663, 448, 5196, 77, 1699, 8275, 82639, 408, 3575, 5854, 2450, 91, 29, 8886, 3019, 1265, 2924, 11682, 37764, 1741, 438, 3181, 285, 7024, 4755, 11, 28285, 4849, 9760, 14613, 11, 86781, 287, 501, 6708, 11, 68863, 279, 13403, 315, 279, 1482, 7354, 11, 73185, 894, 5975, 11, 323, 17493, 5853, 3681, 7354, 13, 758, 279, 12478, 3772, 11, 3118, 389, 5257, 13553, 11, 47439, 804, 11, 323, 62751, 504, 279, 35187, 3772, 11, 59726, 3042, 279, 1590, 6291, 429, 498, 81477, 4396, 13, 576, 6291, 1265, 7146, 264, 19819, 11, 13382, 11, 63594, 7493, 1707, 323, 7716, 5871, 3019, 4362, 311, 5545, 279, 16688, 11, 23126, 438, 11017, 25, 82639, 7265, 3575, 50274, 91, 29, 314, 11822, 23126, 11, 23560, 11, 323, 2797, 6291, 92, 82639, 408, 3575, 50274, 91, 29, 4695, 11, 1430, 311, 11625, 279, 2701, 3405, 1526, 279, 3403, 17501, 25, 151645, 198, 151644, 872, 198, 31115, 458, 32156, 13027, 729, 7907, 504, 279, 2661, 9934, 13, 576, 729, 1265, 1896, 31369, 438, 1946, 323, 1173, 279, 2550, 13, 28424, 1618, 279, 729, 1283, 279, 7271, 72672, 11, 44856, 60436, 374, 2661, 308, 65623, 389, 264, 220, 16, 15, 15, 15, 553, 220, 16, 15, 15, 15, 5827, 13, 11733, 6978, 323, 8147, 315, 279, 5827, 525, 48826, 504, 220, 16, 311, 220, 16, 15, 15, 15, 13, 61706, 525, 48826, 504, 1909, 311, 5622, 11, 1393, 8147, 525, 48826, 504, 2115, 311, 1290, 382, 54, 295, 60436, 15482, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 7036, 11, 429, 419, 374, 279, 1172, 12890, 11, 773, 1378, 65623, 1231, 3359, 1817, 1008, 320, 73846, 311, 44856, 60436, 8, 1496, 421, 1052, 374, 2441, 53206, 7407, 1948, 1105, 13, 4695, 44856, 60436, 6801, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 4192, 15081, 2505, 70674, 785, 1156, 1555, 315, 279, 1946, 5610, 308, 320, 16, 37294, 308, 37294, 220, 17, 15, 15, 220, 15, 15, 15, 8, 4102, 2293, 279, 1372, 315, 65623, 382, 4854, 315, 1790, 308, 5128, 5610, 1378, 3550, 18663, 25780, 856, 15159, 72, 92, 323, 379, 15159, 72, 92, 320, 16, 37294, 856, 15159, 72, 2137, 379, 15159, 72, 92, 37294, 220, 16, 15, 15, 15, 8, 4102, 2293, 279, 1372, 315, 2802, 323, 279, 1372, 315, 3250, 1380, 600, 7563, 53206, 374, 34228, 13, 1084, 594, 19323, 429, 902, 1378, 65623, 4332, 279, 1852, 2309, 4192, 15081, 5097, 70674, 5097, 825, 7546, 4102, 2293, 279, 1372, 315, 13530, 315, 65623, 892, 3359, 1817, 1008, 13, 14731, 15081, 40381, 34764, 2505, 198, 20, 198, 16, 220, 16, 198, 16, 220, 20, 198, 18, 220, 18, 198, 20, 220, 16, 198, 20, 220, 20, 271, 5097, 198, 21, 271, 2505, 198, 18, 198, 16, 220, 16, 198, 17, 220, 18, 198, 18, 220, 20, 271, 5097, 198, 15, 1022, 15081, 9112, 70674, 641, 279, 1156, 6077, 2701, 13530, 315, 65623, 3359, 1817, 1008, 25, 320, 16, 11, 220, 18, 701, 320, 16, 11, 220, 20, 701, 320, 17, 11, 220, 18, 701, 320, 17, 11, 220, 19, 701, 320, 18, 11, 220, 19, 8, 323, 320, 18, 11, 220, 20, 568, 393, 4720, 320, 16, 11, 220, 17, 701, 320, 16, 11, 220, 19, 701, 320, 17, 11, 220, 20, 8, 323, 320, 19, 11, 220, 20, 8, 653, 537, 3359, 1817, 1008, 1576, 807, 653, 537, 4332, 279, 1852, 37236, 624, 151645, 198, 151644, 77091, 198, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1490, 13, 576, 3491, 374, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 421, 807, 525, 389, 279, 1852, 37236, 13, 2055, 1817, 37236, 646, 16792, 1045, 13530, 11, 323, 279, 2790, 374, 279, 2629, 916, 678, 84018, 1127, 315, 279, 10601, 315, 65623, 304, 429, 37236, 4429, 1378, 518, 264, 882, 382, 5338, 11, 358, 1184, 311, 7071, 700, 1246, 311, 1874, 279, 65623, 1119, 862, 19511, 84018, 1127, 13, 2619, 525, 1378, 4494, 315, 84018, 1127, 25, 279, 6174, 429, 30232, 504, 1909, 7950, 311, 5622, 6701, 320, 1149, 594, 1618, 1105, 6785, 84018, 1127, 701, 323, 279, 6174, 429, 30232, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 84018, 1127, 3593, 2461, 264, 6785, 37236, 11, 279, 1376, 374, 856, 481, 379, 13, 9211, 3156, 1741, 264, 37236, 11, 279, 6672, 856, 481, 379, 8458, 6783, 13, 1752, 3110, 11, 320, 16, 11, 16, 8, 702, 856, 12034, 28, 15, 11, 320, 17, 11, 17, 8, 1083, 220, 15, 11, 4992, 13, 2055, 678, 65623, 389, 279, 1852, 6785, 37236, 686, 614, 279, 1852, 856, 12034, 897, 382, 2461, 279, 8225, 84018, 1127, 11, 279, 2629, 856, 488, 379, 374, 6783, 13, 8909, 320, 16, 11, 20, 8, 323, 320, 17, 11, 19, 8, 2176, 2629, 311, 220, 21, 13, 2055, 65623, 389, 279, 1852, 8225, 37236, 686, 614, 279, 1852, 856, 43010, 382, 4416, 279, 3119, 374, 1447, 16, 13, 1752, 1817, 53206, 11, 12564, 2176, 856, 12034, 323, 856, 43010, 624, 17, 13, 1752, 1817, 315, 1493, 1378, 2750, 11, 1874, 279, 65623, 553, 1105, 624, 18, 13, 1752, 1817, 1874, 448, 595, 65623, 11, 912, 595, 6599, 74, 12, 16, 5620, 17, 311, 279, 2790, 1760, 13, 9211, 1817, 6716, 304, 279, 1874, 42972, 311, 279, 2790, 382, 14190, 11, 1290, 13, 9211, 369, 894, 1874, 315, 1379, 595, 11, 279, 1372, 315, 13530, 374, 356, 5969, 11, 17, 8, 892, 374, 595, 6599, 74, 12, 16, 5620, 17, 382, 4416, 279, 7354, 525, 1447, 12, 54340, 916, 678, 65623, 624, 12, 1752, 1817, 11, 11047, 279, 1378, 6894, 25, 856, 12034, 323, 856, 43010, 624, 12, 5443, 57514, 311, 1760, 279, 1372, 315, 65623, 304, 1817, 37236, 320, 21028, 6785, 323, 8225, 4292, 12, 5005, 11, 369, 1817, 1760, 304, 279, 57514, 11, 12564, 279, 27459, 323, 2629, 1105, 678, 382, 14190, 11, 714, 279, 3491, 5302, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 1988, 1817, 53206, 374, 949, 315, 1378, 84018, 1127, 320, 30487, 323, 8225, 568, 4354, 11, 1378, 65623, 646, 1172, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 6785, 37236, 2726, 279, 1852, 8225, 37236, 13, 2055, 1817, 6716, 374, 29994, 3055, 421, 807, 4332, 2987, 315, 279, 1378, 84018, 1127, 382, 3983, 1246, 653, 582, 5648, 1990, 26580, 287, 30, 1752, 3110, 11, 1378, 65623, 1410, 387, 389, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 1988, 429, 594, 11997, 7241, 807, 525, 279, 1852, 1459, 11, 892, 4436, 944, 5420, 1588, 13, 9211, 421, 1378, 65623, 525, 389, 279, 1852, 856, 12034, 323, 1852, 856, 43010, 11, 1221, 21828, 856, 16, 488, 379, 16, 284, 856, 17, 488, 379, 17, 323, 856, 16, 481, 379, 16, 284, 856, 17, 481, 379, 17, 1035, 2968, 856, 16, 284, 856, 17, 323, 379, 16, 284, 379, 17, 11, 892, 646, 944, 3537, 2474, 279, 9892, 525, 4911, 13, 2055, 902, 1378, 65623, 646, 387, 389, 2176, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 2055, 369, 1817, 6716, 315, 65623, 11, 807, 525, 29994, 2987, 3055, 320, 333, 807, 4332, 2987, 6785, 476, 8225, 37236, 8, 476, 537, 518, 678, 13, 15277, 11, 279, 2629, 315, 279, 27459, 504, 2176, 6785, 323, 8225, 84018, 1127, 686, 2968, 279, 4396, 2790, 382, 4416, 279, 5486, 374, 4396, 13, 2055, 1431, 11, 279, 2038, 7354, 1447, 4418, 308, 382, 12209, 369, 1817, 315, 279, 308, 65623, 11, 1349, 856, 5318, 323, 379, 5318, 382, 46254, 369, 1817, 53206, 1447, 1242, 61304, 284, 856, 488, 379, 198, 13490, 61304, 284, 856, 481, 379, 271, 1654, 1184, 311, 3754, 279, 1372, 315, 65623, 304, 1817, 2629, 61304, 323, 1817, 3638, 61304, 382, 4416, 1378, 57514, 25, 825, 369, 36398, 11, 825, 369, 86947, 382, 12209, 11, 369, 1817, 1376, 304, 36398, 11, 912, 356, 11512, 11, 220, 17, 8, 311, 279, 2790, 382, 19198, 369, 279, 86947, 382, 4416, 279, 2038, 686, 387, 1447, 9928, 2629, 25977, 323, 3638, 25977, 438, 1638, 97599, 320, 269, 5792, 97599, 11, 17271, 311, 220, 15, 3593, 2461, 1817, 856, 11, 379, 1447, 1242, 3097, 284, 856, 488, 379, 271, 13490, 3097, 284, 856, 481, 379, 271, 1242, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 271, 13490, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 271, 12209, 11, 2790, 284, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 2629, 25977, 10656, 368, 873, 488, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 3638, 25977, 10656, 368, 5125, 4792, 594, 279, 4226, 382, 3983, 2474, 308, 646, 387, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 11, 323, 369, 1817, 315, 1105, 582, 1882, 1378, 57514, 11, 419, 1265, 387, 11050, 3322, 13, 9211, 1496, 448, 220, 17, 15, 15, 11, 15, 15, 15, 10695, 11, 279, 57514, 646, 3705, 429, 13, 1597, 279, 2629, 374, 506, 1255, 701, 1380, 296, 374, 279, 1372, 315, 6894, 304, 1817, 10997, 11, 892, 374, 518, 1429, 220, 17, 15, 15, 11, 15, 15, 15, 353, 220, 17, 304, 279, 11785, 1142, 11, 892, 374, 70028, 382, 16451, 279, 1156, 3110, 1447, 2505, 220, 20, 1447, 45793, 525, 320, 16, 11, 16, 701, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 701, 320, 20, 11, 20, 3593, 22464, 518, 2629, 61304, 1447, 7, 16, 10, 16, 11730, 17, 11, 320, 16, 10, 20, 11730, 21, 11, 320, 18, 10, 18, 11730, 21, 11, 320, 20, 10, 16, 11730, 21, 11, 320, 20, 10, 20, 11730, 16, 15, 382, 4416, 2629, 25977, 1447, 17, 25, 220, 16, 271, 21, 25, 220, 18, 320, 27436, 220, 16, 11, 20, 26, 220, 18, 11, 18, 26, 20, 11, 16, 57777, 14190, 3783, 11, 320, 16, 11, 20, 8, 2629, 374, 220, 21, 11, 320, 18, 11, 18, 8, 2629, 374, 220, 21, 11, 320, 20, 11, 16, 8, 2629, 374, 220, 21, 13, 2055, 2629, 220, 21, 702, 1760, 220, 18, 382, 12209, 11, 2629, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 785, 1008, 2629, 14579, 525, 220, 17, 25, 16, 11, 220, 16, 15, 25, 16, 13, 2055, 2629, 18527, 374, 220, 18, 382, 2461, 279, 3638, 61304, 1447, 7, 16, 12, 16, 11730, 15, 11, 320, 16, 12, 20, 8, 10829, 19, 11, 320, 18, 12, 18, 11730, 15, 11, 320, 20, 12, 16, 11730, 19, 11, 320, 20, 12, 20, 11730, 15, 382, 13490, 25977, 1447, 15, 25, 18, 320, 27436, 220, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 692, 12, 19, 25, 16, 271, 19, 25, 16, 382, 4416, 3638, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 4416, 2790, 2629, 374, 220, 18, 320, 1242, 8, 488, 220, 18, 320, 13490, 8, 284, 220, 21, 13, 15920, 9071, 279, 1156, 3110, 594, 2550, 382, 9454, 11, 429, 594, 4396, 382, 14037, 3110, 1447, 2505, 220, 18, 1447, 7, 16, 11, 16, 701, 320, 17, 11, 18, 701, 320, 18, 11, 20, 3593, 1242, 61304, 1447, 16, 10, 16, 28, 17, 320, 1830, 220, 16, 692, 17, 10, 18, 28, 20, 320, 1830, 220, 16, 692, 18, 10, 20, 28, 23, 320, 1830, 220, 16, 568, 8116, 18527, 220, 15, 382, 13490, 61304, 1447, 16, 12, 16, 28, 15, 320, 1830, 16, 692, 17, 12, 18, 284, 481, 16, 320, 1830, 16, 692, 18, 12, 20, 284, 481, 17, 320, 1830, 16, 568, 2055, 3638, 18527, 220, 15, 382, 7595, 220, 15, 13, 39970, 382, 4416, 279, 2038, 1265, 975, 382, 7039, 11, 10822, 419, 304, 13027, 382, 785, 2038, 1265, 1349, 504, 31369, 13, 5005, 11, 12564, 279, 2629, 323, 3638, 14579, 382, 62980, 438, 1447, 4418, 308, 382, 1242, 25977, 284, 42908, 1548, 692, 13490, 25977, 284, 42908, 1548, 692, 1958, 716, 304, 2088, 1445, 7731, 262, 856, 11, 379, 284, 2415, 1548, 11, 1946, 1005, 6960, 12367, 262, 274, 284, 856, 488, 379, 271, 262, 294, 284, 856, 481, 379, 271, 262, 2629, 25977, 11880, 60, 1421, 220, 16, 271, 262, 3638, 25977, 21427, 60, 1421, 220, 16, 271, 5035, 284, 220, 15, 271, 1958, 272, 304, 2629, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1958, 272, 304, 3638, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1350, 22842, 692, 9454, 11, 429, 594, 30339, 382, 16451, 448, 279, 1156, 3110, 1447, 1242, 25977, 369, 220, 21, 374, 220, 18, 320, 1499, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 4579, 2055, 220, 18, 9, 17, 14, 17, 284, 18, 382, 13490, 25977, 369, 220, 15, 374, 220, 18, 320, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 8, 11397, 220, 18, 13, 2055, 2790, 220, 21, 382, 14037, 3110, 11, 438, 1573, 382, 3983, 279, 2038, 15804, 504, 31369, 13, 2055, 279, 729, 1265, 387, 5326, 311, 1349, 11127, 11, 1882, 11, 323, 2550, 382, 3983, 279, 3491, 2727, 311, 6923, 458, 32156, 13027, 729, 429, 15804, 31369, 323, 23473, 279, 2550, 382, 4416, 279, 2038, 1035, 387, 1447, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 1173, 22842, 692, 3817, 2822, 3983, 304, 279, 3491, 5114, 11, 279, 729, 1265, 387, 2598, 1283, 7271, 13, 2055, 429, 594, 4396, 382, 9454, 11, 429, 594, 279, 2038, 13, 1084, 1265, 3705, 678, 5048, 382, 11656, 46024, 1447, 77, 28, 16, 25, 2550, 220, 15, 382, 77, 28, 17, 11, 1852, 2629, 476, 1852, 3638, 25, 2550, 220, 16, 382, 3983, 279, 2038, 4278, 382, 14037, 1142, 25, 65623, 304, 1852, 2629, 714, 2155, 86947, 13, 2055, 807, 16792, 220, 16, 6716, 13, 2521, 1852, 3638, 714, 2155, 2629, 11, 16792, 220, 16, 382, 4416, 2038, 4977, 4396, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 8253, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 37236, 11, 2987, 504, 1909, 7950, 311, 5622, 6701, 320, 30487, 37236, 8, 476, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 37236, 3593, 14374, 53084, 198, 16, 13, 3070, 28301, 1437, 7767, 6113, 1127, 95518, 8886, 53206, 646, 387, 949, 315, 1378, 84018, 1127, 510, 256, 481, 3070, 35490, 7767, 23450, 95518, 15633, 1506, 553, 279, 6672, 17767, 87, 481, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 6785, 37236, 624, 256, 481, 3070, 38489, 7767, 23450, 95518, 15633, 1506, 553, 279, 2629, 17767, 87, 488, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 8225, 37236, 382, 17, 13, 3070, 2507, 425, 50109, 389, 8886, 7767, 23450, 95518, 5443, 1378, 57514, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 6785, 323, 8225, 37236, 13, 576, 1376, 369, 6785, 84018, 1127, 374, 17767, 87, 481, 379, 57758, 323, 369, 8225, 84018, 1127, 374, 17767, 87, 488, 379, 59, 3593, 18, 13, 3070, 47866, 393, 4720, 95518, 1752, 1817, 37236, 320, 21028, 6785, 323, 8225, 701, 421, 1052, 525, 17767, 74, 57758, 65623, 389, 264, 37236, 11, 279, 1372, 315, 22818, 13530, 374, 2661, 553, 279, 10601, 14806, 17767, 34, 5969, 11, 220, 17, 8, 284, 595, 1124, 15136, 320, 74, 481, 220, 16, 8, 608, 220, 17, 59, 568, 8116, 1493, 2750, 369, 678, 84018, 1127, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 1173, 22842, 692, 3817, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 504, 5297, 1946, 13, 576, 1156, 1555, 5610, 279, 1372, 315, 65623, 11, 8110, 553, 862, 9892, 624, 17, 13, 3070, 37119, 7767, 6113, 1127, 95518, 9043, 57514, 11, 1565, 1242, 25977, 63, 323, 1565, 13490, 25977, 7808, 525, 1483, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 8225, 323, 6785, 37236, 11, 15576, 624, 18, 13, 3070, 57908, 1095, 393, 4720, 95518, 1752, 1817, 37236, 320, 1242, 323, 6672, 701, 582, 11047, 279, 1372, 315, 13530, 1667, 279, 10601, 14806, 323, 2629, 1493, 2750, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 1986, 5486, 29720, 5203, 65623, 553, 862, 84018, 1127, 323, 47417, 279, 22818, 13530, 304, 13482, 882, 11, 3259, 432, 14452, 369, 3460, 1946, 12282, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 65623, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] [Labels]: [-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1490, 13, 576, 3491, 374, 311, 1760, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 421, 807, 525, 389, 279, 1852, 37236, 13, 2055, 1817, 37236, 646, 16792, 1045, 13530, 11, 323, 279, 2790, 374, 279, 2629, 916, 678, 84018, 1127, 315, 279, 10601, 315, 65623, 304, 429, 37236, 4429, 1378, 518, 264, 882, 382, 5338, 11, 358, 1184, 311, 7071, 700, 1246, 311, 1874, 279, 65623, 1119, 862, 19511, 84018, 1127, 13, 2619, 525, 1378, 4494, 315, 84018, 1127, 25, 279, 6174, 429, 30232, 504, 1909, 7950, 311, 5622, 6701, 320, 1149, 594, 1618, 1105, 6785, 84018, 1127, 701, 323, 279, 6174, 429, 30232, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 84018, 1127, 3593, 2461, 264, 6785, 37236, 11, 279, 1376, 374, 856, 481, 379, 13, 9211, 3156, 1741, 264, 37236, 11, 279, 6672, 856, 481, 379, 8458, 6783, 13, 1752, 3110, 11, 320, 16, 11, 16, 8, 702, 856, 12034, 28, 15, 11, 320, 17, 11, 17, 8, 1083, 220, 15, 11, 4992, 13, 2055, 678, 65623, 389, 279, 1852, 6785, 37236, 686, 614, 279, 1852, 856, 12034, 897, 382, 2461, 279, 8225, 84018, 1127, 11, 279, 2629, 856, 488, 379, 374, 6783, 13, 8909, 320, 16, 11, 20, 8, 323, 320, 17, 11, 19, 8, 2176, 2629, 311, 220, 21, 13, 2055, 65623, 389, 279, 1852, 8225, 37236, 686, 614, 279, 1852, 856, 43010, 382, 4416, 279, 3119, 374, 1447, 16, 13, 1752, 1817, 53206, 11, 12564, 2176, 856, 12034, 323, 856, 43010, 624, 17, 13, 1752, 1817, 315, 1493, 1378, 2750, 11, 1874, 279, 65623, 553, 1105, 624, 18, 13, 1752, 1817, 1874, 448, 595, 65623, 11, 912, 595, 6599, 74, 12, 16, 5620, 17, 311, 279, 2790, 1760, 13, 9211, 1817, 6716, 304, 279, 1874, 42972, 311, 279, 2790, 382, 14190, 11, 1290, 13, 9211, 369, 894, 1874, 315, 1379, 595, 11, 279, 1372, 315, 13530, 374, 356, 5969, 11, 17, 8, 892, 374, 595, 6599, 74, 12, 16, 5620, 17, 382, 4416, 279, 7354, 525, 1447, 12, 54340, 916, 678, 65623, 624, 12, 1752, 1817, 11, 11047, 279, 1378, 6894, 25, 856, 12034, 323, 856, 43010, 624, 12, 5443, 57514, 311, 1760, 279, 1372, 315, 65623, 304, 1817, 37236, 320, 21028, 6785, 323, 8225, 4292, 12, 5005, 11, 369, 1817, 1760, 304, 279, 57514, 11, 12564, 279, 27459, 323, 2629, 1105, 678, 382, 14190, 11, 714, 279, 3491, 5302, 429, 1378, 65623, 3359, 1817, 1008, 421, 807, 4332, 279, 1852, 37236, 13, 1988, 1817, 53206, 374, 949, 315, 1378, 84018, 1127, 320, 30487, 323, 8225, 568, 4354, 11, 1378, 65623, 646, 1172, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 6785, 37236, 2726, 279, 1852, 8225, 37236, 13, 2055, 1817, 6716, 374, 29994, 3055, 421, 807, 4332, 2987, 315, 279, 1378, 84018, 1127, 382, 3983, 1246, 653, 582, 5648, 1990, 26580, 287, 30, 1752, 3110, 11, 1378, 65623, 1410, 387, 389, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 1988, 429, 594, 11997, 7241, 807, 525, 279, 1852, 1459, 11, 892, 4436, 944, 5420, 1588, 13, 9211, 421, 1378, 65623, 525, 389, 279, 1852, 856, 12034, 323, 1852, 856, 43010, 11, 1221, 21828, 856, 16, 488, 379, 16, 284, 856, 17, 488, 379, 17, 323, 856, 16, 481, 379, 16, 284, 856, 17, 481, 379, 17, 1035, 2968, 856, 16, 284, 856, 17, 323, 379, 16, 284, 379, 17, 11, 892, 646, 944, 3537, 2474, 279, 9892, 525, 4911, 13, 2055, 902, 1378, 65623, 646, 387, 389, 2176, 279, 1852, 6785, 323, 1852, 8225, 37236, 13, 2055, 369, 1817, 6716, 315, 65623, 11, 807, 525, 29994, 2987, 3055, 320, 333, 807, 4332, 2987, 6785, 476, 8225, 37236, 8, 476, 537, 518, 678, 13, 15277, 11, 279, 2629, 315, 279, 27459, 504, 2176, 6785, 323, 8225, 84018, 1127, 686, 2968, 279, 4396, 2790, 382, 4416, 279, 5486, 374, 4396, 13, 2055, 1431, 11, 279, 2038, 7354, 1447, 4418, 308, 382, 12209, 369, 1817, 315, 279, 308, 65623, 11, 1349, 856, 5318, 323, 379, 5318, 382, 46254, 369, 1817, 53206, 1447, 1242, 61304, 284, 856, 488, 379, 198, 13490, 61304, 284, 856, 481, 379, 271, 1654, 1184, 311, 3754, 279, 1372, 315, 65623, 304, 1817, 2629, 61304, 323, 1817, 3638, 61304, 382, 4416, 1378, 57514, 25, 825, 369, 36398, 11, 825, 369, 86947, 382, 12209, 11, 369, 1817, 1376, 304, 36398, 11, 912, 356, 11512, 11, 220, 17, 8, 311, 279, 2790, 382, 19198, 369, 279, 86947, 382, 4416, 279, 2038, 686, 387, 1447, 9928, 2629, 25977, 323, 3638, 25977, 438, 1638, 97599, 320, 269, 5792, 97599, 11, 17271, 311, 220, 15, 3593, 2461, 1817, 856, 11, 379, 1447, 1242, 3097, 284, 856, 488, 379, 271, 13490, 3097, 284, 856, 481, 379, 271, 1242, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 271, 13490, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 271, 12209, 11, 2790, 284, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 2629, 25977, 10656, 368, 873, 488, 2629, 7, 320, 66, 6599, 66, 12, 16, 27151, 17, 8, 369, 272, 304, 3638, 25977, 10656, 368, 5125, 4792, 594, 279, 4226, 382, 3983, 2474, 308, 646, 387, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 11, 323, 369, 1817, 315, 1105, 582, 1882, 1378, 57514, 11, 419, 1265, 387, 11050, 3322, 13, 9211, 1496, 448, 220, 17, 15, 15, 11, 15, 15, 15, 10695, 11, 279, 57514, 646, 3705, 429, 13, 1597, 279, 2629, 374, 506, 1255, 701, 1380, 296, 374, 279, 1372, 315, 6894, 304, 1817, 10997, 11, 892, 374, 518, 1429, 220, 17, 15, 15, 11, 15, 15, 15, 353, 220, 17, 304, 279, 11785, 1142, 11, 892, 374, 70028, 382, 16451, 279, 1156, 3110, 1447, 2505, 220, 20, 1447, 45793, 525, 320, 16, 11, 16, 701, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 701, 320, 20, 11, 20, 3593, 22464, 518, 2629, 61304, 1447, 7, 16, 10, 16, 11730, 17, 11, 320, 16, 10, 20, 11730, 21, 11, 320, 18, 10, 18, 11730, 21, 11, 320, 20, 10, 16, 11730, 21, 11, 320, 20, 10, 20, 11730, 16, 15, 382, 4416, 2629, 25977, 1447, 17, 25, 220, 16, 271, 21, 25, 220, 18, 320, 27436, 220, 16, 11, 20, 26, 220, 18, 11, 18, 26, 20, 11, 16, 57777, 14190, 3783, 11, 320, 16, 11, 20, 8, 2629, 374, 220, 21, 11, 320, 18, 11, 18, 8, 2629, 374, 220, 21, 11, 320, 20, 11, 16, 8, 2629, 374, 220, 21, 13, 2055, 2629, 220, 21, 702, 1760, 220, 18, 382, 12209, 11, 2629, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 785, 1008, 2629, 14579, 525, 220, 17, 25, 16, 11, 220, 16, 15, 25, 16, 13, 2055, 2629, 18527, 374, 220, 18, 382, 2461, 279, 3638, 61304, 1447, 7, 16, 12, 16, 11730, 15, 11, 320, 16, 12, 20, 8, 10829, 19, 11, 320, 18, 12, 18, 11730, 15, 11, 320, 20, 12, 16, 11730, 19, 11, 320, 20, 12, 20, 11730, 15, 382, 13490, 25977, 1447, 15, 25, 18, 320, 27436, 220, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 692, 12, 19, 25, 16, 271, 19, 25, 16, 382, 4416, 3638, 18527, 374, 220, 18, 5157, 220, 17, 284, 220, 18, 382, 4416, 2790, 2629, 374, 220, 18, 320, 1242, 8, 488, 220, 18, 320, 13490, 8, 284, 220, 21, 13, 15920, 9071, 279, 1156, 3110, 594, 2550, 382, 9454, 11, 429, 594, 4396, 382, 14037, 3110, 1447, 2505, 220, 18, 1447, 7, 16, 11, 16, 701, 320, 17, 11, 18, 701, 320, 18, 11, 20, 3593, 1242, 61304, 1447, 16, 10, 16, 28, 17, 320, 1830, 220, 16, 692, 17, 10, 18, 28, 20, 320, 1830, 220, 16, 692, 18, 10, 20, 28, 23, 320, 1830, 220, 16, 568, 8116, 18527, 220, 15, 382, 13490, 61304, 1447, 16, 12, 16, 28, 15, 320, 1830, 16, 692, 17, 12, 18, 284, 481, 16, 320, 1830, 16, 692, 18, 12, 20, 284, 481, 17, 320, 1830, 16, 568, 2055, 3638, 18527, 220, 15, 382, 7595, 220, 15, 13, 39970, 382, 4416, 279, 2038, 1265, 975, 382, 7039, 11, 10822, 419, 304, 13027, 382, 785, 2038, 1265, 1349, 504, 31369, 13, 5005, 11, 12564, 279, 2629, 323, 3638, 14579, 382, 62980, 438, 1447, 4418, 308, 382, 1242, 25977, 284, 42908, 1548, 692, 13490, 25977, 284, 42908, 1548, 692, 1958, 716, 304, 2088, 1445, 7731, 262, 856, 11, 379, 284, 2415, 1548, 11, 1946, 1005, 6960, 12367, 262, 274, 284, 856, 488, 379, 271, 262, 294, 284, 856, 481, 379, 271, 262, 2629, 25977, 11880, 60, 1421, 220, 16, 271, 262, 3638, 25977, 21427, 60, 1421, 220, 16, 271, 5035, 284, 220, 15, 271, 1958, 272, 304, 2629, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1958, 272, 304, 3638, 25977, 10656, 39974, 262, 2790, 1421, 272, 353, 320, 66, 12, 16, 8, 442, 220, 17, 271, 1350, 22842, 692, 9454, 11, 429, 594, 30339, 382, 16451, 448, 279, 1156, 3110, 1447, 1242, 25977, 369, 220, 21, 374, 220, 18, 320, 1499, 320, 16, 11, 20, 701, 320, 18, 11, 18, 701, 320, 20, 11, 16, 4579, 2055, 220, 18, 9, 17, 14, 17, 284, 18, 382, 13490, 25977, 369, 220, 15, 374, 220, 18, 320, 16, 11, 16, 26, 18, 11, 18, 26, 20, 11, 20, 8, 11397, 220, 18, 13, 2055, 2790, 220, 21, 382, 14037, 3110, 11, 438, 1573, 382, 3983, 279, 2038, 15804, 504, 31369, 13, 2055, 279, 729, 1265, 387, 5326, 311, 1349, 11127, 11, 1882, 11, 323, 2550, 382, 3983, 279, 3491, 2727, 311, 6923, 458, 32156, 13027, 729, 429, 15804, 31369, 323, 23473, 279, 2550, 382, 4416, 279, 2038, 1035, 387, 1447, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 16, 8, 442, 17, 198, 262, 1173, 22842, 692, 3817, 2822, 3983, 304, 279, 3491, 5114, 11, 279, 729, 1265, 387, 2598, 1283, 7271, 13, 2055, 429, 594, 4396, 382, 9454, 11, 429, 594, 279, 2038, 13, 1084, 1265, 3705, 678, 5048, 382, 11656, 46024, 1447, 77, 28, 16, 25, 2550, 220, 15, 382, 77, 28, 17, 11, 1852, 2629, 476, 1852, 3638, 25, 2550, 220, 16, 382, 3983, 279, 2038, 4278, 382, 14037, 1142, 25, 65623, 304, 1852, 2629, 714, 2155, 86947, 13, 2055, 807, 16792, 220, 16, 6716, 13, 2521, 1852, 3638, 714, 2155, 2629, 11, 16792, 220, 16, 382, 4416, 2038, 4977, 4396, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 8253, 279, 1372, 315, 13530, 315, 65623, 429, 3359, 1817, 1008, 389, 264, 220, 16, 15, 15, 15, 87, 16, 15, 15, 15, 5827, 13, 425, 50109, 3359, 1817, 1008, 421, 807, 525, 389, 279, 1852, 37236, 11, 2987, 504, 1909, 7950, 311, 5622, 6701, 320, 30487, 37236, 8, 476, 504, 1909, 6701, 311, 5622, 7950, 320, 42224, 37236, 3593, 14374, 53084, 198, 16, 13, 3070, 28301, 1437, 7767, 6113, 1127, 95518, 8886, 53206, 646, 387, 949, 315, 1378, 84018, 1127, 510, 256, 481, 3070, 35490, 7767, 23450, 95518, 15633, 1506, 553, 279, 6672, 17767, 87, 481, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 6785, 37236, 624, 256, 481, 3070, 38489, 7767, 23450, 95518, 15633, 1506, 553, 279, 2629, 17767, 87, 488, 379, 59, 701, 892, 8458, 6783, 369, 678, 9892, 389, 279, 1852, 8225, 37236, 382, 17, 13, 3070, 2507, 425, 50109, 389, 8886, 7767, 23450, 95518, 5443, 1378, 57514, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 6785, 323, 8225, 37236, 13, 576, 1376, 369, 6785, 84018, 1127, 374, 17767, 87, 481, 379, 57758, 323, 369, 8225, 84018, 1127, 374, 17767, 87, 488, 379, 59, 3593, 18, 13, 3070, 47866, 393, 4720, 95518, 1752, 1817, 37236, 320, 21028, 6785, 323, 8225, 701, 421, 1052, 525, 17767, 74, 57758, 65623, 389, 264, 37236, 11, 279, 1372, 315, 22818, 13530, 374, 2661, 553, 279, 10601, 14806, 17767, 34, 5969, 11, 220, 17, 8, 284, 595, 1124, 15136, 320, 74, 481, 220, 16, 8, 608, 220, 17, 59, 568, 8116, 1493, 2750, 369, 678, 84018, 1127, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 198, 1499, 15302, 1159, 42908, 271, 750, 1887, 3932, 262, 308, 284, 526, 18140, 43184, 31800, 2398, 262, 2629, 25977, 284, 42908, 1548, 340, 262, 3638, 25977, 284, 42908, 1548, 340, 262, 369, 716, 304, 2088, 1445, 982, 286, 856, 11, 379, 284, 2415, 1548, 11, 5708, 43184, 31800, 1005, 6960, 2398, 286, 2629, 3097, 284, 856, 488, 379, 198, 286, 3638, 3097, 284, 856, 481, 379, 198, 286, 2629, 25977, 58, 1242, 3097, 60, 1421, 220, 16, 198, 286, 3638, 25977, 58, 13490, 3097, 60, 1421, 220, 16, 198, 262, 2790, 284, 220, 15, 198, 262, 369, 13195, 304, 2629, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 369, 13195, 304, 3638, 25977, 10656, 3932, 286, 2790, 1421, 13195, 353, 320, 15853, 481, 220, 16, 8, 442, 220, 17, 198, 262, 1173, 22842, 692, 3817, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 504, 5297, 1946, 13, 576, 1156, 1555, 5610, 279, 1372, 315, 65623, 11, 8110, 553, 862, 9892, 624, 17, 13, 3070, 37119, 7767, 6113, 1127, 95518, 9043, 57514, 11, 1565, 1242, 25977, 63, 323, 1565, 13490, 25977, 7808, 525, 1483, 311, 1760, 279, 1372, 315, 65623, 389, 1817, 8225, 323, 6785, 37236, 11, 15576, 624, 18, 13, 3070, 57908, 1095, 393, 4720, 95518, 1752, 1817, 37236, 320, 1242, 323, 6672, 701, 582, 11047, 279, 1372, 315, 13530, 1667, 279, 10601, 14806, 323, 2629, 1493, 2750, 311, 633, 279, 2790, 1372, 315, 22818, 13530, 382, 1986, 5486, 29720, 5203, 65623, 553, 862, 84018, 1127, 323, 47417, 279, 22818, 13530, 304, 13482, 882, 11, 3259, 432, 14452, 369, 3460, 1946, 12282, 705, 311, 220, 17, 15, 15, 11, 15, 15, 15, 65623, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] ================================================================================ >>> End of first sample inspection <<< ================================================================================ ================================================================================ >>> Printing the first sample of the first training batch <<< ================================================================================ [Input IDs]: [151644, 8948, 198, 7771, 3476, 438, 458, 17847, 17601, 26364, 23966, 4755, 1526, 264, 36438, 1293, 7274, 1882, 1573, 8241, 279, 1590, 23560, 323, 13382, 9904, 13, 1096, 7460, 22570, 304, 264, 15817, 10775, 315, 6358, 11, 28285, 4849, 11, 26403, 11, 31734, 23391, 11, 21844, 11, 1182, 376, 4527, 11, 323, 19569, 311, 2225, 1632, 12, 24712, 291, 7274, 1882, 13, 5209, 5944, 697, 2033, 1119, 1378, 1887, 14158, 25, 35187, 323, 12478, 13, 758, 279, 35187, 3772, 11, 7716, 697, 32711, 1882, 1667, 279, 5189, 3561, 25, 82639, 7265, 3575, 5854, 2450, 91, 29, 314, 60565, 448, 7354, 18663, 448, 5196, 77, 1699, 8275, 82639, 408, 3575, 5854, 2450, 91, 29, 8886, 3019, 1265, 2924, 11682, 37764, 1741, 438, 3181, 285, 7024, 4755, 11, 28285, 4849, 9760, 14613, 11, 86781, 287, 501, 6708, 11, 68863, 279, 13403, 315, 279, 1482, 7354, 11, 73185, 894, 5975, 11, 323, 17493, 5853, 3681, 7354, 13, 758, 279, 12478, 3772, 11, 3118, 389, 5257, 13553, 11, 47439, 804, 11, 323, 62751, 504, 279, 35187, 3772, 11, 59726, 3042, 279, 1590, 6291, 429, 498, 81477, 4396, 13, 576, 6291, 1265, 7146, 264, 19819, 11, 13382, 11, 63594, 7493, 1707, 323, 7716, 5871, 3019, 4362, 311, 5545, 279, 16688, 11, 23126, 438, 11017, 25, 82639, 7265, 3575, 50274, 91, 29, 314, 11822, 23126, 11, 23560, 11, 323, 2797, 6291, 92, 82639, 408, 3575, 50274, 91, 29, 4695, 11, 1430, 311, 11625, 279, 2701, 3405, 1526, 279, 3403, 17501, 25, 151645, 198, 151644, 872, 198, 5598, 697, 1590, 2033, 2878, 1124, 79075, 46391, 362, 29238, 10788, 1045, 11561, 518, 264, 11089, 315, 400, 17, 15, 59, 4, 3, 315, 279, 1140, 3349, 13, 1260, 6801, 311, 1868, 1105, 518, 1741, 264, 3349, 429, 566, 646, 2968, 264, 11089, 315, 400, 17, 15, 59, 4, 3, 315, 279, 12864, 3349, 323, 2058, 1281, 264, 11372, 315, 400, 17, 15, 59, 4, 3, 315, 279, 11236, 3349, 13, 576, 817, 2889, 315, 279, 1140, 3349, 518, 892, 566, 1265, 1868, 1105, 374, 510, 58736, 1318, 13233, 96065, 32, 8, 1124, 335, 17, 15, 220, 1124, 80, 31610, 1124, 1318, 13233, 96065, 33, 8, 1124, 335, 16, 15, 15, 1124, 80, 31610, 1124, 1318, 13233, 96065, 34, 8, 1124, 335, 16, 17, 20, 1124, 80, 31610, 1124, 1318, 13233, 96065, 35, 8, 1124, 335, 23, 15, 1124, 80, 31610, 1124, 1318, 13233, 96065, 36, 8, 1124, 335, 16, 17, 15, 3, 151645, 198, 151644, 77091, 198, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1430, 311, 21403, 419, 3491, 3019, 553, 3019, 13, 88190, 11, 773, 279, 29238, 10788, 11561, 518, 264, 220, 17, 15, 4, 11089, 1007, 279, 1140, 3349, 13, 5005, 566, 6801, 311, 738, 264, 12864, 3349, 1741, 429, 1496, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 11, 566, 2058, 3643, 264, 220, 17, 15, 4, 11372, 389, 279, 11236, 3349, 13, 1205, 1184, 311, 1477, 1128, 11414, 315, 279, 1140, 3349, 566, 1265, 1868, 705, 279, 11561, 13, 576, 2606, 525, 2661, 11, 714, 358, 1184, 311, 7071, 432, 700, 59726, 382, 5338, 11, 1077, 752, 4715, 279, 3491, 1549, 311, 1281, 2704, 358, 3535, 678, 279, 3793, 13, 576, 1140, 3349, 374, 279, 4024, 3349, 1573, 894, 31062, 13, 576, 29238, 49531, 279, 11561, 518, 220, 17, 15, 4, 1007, 419, 1140, 3349, 13, 2055, 806, 2783, 3349, 374, 220, 23, 15, 4, 315, 279, 1140, 3349, 13, 5005, 566, 6801, 311, 738, 264, 12864, 3349, 13, 3197, 566, 30778, 11, 566, 6696, 264, 220, 17, 15, 4, 11089, 389, 419, 12864, 3349, 11, 323, 1283, 429, 11089, 11, 806, 11236, 3349, 1265, 2058, 2968, 1435, 264, 220, 17, 15, 4, 11372, 3118, 389, 279, 11236, 3349, 5086, 13, 13824, 11, 11372, 374, 5990, 16588, 3118, 389, 2783, 3349, 11, 1290, 30, 576, 3491, 2727, 330, 64, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 1189, 2938, 594, 264, 2699, 30615, 13, 6771, 752, 5185, 429, 382, 10061, 752, 3270, 1495, 279, 1376, 3501, 1447, 16, 13, 55399, 594, 2783, 3349, 320, 34, 8, 284, 1759, 3349, 320, 43, 8, 481, 220, 17, 15, 4, 315, 444, 284, 220, 23, 15, 4, 315, 444, 284, 220, 15, 13, 23, 43, 198, 17, 13, 4389, 291, 3349, 320, 44, 8, 374, 1128, 582, 1184, 311, 1477, 438, 264, 11414, 315, 444, 624, 18, 13, 53720, 3349, 320, 50, 8, 284, 4389, 291, 3349, 481, 220, 17, 15, 4, 315, 386, 284, 220, 23, 15, 4, 315, 386, 284, 220, 15, 13, 23, 44, 198, 19, 13, 57782, 284, 220, 17, 15, 4, 315, 53720, 8483, 284, 220, 15, 13, 17, 50, 198, 20, 13, 15277, 11, 53720, 8483, 284, 11194, 8483, 488, 57782, 198, 256, 589, 328, 284, 356, 488, 220, 15, 13, 17, 50, 271, 14190, 11, 419, 374, 279, 9023, 949, 13, 576, 11372, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 537, 220, 17, 15, 4, 315, 279, 2783, 3349, 13, 2055, 421, 358, 55327, 844, 279, 23606, 328, 284, 356, 488, 220, 15, 13, 17, 50, 11, 1221, 328, 481, 220, 15, 13, 17, 50, 284, 356, 589, 220, 15, 13, 23, 50, 284, 356, 13, 15277, 11, 328, 284, 356, 608, 220, 15, 13, 23, 382, 3983, 582, 1414, 429, 356, 374, 220, 15, 13, 23, 43, 11, 773, 31334, 10607, 429, 304, 11, 328, 284, 220, 15, 13, 23, 43, 608, 220, 15, 13, 23, 284, 444, 13, 2055, 279, 11236, 3349, 1969, 387, 6144, 311, 279, 1140, 3349, 30, 1988, 1221, 279, 11236, 3349, 374, 1083, 220, 15, 13, 23, 44, 320, 11284, 566, 6696, 264, 220, 17, 15, 4, 11089, 568, 15277, 11, 220, 15, 13, 23, 44, 284, 444, 589, 386, 284, 444, 608, 220, 15, 13, 23, 284, 220, 16, 13, 17, 20, 43, 13, 2055, 386, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 15277, 11, 279, 4226, 1265, 387, 220, 16, 17, 20, 13384, 892, 374, 2999, 356, 13, 6771, 752, 1779, 419, 1549, 311, 1281, 2704, 382, 92014, 11, 1077, 752, 653, 432, 3019, 553, 3019, 448, 7332, 382, 10061, 752, 78064, 1447, 12, 6771, 279, 1140, 3349, 387, 444, 624, 12, 55399, 594, 2783, 3349, 11, 356, 284, 220, 15, 13, 23, 43, 320, 11284, 566, 10788, 518, 220, 17, 15, 4, 11089, 340, 12, 6771, 279, 12864, 3349, 387, 386, 320, 8206, 374, 264, 11414, 315, 444, 11, 582, 1184, 311, 1477, 419, 11414, 340, 12, 53720, 3349, 11, 328, 284, 386, 481, 220, 15, 13, 17, 44, 284, 220, 15, 13, 23, 44, 198, 12, 57782, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 773, 57782, 284, 220, 15, 13, 17, 50, 198, 12, 57782, 374, 1083, 53720, 8483, 481, 11194, 8483, 25, 328, 481, 356, 198, 12, 15277, 11, 328, 481, 356, 284, 220, 15, 13, 17, 50, 589, 328, 481, 220, 15, 13, 17, 50, 284, 356, 589, 220, 15, 13, 23, 50, 284, 356, 198, 12, 87149, 328, 284, 220, 15, 13, 23, 44, 1119, 419, 25, 220, 15, 13, 23, 6599, 15, 13, 23, 44, 8, 284, 356, 589, 220, 15, 13, 21, 19, 44, 284, 356, 198, 12, 1988, 582, 1414, 356, 284, 220, 15, 13, 23, 43, 11, 773, 220, 15, 13, 21, 19, 44, 284, 220, 15, 13, 23, 43, 198, 12, 11473, 4405, 369, 386, 25, 386, 284, 320, 15, 13, 23, 43, 8, 608, 220, 15, 13, 21, 19, 284, 320, 15, 13, 23, 608, 220, 15, 13, 21, 19, 33442, 284, 320, 23, 15, 608, 220, 21, 19, 33442, 284, 320, 20, 608, 220, 19, 33442, 284, 220, 16, 13, 17, 20, 43, 198, 12, 15277, 11, 386, 374, 220, 16, 17, 20, 4, 315, 444, 11, 773, 279, 4226, 374, 220, 16, 17, 20, 13384, 892, 374, 2999, 356, 382, 14190, 11, 714, 304, 279, 2086, 5486, 11, 358, 633, 264, 2155, 23606, 30, 13824, 11, 1156, 5486, 1053, 328, 284, 444, 11, 714, 279, 2086, 5486, 2727, 328, 284, 220, 15, 13, 23, 44, 11, 892, 374, 220, 15, 13, 23, 9, 16, 13, 17, 20, 43, 284, 444, 13, 2055, 2176, 19827, 7503, 13, 2055, 279, 11236, 3349, 374, 6144, 311, 279, 1140, 3349, 13, 2055, 11, 279, 29238, 10335, 705, 11236, 279, 1985, 518, 279, 1140, 3349, 11, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 13, 2055, 279, 12864, 3349, 1969, 387, 5080, 1091, 279, 1140, 3349, 773, 429, 1496, 1283, 264, 220, 17, 15, 4, 11089, 11, 566, 5221, 1182, 311, 279, 1140, 3349, 382, 3983, 279, 11372, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 13, 13824, 11, 11372, 374, 328, 481, 356, 284, 444, 481, 220, 15, 13, 23, 43, 284, 220, 15, 13, 17, 43, 13, 1988, 4092, 311, 279, 3491, 11, 419, 11372, 1265, 387, 6144, 311, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 892, 374, 220, 15, 13, 17, 50, 13, 8704, 328, 284, 444, 11, 220, 15, 13, 17, 50, 284, 220, 15, 13, 17, 43, 13, 2055, 12824, 11, 220, 15, 13, 17, 43, 284, 220, 15, 13, 17, 43, 13, 2055, 429, 12341, 700, 382, 54815, 11, 279, 12864, 3349, 3880, 311, 387, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 2055, 279, 4226, 374, 356, 382, 3983, 1077, 752, 1101, 10146, 448, 5109, 311, 1281, 2704, 382, 10048, 2900, 279, 1140, 3349, 374, 400, 16, 15, 15, 382, 84545, 49531, 518, 220, 17, 15, 4, 11089, 11, 773, 2783, 3349, 374, 400, 23, 15, 382, 1519, 6801, 311, 1868, 705, 279, 3349, 1741, 429, 979, 566, 30778, 518, 220, 17, 15, 4, 11089, 1007, 279, 12864, 3349, 11, 566, 3643, 264, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 382, 10061, 748, 1077, 279, 12864, 3349, 387, 386, 382, 50, 6293, 3349, 374, 220, 15, 13, 23, 44, 382, 67297, 284, 53720, 3349, 481, 11194, 3349, 284, 220, 15, 13, 23, 44, 481, 220, 23, 15, 382, 11190, 311, 279, 3491, 11, 11372, 1265, 387, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 773, 220, 15, 13, 17, 6599, 15, 13, 23, 44, 8, 284, 220, 15, 13, 16, 21, 44, 382, 1649, 705, 23606, 25, 220, 15, 13, 23, 44, 481, 220, 23, 15, 284, 220, 15, 13, 16, 21, 44, 271, 3136, 2144, 220, 15, 13, 16, 21, 44, 504, 2176, 11067, 25, 220, 15, 13, 21, 19, 44, 481, 220, 23, 15, 284, 220, 15, 271, 15, 13, 21, 19, 44, 284, 220, 23, 15, 589, 386, 284, 220, 23, 15, 608, 220, 15, 13, 21, 19, 284, 220, 16, 17, 20, 382, 4416, 12864, 3349, 374, 400, 16, 17, 20, 11, 892, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 1711, 16, 15, 15, 568, 2055, 419, 1083, 42396, 432, 13, 2055, 4226, 374, 356, 382, 54815, 11, 1283, 678, 1493, 7354, 323, 22901, 11, 279, 4396, 4226, 374, 356, 11, 220, 16, 17, 20, 382, 334, 19357, 21806, 1019, 59, 79075, 90, 34, 630, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 785, 29238, 49531, 11561, 518, 264, 220, 17, 15, 4, 11089, 1007, 279, 1140, 3349, 11, 773, 806, 2783, 3349, 320, 34, 8, 374, 220, 23, 15, 4, 315, 279, 1140, 3349, 320, 43, 568, 1260, 6801, 311, 1868, 279, 11561, 1741, 429, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 320, 44, 701, 566, 2058, 3643, 264, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 320, 50, 3593, 16, 13, 3070, 14940, 8483, 320, 34, 1648, 1019, 256, 1124, 9640, 256, 356, 284, 220, 15, 13, 23, 43, 198, 256, 1124, 2533, 17, 13, 3070, 50, 6293, 8483, 320, 50, 1648, 1019, 256, 1124, 9640, 256, 328, 284, 220, 15, 13, 23, 44, 198, 256, 1124, 2533, 18, 13, 3070, 67297, 74216, 25, 1019, 256, 481, 57782, 1265, 387, 220, 17, 15, 4, 315, 279, 11236, 3349, 510, 256, 1124, 9640, 256, 1124, 1318, 90, 67297, 92, 284, 220, 15, 13, 17, 50, 198, 256, 1124, 921, 256, 481, 57782, 374, 1083, 279, 6672, 1948, 11236, 3349, 323, 2783, 3349, 510, 256, 1124, 9640, 256, 328, 481, 356, 284, 220, 15, 13, 17, 50, 198, 256, 1124, 2533, 19, 13, 3070, 50, 19648, 369, 328, 25, 1019, 256, 1124, 9640, 256, 328, 481, 220, 15, 13, 17, 50, 284, 356, 1124, 6383, 550, 220, 15, 13, 23, 50, 284, 356, 198, 256, 1124, 2533, 20, 13, 3070, 3136, 3696, 10607, 356, 323, 328, 25, 1019, 256, 1124, 9640, 256, 220, 15, 13, 23, 50, 284, 220, 15, 13, 23, 43, 1124, 6383, 550, 328, 284, 444, 198, 256, 1124, 2533, 21, 13, 3070, 6740, 1095, 53720, 8483, 311, 4389, 291, 8483, 25, 1019, 256, 1124, 9640, 256, 220, 15, 13, 23, 44, 284, 444, 1124, 6383, 550, 386, 284, 1124, 37018, 90, 43, 15170, 15, 13, 23, 92, 284, 220, 16, 13, 17, 20, 43, 198, 256, 1124, 2533, 44500, 11, 279, 12864, 3349, 320, 44, 8, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 15277, 11, 279, 4226, 374, 1124, 11520, 79075, 90, 34, 11035, 3593, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] [Labels]: [-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 1430, 311, 21403, 419, 3491, 3019, 553, 3019, 13, 88190, 11, 773, 279, 29238, 10788, 11561, 518, 264, 220, 17, 15, 4, 11089, 1007, 279, 1140, 3349, 13, 5005, 566, 6801, 311, 738, 264, 12864, 3349, 1741, 429, 1496, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 11, 566, 2058, 3643, 264, 220, 17, 15, 4, 11372, 389, 279, 11236, 3349, 13, 1205, 1184, 311, 1477, 1128, 11414, 315, 279, 1140, 3349, 566, 1265, 1868, 705, 279, 11561, 13, 576, 2606, 525, 2661, 11, 714, 358, 1184, 311, 7071, 432, 700, 59726, 382, 5338, 11, 1077, 752, 4715, 279, 3491, 1549, 311, 1281, 2704, 358, 3535, 678, 279, 3793, 13, 576, 1140, 3349, 374, 279, 4024, 3349, 1573, 894, 31062, 13, 576, 29238, 49531, 279, 11561, 518, 220, 17, 15, 4, 1007, 419, 1140, 3349, 13, 2055, 806, 2783, 3349, 374, 220, 23, 15, 4, 315, 279, 1140, 3349, 13, 5005, 566, 6801, 311, 738, 264, 12864, 3349, 13, 3197, 566, 30778, 11, 566, 6696, 264, 220, 17, 15, 4, 11089, 389, 419, 12864, 3349, 11, 323, 1283, 429, 11089, 11, 806, 11236, 3349, 1265, 2058, 2968, 1435, 264, 220, 17, 15, 4, 11372, 3118, 389, 279, 11236, 3349, 5086, 13, 13824, 11, 11372, 374, 5990, 16588, 3118, 389, 2783, 3349, 11, 1290, 30, 576, 3491, 2727, 330, 64, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 1189, 2938, 594, 264, 2699, 30615, 13, 6771, 752, 5185, 429, 382, 10061, 752, 3270, 1495, 279, 1376, 3501, 1447, 16, 13, 55399, 594, 2783, 3349, 320, 34, 8, 284, 1759, 3349, 320, 43, 8, 481, 220, 17, 15, 4, 315, 444, 284, 220, 23, 15, 4, 315, 444, 284, 220, 15, 13, 23, 43, 198, 17, 13, 4389, 291, 3349, 320, 44, 8, 374, 1128, 582, 1184, 311, 1477, 438, 264, 11414, 315, 444, 624, 18, 13, 53720, 3349, 320, 50, 8, 284, 4389, 291, 3349, 481, 220, 17, 15, 4, 315, 386, 284, 220, 23, 15, 4, 315, 386, 284, 220, 15, 13, 23, 44, 198, 19, 13, 57782, 284, 220, 17, 15, 4, 315, 53720, 8483, 284, 220, 15, 13, 17, 50, 198, 20, 13, 15277, 11, 53720, 8483, 284, 11194, 8483, 488, 57782, 198, 256, 589, 328, 284, 356, 488, 220, 15, 13, 17, 50, 271, 14190, 11, 419, 374, 279, 9023, 949, 13, 576, 11372, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 537, 220, 17, 15, 4, 315, 279, 2783, 3349, 13, 2055, 421, 358, 55327, 844, 279, 23606, 328, 284, 356, 488, 220, 15, 13, 17, 50, 11, 1221, 328, 481, 220, 15, 13, 17, 50, 284, 356, 589, 220, 15, 13, 23, 50, 284, 356, 13, 15277, 11, 328, 284, 356, 608, 220, 15, 13, 23, 382, 3983, 582, 1414, 429, 356, 374, 220, 15, 13, 23, 43, 11, 773, 31334, 10607, 429, 304, 11, 328, 284, 220, 15, 13, 23, 43, 608, 220, 15, 13, 23, 284, 444, 13, 2055, 279, 11236, 3349, 1969, 387, 6144, 311, 279, 1140, 3349, 30, 1988, 1221, 279, 11236, 3349, 374, 1083, 220, 15, 13, 23, 44, 320, 11284, 566, 6696, 264, 220, 17, 15, 4, 11089, 568, 15277, 11, 220, 15, 13, 23, 44, 284, 444, 589, 386, 284, 444, 608, 220, 15, 13, 23, 284, 220, 16, 13, 17, 20, 43, 13, 2055, 386, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 15277, 11, 279, 4226, 1265, 387, 220, 16, 17, 20, 13384, 892, 374, 2999, 356, 13, 6771, 752, 1779, 419, 1549, 311, 1281, 2704, 382, 92014, 11, 1077, 752, 653, 432, 3019, 553, 3019, 448, 7332, 382, 10061, 752, 78064, 1447, 12, 6771, 279, 1140, 3349, 387, 444, 624, 12, 55399, 594, 2783, 3349, 11, 356, 284, 220, 15, 13, 23, 43, 320, 11284, 566, 10788, 518, 220, 17, 15, 4, 11089, 340, 12, 6771, 279, 12864, 3349, 387, 386, 320, 8206, 374, 264, 11414, 315, 444, 11, 582, 1184, 311, 1477, 419, 11414, 340, 12, 53720, 3349, 11, 328, 284, 386, 481, 220, 15, 13, 17, 44, 284, 220, 15, 13, 23, 44, 198, 12, 57782, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 773, 57782, 284, 220, 15, 13, 17, 50, 198, 12, 57782, 374, 1083, 53720, 8483, 481, 11194, 8483, 25, 328, 481, 356, 198, 12, 15277, 11, 328, 481, 356, 284, 220, 15, 13, 17, 50, 589, 328, 481, 220, 15, 13, 17, 50, 284, 356, 589, 220, 15, 13, 23, 50, 284, 356, 198, 12, 87149, 328, 284, 220, 15, 13, 23, 44, 1119, 419, 25, 220, 15, 13, 23, 6599, 15, 13, 23, 44, 8, 284, 356, 589, 220, 15, 13, 21, 19, 44, 284, 356, 198, 12, 1988, 582, 1414, 356, 284, 220, 15, 13, 23, 43, 11, 773, 220, 15, 13, 21, 19, 44, 284, 220, 15, 13, 23, 43, 198, 12, 11473, 4405, 369, 386, 25, 386, 284, 320, 15, 13, 23, 43, 8, 608, 220, 15, 13, 21, 19, 284, 320, 15, 13, 23, 608, 220, 15, 13, 21, 19, 33442, 284, 320, 23, 15, 608, 220, 21, 19, 33442, 284, 320, 20, 608, 220, 19, 33442, 284, 220, 16, 13, 17, 20, 43, 198, 12, 15277, 11, 386, 374, 220, 16, 17, 20, 4, 315, 444, 11, 773, 279, 4226, 374, 220, 16, 17, 20, 13384, 892, 374, 2999, 356, 382, 14190, 11, 714, 304, 279, 2086, 5486, 11, 358, 633, 264, 2155, 23606, 30, 13824, 11, 1156, 5486, 1053, 328, 284, 444, 11, 714, 279, 2086, 5486, 2727, 328, 284, 220, 15, 13, 23, 44, 11, 892, 374, 220, 15, 13, 23, 9, 16, 13, 17, 20, 43, 284, 444, 13, 2055, 2176, 19827, 7503, 13, 2055, 279, 11236, 3349, 374, 6144, 311, 279, 1140, 3349, 13, 2055, 11, 279, 29238, 10335, 705, 11236, 279, 1985, 518, 279, 1140, 3349, 11, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 13, 2055, 279, 12864, 3349, 1969, 387, 5080, 1091, 279, 1140, 3349, 773, 429, 1496, 1283, 264, 220, 17, 15, 4, 11089, 11, 566, 5221, 1182, 311, 279, 1140, 3349, 382, 3983, 279, 11372, 374, 220, 17, 15, 4, 315, 279, 11236, 3349, 13, 13824, 11, 11372, 374, 328, 481, 356, 284, 444, 481, 220, 15, 13, 23, 43, 284, 220, 15, 13, 17, 43, 13, 1988, 4092, 311, 279, 3491, 11, 419, 11372, 1265, 387, 6144, 311, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 892, 374, 220, 15, 13, 17, 50, 13, 8704, 328, 284, 444, 11, 220, 15, 13, 17, 50, 284, 220, 15, 13, 17, 43, 13, 2055, 12824, 11, 220, 15, 13, 17, 43, 284, 220, 15, 13, 17, 43, 13, 2055, 429, 12341, 700, 382, 54815, 11, 279, 12864, 3349, 3880, 311, 387, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 2055, 279, 4226, 374, 356, 382, 3983, 1077, 752, 1101, 10146, 448, 5109, 311, 1281, 2704, 382, 10048, 2900, 279, 1140, 3349, 374, 400, 16, 15, 15, 382, 84545, 49531, 518, 220, 17, 15, 4, 11089, 11, 773, 2783, 3349, 374, 400, 23, 15, 382, 1519, 6801, 311, 1868, 705, 279, 3349, 1741, 429, 979, 566, 30778, 518, 220, 17, 15, 4, 11089, 1007, 279, 12864, 3349, 11, 566, 3643, 264, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 382, 10061, 748, 1077, 279, 12864, 3349, 387, 386, 382, 50, 6293, 3349, 374, 220, 15, 13, 23, 44, 382, 67297, 284, 53720, 3349, 481, 11194, 3349, 284, 220, 15, 13, 23, 44, 481, 220, 23, 15, 382, 11190, 311, 279, 3491, 11, 11372, 1265, 387, 220, 17, 15, 4, 315, 279, 11236, 3349, 11, 773, 220, 15, 13, 17, 6599, 15, 13, 23, 44, 8, 284, 220, 15, 13, 16, 21, 44, 382, 1649, 705, 23606, 25, 220, 15, 13, 23, 44, 481, 220, 23, 15, 284, 220, 15, 13, 16, 21, 44, 271, 3136, 2144, 220, 15, 13, 16, 21, 44, 504, 2176, 11067, 25, 220, 15, 13, 21, 19, 44, 481, 220, 23, 15, 284, 220, 15, 271, 15, 13, 21, 19, 44, 284, 220, 23, 15, 589, 386, 284, 220, 23, 15, 608, 220, 15, 13, 21, 19, 284, 220, 16, 17, 20, 382, 4416, 12864, 3349, 374, 400, 16, 17, 20, 11, 892, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 1711, 16, 15, 15, 568, 2055, 419, 1083, 42396, 432, 13, 2055, 4226, 374, 356, 382, 54815, 11, 1283, 678, 1493, 7354, 323, 22901, 11, 279, 4396, 4226, 374, 356, 11, 220, 16, 17, 20, 382, 334, 19357, 21806, 1019, 59, 79075, 90, 34, 630, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 785, 29238, 49531, 11561, 518, 264, 220, 17, 15, 4, 11089, 1007, 279, 1140, 3349, 11, 773, 806, 2783, 3349, 320, 34, 8, 374, 220, 23, 15, 4, 315, 279, 1140, 3349, 320, 43, 568, 1260, 6801, 311, 1868, 279, 11561, 1741, 429, 1283, 7086, 264, 220, 17, 15, 4, 11089, 389, 279, 12864, 3349, 320, 44, 701, 566, 2058, 3643, 264, 11372, 315, 220, 17, 15, 4, 315, 279, 11236, 3349, 320, 50, 3593, 16, 13, 3070, 14940, 8483, 320, 34, 1648, 1019, 256, 1124, 9640, 256, 356, 284, 220, 15, 13, 23, 43, 198, 256, 1124, 2533, 17, 13, 3070, 50, 6293, 8483, 320, 50, 1648, 1019, 256, 1124, 9640, 256, 328, 284, 220, 15, 13, 23, 44, 198, 256, 1124, 2533, 18, 13, 3070, 67297, 74216, 25, 1019, 256, 481, 57782, 1265, 387, 220, 17, 15, 4, 315, 279, 11236, 3349, 510, 256, 1124, 9640, 256, 1124, 1318, 90, 67297, 92, 284, 220, 15, 13, 17, 50, 198, 256, 1124, 921, 256, 481, 57782, 374, 1083, 279, 6672, 1948, 11236, 3349, 323, 2783, 3349, 510, 256, 1124, 9640, 256, 328, 481, 356, 284, 220, 15, 13, 17, 50, 198, 256, 1124, 2533, 19, 13, 3070, 50, 19648, 369, 328, 25, 1019, 256, 1124, 9640, 256, 328, 481, 220, 15, 13, 17, 50, 284, 356, 1124, 6383, 550, 220, 15, 13, 23, 50, 284, 356, 198, 256, 1124, 2533, 20, 13, 3070, 3136, 3696, 10607, 356, 323, 328, 25, 1019, 256, 1124, 9640, 256, 220, 15, 13, 23, 50, 284, 220, 15, 13, 23, 43, 1124, 6383, 550, 328, 284, 444, 198, 256, 1124, 2533, 21, 13, 3070, 6740, 1095, 53720, 8483, 311, 4389, 291, 8483, 25, 1019, 256, 1124, 9640, 256, 220, 15, 13, 23, 44, 284, 444, 1124, 6383, 550, 386, 284, 1124, 37018, 90, 43, 15170, 15, 13, 23, 92, 284, 220, 16, 13, 17, 20, 43, 198, 256, 1124, 2533, 44500, 11, 279, 12864, 3349, 320, 44, 8, 374, 220, 16, 17, 20, 4, 315, 279, 1140, 3349, 13, 15277, 11, 279, 4226, 374, 1124, 11520, 79075, 90, 34, 11035, 3593, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] ================================================================================ >>> End of first sample inspection <<< ================================================================================ ================================================================================ >>> Printing the first sample of the first training batch <<< ================================================================================ [Input IDs]: [151644, 8948, 198, 7771, 3476, 438, 458, 17847, 17601, 26364, 23966, 4755, 1526, 264, 36438, 1293, 7274, 1882, 1573, 8241, 279, 1590, 23560, 323, 13382, 9904, 13, 1096, 7460, 22570, 304, 264, 15817, 10775, 315, 6358, 11, 28285, 4849, 11, 26403, 11, 31734, 23391, 11, 21844, 11, 1182, 376, 4527, 11, 323, 19569, 311, 2225, 1632, 12, 24712, 291, 7274, 1882, 13, 5209, 5944, 697, 2033, 1119, 1378, 1887, 14158, 25, 35187, 323, 12478, 13, 758, 279, 35187, 3772, 11, 7716, 697, 32711, 1882, 1667, 279, 5189, 3561, 25, 82639, 7265, 3575, 5854, 2450, 91, 29, 314, 60565, 448, 7354, 18663, 448, 5196, 77, 1699, 8275, 82639, 408, 3575, 5854, 2450, 91, 29, 8886, 3019, 1265, 2924, 11682, 37764, 1741, 438, 3181, 285, 7024, 4755, 11, 28285, 4849, 9760, 14613, 11, 86781, 287, 501, 6708, 11, 68863, 279, 13403, 315, 279, 1482, 7354, 11, 73185, 894, 5975, 11, 323, 17493, 5853, 3681, 7354, 13, 758, 279, 12478, 3772, 11, 3118, 389, 5257, 13553, 11, 47439, 804, 11, 323, 62751, 504, 279, 35187, 3772, 11, 59726, 3042, 279, 1590, 6291, 429, 498, 81477, 4396, 13, 576, 6291, 1265, 7146, 264, 19819, 11, 13382, 11, 63594, 7493, 1707, 323, 7716, 5871, 3019, 4362, 311, 5545, 279, 16688, 11, 23126, 438, 11017, 25, 82639, 7265, 3575, 50274, 91, 29, 314, 11822, 23126, 11, 23560, 11, 323, 2797, 6291, 92, 82639, 408, 3575, 50274, 91, 29, 4695, 11, 1430, 311, 11625, 279, 2701, 3405, 1526, 279, 3403, 17501, 25, 151645, 198, 151644, 872, 198, 5598, 697, 1590, 2033, 2878, 1124, 79075, 46391, 61242, 1437, 57960, 26888, 90, 17, 20, 15, 15, 15, 92, 12947, 151645, 198, 151644, 77091, 198, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 773, 358, 1184, 311, 39721, 279, 9334, 3704, 315, 220, 17, 20, 15, 15, 15, 13, 6771, 752, 1744, 911, 1246, 311, 5486, 419, 13, 88190, 11, 9334, 19703, 646, 7025, 387, 43799, 553, 2097, 5503, 279, 1372, 1119, 264, 1985, 315, 264, 4727, 9334, 323, 2441, 1372, 13, 2938, 1616, 11, 358, 646, 1896, 279, 9334, 3704, 315, 279, 4727, 9334, 700, 315, 279, 17855, 13, 4710, 5338, 11, 358, 1265, 19091, 1128, 264, 4727, 9334, 374, 13, 362, 4727, 9334, 374, 264, 1372, 429, 374, 279, 9334, 315, 458, 7546, 13, 25311, 525, 220, 16, 11, 220, 19, 11, 220, 24, 11, 220, 16, 21, 11, 220, 17, 20, 11, 220, 18, 21, 11, 4992, 13, 2055, 11, 358, 1184, 311, 1477, 279, 7772, 4727, 9334, 429, 64828, 220, 17, 20, 15, 15, 15, 13, 6771, 752, 1191, 553, 14719, 1495, 220, 17, 20, 15, 15, 15, 1119, 1181, 10250, 9363, 13, 2938, 2578, 1492, 752, 10542, 894, 4727, 31340, 2878, 432, 382, 24617, 448, 220, 17, 20, 15, 15, 15, 13, 6771, 594, 21749, 553, 220, 17, 1156, 13, 220, 17, 20, 15, 15, 15, 17779, 553, 220, 17, 374, 220, 16, 17, 20, 15, 15, 13, 62902, 553, 220, 17, 1549, 6696, 220, 21, 17, 20, 15, 13, 3776, 803, 882, 553, 220, 17, 374, 220, 18, 16, 17, 20, 13, 13824, 11, 220, 18, 16, 17, 20, 374, 537, 74916, 553, 220, 17, 13, 2055, 11, 279, 1372, 315, 220, 17, 82, 304, 279, 10250, 8168, 2022, 374, 220, 18, 13, 4695, 7218, 389, 311, 220, 20, 13, 220, 18, 16, 17, 20, 17779, 553, 220, 20, 374, 220, 21, 17, 20, 13, 8765, 4490, 553, 220, 20, 1549, 374, 220, 16, 17, 20, 13, 13759, 553, 220, 20, 374, 220, 17, 20, 11, 323, 3055, 803, 553, 220, 20, 374, 220, 20, 11, 323, 5499, 553, 220, 20, 374, 220, 16, 13, 2055, 11, 429, 594, 220, 20, 61, 20, 13, 4710, 97904, 432, 678, 3786, 11, 279, 10250, 9363, 315, 220, 17, 20, 15, 15, 15, 525, 220, 17, 61, 18, 353, 220, 20, 61, 20, 13, 4695, 11, 311, 1477, 279, 7772, 4727, 9334, 8168, 11, 358, 1184, 311, 1401, 518, 279, 505, 2700, 315, 279, 10250, 9363, 13, 362, 4727, 9334, 702, 1496, 505, 2700, 304, 1181, 10250, 8168, 2022, 13, 2055, 11, 369, 1817, 10250, 8168, 11, 358, 646, 1896, 438, 1657, 13530, 438, 3204, 382, 24617, 448, 220, 17, 61, 18, 13, 576, 27690, 374, 220, 18, 11, 892, 374, 10322, 13, 576, 7772, 1496, 27690, 2686, 1091, 220, 18, 374, 220, 17, 11, 773, 582, 646, 1896, 220, 17, 61, 17, 438, 949, 315, 279, 4727, 9334, 13, 5005, 369, 220, 20, 61, 20, 11, 279, 27690, 374, 220, 20, 13, 576, 7772, 1496, 27690, 2686, 1091, 220, 20, 374, 220, 19, 11, 773, 582, 646, 1896, 220, 20, 61, 19, 13, 15277, 11, 279, 7772, 4727, 9334, 8168, 374, 220, 17, 61, 17, 353, 220, 20, 61, 19, 382, 57908, 1095, 429, 25, 220, 17, 61, 17, 374, 220, 19, 11, 323, 220, 20, 61, 19, 374, 220, 21, 17, 20, 13, 58712, 6711, 220, 19, 323, 220, 21, 17, 20, 6696, 220, 17, 20, 15, 15, 13, 2055, 11, 220, 17, 20, 15, 15, 15, 646, 387, 5326, 438, 220, 17, 20, 15, 15, 353, 220, 16, 15, 13, 6771, 752, 1779, 429, 25, 220, 17, 20, 15, 15, 353, 220, 16, 15, 374, 12824, 220, 17, 20, 15, 15, 15, 13, 2055, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 11995, 248, 7, 17, 20, 15, 15, 353, 220, 16, 15, 568, 4710, 12549, 279, 9334, 3704, 315, 264, 1985, 374, 279, 1985, 315, 279, 9334, 19703, 11, 419, 9044, 11995, 248, 17, 20, 15, 15, 353, 11995, 248, 16, 15, 13, 4695, 11, 11995, 248, 17, 20, 15, 15, 374, 264, 3881, 897, 13, 220, 17, 20, 15, 15, 374, 220, 20, 15, 52263, 1576, 220, 20, 15, 9, 20, 15, 28, 17, 20, 15, 15, 13, 2055, 11, 11995, 248, 17, 20, 15, 15, 374, 220, 20, 15, 13, 15277, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 220, 20, 15, 353, 11995, 248, 16, 15, 13, 4710, 3983, 3783, 11, 374, 220, 16, 15, 264, 10250, 1372, 30, 7414, 11, 220, 16, 15, 374, 220, 17, 9, 20, 11, 2176, 49433, 13, 2619, 525, 902, 4727, 9334, 9363, 304, 220, 16, 15, 11, 773, 11995, 248, 16, 15, 4157, 387, 43799, 4623, 13, 15277, 11, 279, 43799, 1352, 315, 11995, 248, 17, 20, 15, 15, 15, 374, 220, 20, 15, 144336, 16, 15, 13, 4710, 92014, 11, 7196, 1052, 594, 2441, 1616, 311, 5486, 419, 13, 6771, 752, 10146, 13, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 353, 220, 16, 15, 15, 15, 13, 9211, 220, 17, 20, 3039, 220, 16, 15, 15, 15, 374, 220, 17, 20, 15, 15, 15, 13, 5005, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 11995, 248, 7, 17, 20, 353, 220, 16, 15, 15, 15, 8, 284, 11995, 248, 17, 20, 353, 11995, 248, 16, 15, 15, 15, 13, 11995, 248, 17, 20, 374, 220, 20, 11, 773, 429, 9044, 220, 20, 144336, 16, 15, 15, 15, 13, 1988, 11995, 248, 16, 15, 15, 15, 646, 387, 43799, 4623, 13, 220, 16, 15, 15, 15, 374, 220, 16, 15, 15, 353, 220, 16, 15, 11, 773, 11995, 248, 16, 15, 15, 15, 284, 11995, 248, 7, 16, 15, 15, 9, 16, 15, 8, 284, 11995, 248, 16, 15, 15, 353, 11995, 248, 16, 15, 284, 220, 16, 15, 144336, 16, 15, 13, 15277, 11, 220, 20, 144336, 16, 15, 15, 15, 9044, 220, 20, 9, 16, 15, 144336, 16, 15, 284, 220, 20, 15, 144336, 16, 15, 13, 2055, 11, 1852, 1102, 13, 4710, 14037, 1616, 25, 10696, 1667, 27690, 5601, 13, 8704, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 353, 220, 16, 15, 61, 18, 13, 2055, 11, 220, 17, 20, 374, 220, 20, 61, 17, 323, 220, 16, 15, 61, 18, 374, 320, 17, 9, 20, 29776, 18, 284, 220, 17, 61, 18, 9, 20, 61, 18, 13, 2055, 11, 30055, 11, 220, 20, 61, 17, 353, 220, 17, 61, 18, 353, 20, 61, 18, 284, 220, 17, 61, 18, 9, 20, 13268, 17, 10, 18, 8, 284, 220, 17, 61, 18, 9, 20, 61, 20, 13, 15920, 374, 279, 1852, 10250, 9363, 438, 1573, 13, 5005, 11, 979, 4633, 279, 9334, 3704, 11, 582, 646, 3270, 432, 438, 220, 17, 13268, 18, 14, 17, 4806, 20, 13268, 20, 14, 17, 8, 284, 220, 17, 13268, 16, 488, 220, 16, 14, 17, 4806, 20, 13268, 17, 488, 220, 16, 14, 17, 8, 284, 220, 17, 9, 20, 61, 17, 353, 11995, 248, 7, 17, 9, 20, 8, 284, 220, 17, 9, 17, 20, 9, 144336, 16, 15, 284, 220, 20, 15, 144336, 16, 15, 13, 84194, 11, 1852, 4226, 13, 4710, 10061, 752, 1083, 12564, 279, 34776, 897, 311, 1779, 13, 11995, 248, 17, 20, 15, 15, 15, 13, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 9, 16, 15, 15, 15, 11, 773, 9334, 3704, 374, 220, 20, 9, 26888, 7, 16, 15, 15, 15, 568, 17946, 7, 16, 15, 15, 15, 8, 374, 911, 220, 18, 16, 13, 21, 17, 17, 22, 22, 21, 21, 11, 773, 220, 20, 9, 18, 16, 13, 21, 17, 17, 22, 22, 21, 21, 374, 13187, 220, 16, 20, 23, 13, 16, 16, 18, 23, 23, 18, 13, 38478, 11, 220, 20, 15, 9, 26888, 7, 16, 15, 568, 17946, 7, 16, 15, 8, 374, 13187, 220, 18, 13, 16, 21, 17, 17, 22, 22, 21, 21, 11, 773, 220, 20, 15, 9, 18, 13, 16, 21, 17, 17, 22, 22, 21, 21, 374, 1083, 220, 16, 20, 23, 13, 16, 16, 18, 23, 23, 18, 13, 2055, 2176, 5510, 11, 279, 34776, 897, 374, 279, 1852, 13, 4710, 54815, 11, 279, 43799, 17855, 1352, 374, 220, 20, 15, 144336, 16, 15, 11, 323, 279, 34776, 897, 374, 13187, 220, 16, 20, 23, 13, 16, 16, 13, 1988, 279, 3405, 17064, 311, 39721, 11, 773, 279, 4734, 1352, 374, 4362, 11, 537, 279, 12122, 56204, 13, 2055, 279, 4226, 374, 220, 20, 15, 144336, 16, 15, 13, 4710, 14190, 11, 714, 374, 1052, 264, 1616, 311, 3270, 432, 2041, 264, 9334, 3704, 30, 1416, 220, 17, 20, 15, 15, 15, 374, 264, 4727, 9334, 5086, 13, 6771, 594, 1779, 13, 3555, 1372, 52263, 374, 220, 17, 20, 15, 15, 15, 30, 6771, 594, 1490, 13, 220, 16, 20, 15, 61, 17, 374, 220, 17, 17, 20, 15, 15, 11, 220, 16, 21, 15, 61, 17, 374, 220, 17, 20, 21, 15, 15, 13, 2055, 220, 17, 20, 15, 15, 15, 374, 1948, 220, 16, 20, 15, 61, 17, 323, 220, 16, 21, 15, 61, 17, 13, 220, 16, 20, 23, 61, 17, 374, 220, 17, 19, 24, 21, 19, 11, 892, 374, 3265, 714, 537, 220, 17, 20, 15, 15, 15, 13, 220, 16, 20, 24, 61, 17, 374, 220, 17, 20, 17, 23, 16, 11, 892, 374, 916, 13, 2055, 11, 220, 17, 20, 15, 15, 15, 374, 537, 264, 4727, 9334, 13, 15277, 11, 279, 43799, 1352, 374, 12824, 220, 20, 15, 144336, 16, 15, 13, 4710, 92014, 11, 421, 279, 4024, 1372, 572, 220, 17, 20, 15, 15, 11, 429, 594, 220, 20, 15, 61, 17, 11, 714, 220, 17, 20, 15, 15, 15, 374, 220, 16, 15, 15, 3039, 8131, 13, 2055, 11, 17946, 7, 17, 20, 15, 15, 15, 8, 284, 17946, 7, 17, 20, 15, 15, 353, 220, 16, 15, 8, 284, 17946, 7, 17, 20, 15, 15, 8, 353, 17946, 7, 16, 15, 8, 284, 220, 20, 15, 9, 26888, 7, 16, 15, 568, 84194, 11, 1852, 3166, 13, 4710, 4416, 11, 1283, 678, 1493, 5413, 323, 12341, 11, 358, 2776, 16506, 429, 279, 43799, 1352, 315, 11995, 248, 17, 20, 15, 15, 15, 374, 220, 20, 15, 144336, 16, 15, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 39721, 1124, 11520, 26888, 90, 17, 20, 15, 15, 15, 11035, 701, 582, 1191, 553, 2097, 5503, 279, 1372, 1119, 264, 1985, 315, 264, 4727, 9334, 323, 2441, 1372, 13, 4710, 16, 13, 3070, 32306, 37729, 2022, 95518, 2303, 256, 17767, 17, 20, 15, 15, 15, 284, 220, 17, 61, 18, 1124, 15136, 220, 20, 61, 20, 59, 568, 18611, 17, 13, 3070, 28301, 1437, 23239, 20084, 5403, 95518, 2303, 256, 576, 7772, 4727, 9334, 9363, 525, 17767, 17, 61, 17, 57758, 320, 1499, 17767, 17, 61, 18, 59, 593, 323, 17767, 20, 61, 19, 57758, 320, 1499, 17767, 20, 61, 20, 59, 4579, 2303, 256, 58712, 6711, 1493, 6696, 17767, 17, 61, 17, 1124, 15136, 220, 20, 61, 19, 284, 220, 19, 1124, 15136, 220, 21, 17, 20, 284, 220, 17, 20, 15, 15, 59, 568, 18611, 18, 13, 3070, 58465, 1247, 279, 15619, 18854, 95518, 2303, 256, 1124, 9640, 256, 1124, 26888, 90, 17, 20, 15, 15, 15, 92, 284, 1124, 26888, 90, 17, 20, 15, 15, 1124, 15136, 220, 16, 15, 92, 284, 1124, 26888, 90, 17, 20, 15, 15, 92, 1124, 15136, 1124, 26888, 90, 16, 15, 532, 256, 1124, 60, 2303, 256, 8704, 1124, 11520, 26888, 90, 17, 20, 15, 15, 92, 284, 220, 20, 15, 59, 701, 419, 15491, 9606, 311, 25, 2303, 256, 1124, 9640, 256, 220, 20, 15, 1124, 15136, 1124, 26888, 90, 16, 15, 532, 256, 1124, 2533, 19, 13, 3070, 62339, 95518, 2303, 256, 481, 41109, 8168, 2022, 25, 17767, 17, 20, 15, 15, 15, 284, 220, 17, 20, 1124, 15136, 220, 16, 15, 15, 15, 59, 701, 6388, 311, 1124, 11520, 26888, 90, 17, 20, 92, 1124, 15136, 1124, 26888, 90, 16, 15, 15, 15, 92, 284, 220, 20, 1124, 15136, 220, 16, 15, 59, 26888, 90, 16, 15, 92, 284, 220, 20, 15, 59, 26888, 90, 16, 15, 11035, 568, 2303, 256, 481, 47124, 938, 56204, 42396, 28137, 382, 44500, 11, 279, 43799, 1352, 315, 1124, 11520, 26888, 90, 17, 20, 15, 15, 15, 11035, 8, 374, 1124, 11520, 79075, 90, 20, 15, 59, 26888, 90, 16, 15, 3417, 59, 3593, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] [Labels]: [-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 773, 358, 1184, 311, 39721, 279, 9334, 3704, 315, 220, 17, 20, 15, 15, 15, 13, 6771, 752, 1744, 911, 1246, 311, 5486, 419, 13, 88190, 11, 9334, 19703, 646, 7025, 387, 43799, 553, 2097, 5503, 279, 1372, 1119, 264, 1985, 315, 264, 4727, 9334, 323, 2441, 1372, 13, 2938, 1616, 11, 358, 646, 1896, 279, 9334, 3704, 315, 279, 4727, 9334, 700, 315, 279, 17855, 13, 4710, 5338, 11, 358, 1265, 19091, 1128, 264, 4727, 9334, 374, 13, 362, 4727, 9334, 374, 264, 1372, 429, 374, 279, 9334, 315, 458, 7546, 13, 25311, 525, 220, 16, 11, 220, 19, 11, 220, 24, 11, 220, 16, 21, 11, 220, 17, 20, 11, 220, 18, 21, 11, 4992, 13, 2055, 11, 358, 1184, 311, 1477, 279, 7772, 4727, 9334, 429, 64828, 220, 17, 20, 15, 15, 15, 13, 6771, 752, 1191, 553, 14719, 1495, 220, 17, 20, 15, 15, 15, 1119, 1181, 10250, 9363, 13, 2938, 2578, 1492, 752, 10542, 894, 4727, 31340, 2878, 432, 382, 24617, 448, 220, 17, 20, 15, 15, 15, 13, 6771, 594, 21749, 553, 220, 17, 1156, 13, 220, 17, 20, 15, 15, 15, 17779, 553, 220, 17, 374, 220, 16, 17, 20, 15, 15, 13, 62902, 553, 220, 17, 1549, 6696, 220, 21, 17, 20, 15, 13, 3776, 803, 882, 553, 220, 17, 374, 220, 18, 16, 17, 20, 13, 13824, 11, 220, 18, 16, 17, 20, 374, 537, 74916, 553, 220, 17, 13, 2055, 11, 279, 1372, 315, 220, 17, 82, 304, 279, 10250, 8168, 2022, 374, 220, 18, 13, 4695, 7218, 389, 311, 220, 20, 13, 220, 18, 16, 17, 20, 17779, 553, 220, 20, 374, 220, 21, 17, 20, 13, 8765, 4490, 553, 220, 20, 1549, 374, 220, 16, 17, 20, 13, 13759, 553, 220, 20, 374, 220, 17, 20, 11, 323, 3055, 803, 553, 220, 20, 374, 220, 20, 11, 323, 5499, 553, 220, 20, 374, 220, 16, 13, 2055, 11, 429, 594, 220, 20, 61, 20, 13, 4710, 97904, 432, 678, 3786, 11, 279, 10250, 9363, 315, 220, 17, 20, 15, 15, 15, 525, 220, 17, 61, 18, 353, 220, 20, 61, 20, 13, 4695, 11, 311, 1477, 279, 7772, 4727, 9334, 8168, 11, 358, 1184, 311, 1401, 518, 279, 505, 2700, 315, 279, 10250, 9363, 13, 362, 4727, 9334, 702, 1496, 505, 2700, 304, 1181, 10250, 8168, 2022, 13, 2055, 11, 369, 1817, 10250, 8168, 11, 358, 646, 1896, 438, 1657, 13530, 438, 3204, 382, 24617, 448, 220, 17, 61, 18, 13, 576, 27690, 374, 220, 18, 11, 892, 374, 10322, 13, 576, 7772, 1496, 27690, 2686, 1091, 220, 18, 374, 220, 17, 11, 773, 582, 646, 1896, 220, 17, 61, 17, 438, 949, 315, 279, 4727, 9334, 13, 5005, 369, 220, 20, 61, 20, 11, 279, 27690, 374, 220, 20, 13, 576, 7772, 1496, 27690, 2686, 1091, 220, 20, 374, 220, 19, 11, 773, 582, 646, 1896, 220, 20, 61, 19, 13, 15277, 11, 279, 7772, 4727, 9334, 8168, 374, 220, 17, 61, 17, 353, 220, 20, 61, 19, 382, 57908, 1095, 429, 25, 220, 17, 61, 17, 374, 220, 19, 11, 323, 220, 20, 61, 19, 374, 220, 21, 17, 20, 13, 58712, 6711, 220, 19, 323, 220, 21, 17, 20, 6696, 220, 17, 20, 15, 15, 13, 2055, 11, 220, 17, 20, 15, 15, 15, 646, 387, 5326, 438, 220, 17, 20, 15, 15, 353, 220, 16, 15, 13, 6771, 752, 1779, 429, 25, 220, 17, 20, 15, 15, 353, 220, 16, 15, 374, 12824, 220, 17, 20, 15, 15, 15, 13, 2055, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 11995, 248, 7, 17, 20, 15, 15, 353, 220, 16, 15, 568, 4710, 12549, 279, 9334, 3704, 315, 264, 1985, 374, 279, 1985, 315, 279, 9334, 19703, 11, 419, 9044, 11995, 248, 17, 20, 15, 15, 353, 11995, 248, 16, 15, 13, 4695, 11, 11995, 248, 17, 20, 15, 15, 374, 264, 3881, 897, 13, 220, 17, 20, 15, 15, 374, 220, 20, 15, 52263, 1576, 220, 20, 15, 9, 20, 15, 28, 17, 20, 15, 15, 13, 2055, 11, 11995, 248, 17, 20, 15, 15, 374, 220, 20, 15, 13, 15277, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 220, 20, 15, 353, 11995, 248, 16, 15, 13, 4710, 3983, 3783, 11, 374, 220, 16, 15, 264, 10250, 1372, 30, 7414, 11, 220, 16, 15, 374, 220, 17, 9, 20, 11, 2176, 49433, 13, 2619, 525, 902, 4727, 9334, 9363, 304, 220, 16, 15, 11, 773, 11995, 248, 16, 15, 4157, 387, 43799, 4623, 13, 15277, 11, 279, 43799, 1352, 315, 11995, 248, 17, 20, 15, 15, 15, 374, 220, 20, 15, 144336, 16, 15, 13, 4710, 92014, 11, 7196, 1052, 594, 2441, 1616, 311, 5486, 419, 13, 6771, 752, 10146, 13, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 353, 220, 16, 15, 15, 15, 13, 9211, 220, 17, 20, 3039, 220, 16, 15, 15, 15, 374, 220, 17, 20, 15, 15, 15, 13, 5005, 11, 11995, 248, 17, 20, 15, 15, 15, 284, 11995, 248, 7, 17, 20, 353, 220, 16, 15, 15, 15, 8, 284, 11995, 248, 17, 20, 353, 11995, 248, 16, 15, 15, 15, 13, 11995, 248, 17, 20, 374, 220, 20, 11, 773, 429, 9044, 220, 20, 144336, 16, 15, 15, 15, 13, 1988, 11995, 248, 16, 15, 15, 15, 646, 387, 43799, 4623, 13, 220, 16, 15, 15, 15, 374, 220, 16, 15, 15, 353, 220, 16, 15, 11, 773, 11995, 248, 16, 15, 15, 15, 284, 11995, 248, 7, 16, 15, 15, 9, 16, 15, 8, 284, 11995, 248, 16, 15, 15, 353, 11995, 248, 16, 15, 284, 220, 16, 15, 144336, 16, 15, 13, 15277, 11, 220, 20, 144336, 16, 15, 15, 15, 9044, 220, 20, 9, 16, 15, 144336, 16, 15, 284, 220, 20, 15, 144336, 16, 15, 13, 2055, 11, 1852, 1102, 13, 4710, 14037, 1616, 25, 10696, 1667, 27690, 5601, 13, 8704, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 353, 220, 16, 15, 61, 18, 13, 2055, 11, 220, 17, 20, 374, 220, 20, 61, 17, 323, 220, 16, 15, 61, 18, 374, 320, 17, 9, 20, 29776, 18, 284, 220, 17, 61, 18, 9, 20, 61, 18, 13, 2055, 11, 30055, 11, 220, 20, 61, 17, 353, 220, 17, 61, 18, 353, 20, 61, 18, 284, 220, 17, 61, 18, 9, 20, 13268, 17, 10, 18, 8, 284, 220, 17, 61, 18, 9, 20, 61, 20, 13, 15920, 374, 279, 1852, 10250, 9363, 438, 1573, 13, 5005, 11, 979, 4633, 279, 9334, 3704, 11, 582, 646, 3270, 432, 438, 220, 17, 13268, 18, 14, 17, 4806, 20, 13268, 20, 14, 17, 8, 284, 220, 17, 13268, 16, 488, 220, 16, 14, 17, 4806, 20, 13268, 17, 488, 220, 16, 14, 17, 8, 284, 220, 17, 9, 20, 61, 17, 353, 11995, 248, 7, 17, 9, 20, 8, 284, 220, 17, 9, 17, 20, 9, 144336, 16, 15, 284, 220, 20, 15, 144336, 16, 15, 13, 84194, 11, 1852, 4226, 13, 4710, 10061, 752, 1083, 12564, 279, 34776, 897, 311, 1779, 13, 11995, 248, 17, 20, 15, 15, 15, 13, 220, 17, 20, 15, 15, 15, 374, 220, 17, 20, 9, 16, 15, 15, 15, 11, 773, 9334, 3704, 374, 220, 20, 9, 26888, 7, 16, 15, 15, 15, 568, 17946, 7, 16, 15, 15, 15, 8, 374, 911, 220, 18, 16, 13, 21, 17, 17, 22, 22, 21, 21, 11, 773, 220, 20, 9, 18, 16, 13, 21, 17, 17, 22, 22, 21, 21, 374, 13187, 220, 16, 20, 23, 13, 16, 16, 18, 23, 23, 18, 13, 38478, 11, 220, 20, 15, 9, 26888, 7, 16, 15, 568, 17946, 7, 16, 15, 8, 374, 13187, 220, 18, 13, 16, 21, 17, 17, 22, 22, 21, 21, 11, 773, 220, 20, 15, 9, 18, 13, 16, 21, 17, 17, 22, 22, 21, 21, 374, 1083, 220, 16, 20, 23, 13, 16, 16, 18, 23, 23, 18, 13, 2055, 2176, 5510, 11, 279, 34776, 897, 374, 279, 1852, 13, 4710, 54815, 11, 279, 43799, 17855, 1352, 374, 220, 20, 15, 144336, 16, 15, 11, 323, 279, 34776, 897, 374, 13187, 220, 16, 20, 23, 13, 16, 16, 13, 1988, 279, 3405, 17064, 311, 39721, 11, 773, 279, 4734, 1352, 374, 4362, 11, 537, 279, 12122, 56204, 13, 2055, 279, 4226, 374, 220, 20, 15, 144336, 16, 15, 13, 4710, 14190, 11, 714, 374, 1052, 264, 1616, 311, 3270, 432, 2041, 264, 9334, 3704, 30, 1416, 220, 17, 20, 15, 15, 15, 374, 264, 4727, 9334, 5086, 13, 6771, 594, 1779, 13, 3555, 1372, 52263, 374, 220, 17, 20, 15, 15, 15, 30, 6771, 594, 1490, 13, 220, 16, 20, 15, 61, 17, 374, 220, 17, 17, 20, 15, 15, 11, 220, 16, 21, 15, 61, 17, 374, 220, 17, 20, 21, 15, 15, 13, 2055, 220, 17, 20, 15, 15, 15, 374, 1948, 220, 16, 20, 15, 61, 17, 323, 220, 16, 21, 15, 61, 17, 13, 220, 16, 20, 23, 61, 17, 374, 220, 17, 19, 24, 21, 19, 11, 892, 374, 3265, 714, 537, 220, 17, 20, 15, 15, 15, 13, 220, 16, 20, 24, 61, 17, 374, 220, 17, 20, 17, 23, 16, 11, 892, 374, 916, 13, 2055, 11, 220, 17, 20, 15, 15, 15, 374, 537, 264, 4727, 9334, 13, 15277, 11, 279, 43799, 1352, 374, 12824, 220, 20, 15, 144336, 16, 15, 13, 4710, 92014, 11, 421, 279, 4024, 1372, 572, 220, 17, 20, 15, 15, 11, 429, 594, 220, 20, 15, 61, 17, 11, 714, 220, 17, 20, 15, 15, 15, 374, 220, 16, 15, 15, 3039, 8131, 13, 2055, 11, 17946, 7, 17, 20, 15, 15, 15, 8, 284, 17946, 7, 17, 20, 15, 15, 353, 220, 16, 15, 8, 284, 17946, 7, 17, 20, 15, 15, 8, 353, 17946, 7, 16, 15, 8, 284, 220, 20, 15, 9, 26888, 7, 16, 15, 568, 84194, 11, 1852, 3166, 13, 4710, 4416, 11, 1283, 678, 1493, 5413, 323, 12341, 11, 358, 2776, 16506, 429, 279, 43799, 1352, 315, 11995, 248, 17, 20, 15, 15, 15, 374, 220, 20, 15, 144336, 16, 15, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 39721, 1124, 11520, 26888, 90, 17, 20, 15, 15, 15, 11035, 701, 582, 1191, 553, 2097, 5503, 279, 1372, 1119, 264, 1985, 315, 264, 4727, 9334, 323, 2441, 1372, 13, 4710, 16, 13, 3070, 32306, 37729, 2022, 95518, 2303, 256, 17767, 17, 20, 15, 15, 15, 284, 220, 17, 61, 18, 1124, 15136, 220, 20, 61, 20, 59, 568, 18611, 17, 13, 3070, 28301, 1437, 23239, 20084, 5403, 95518, 2303, 256, 576, 7772, 4727, 9334, 9363, 525, 17767, 17, 61, 17, 57758, 320, 1499, 17767, 17, 61, 18, 59, 593, 323, 17767, 20, 61, 19, 57758, 320, 1499, 17767, 20, 61, 20, 59, 4579, 2303, 256, 58712, 6711, 1493, 6696, 17767, 17, 61, 17, 1124, 15136, 220, 20, 61, 19, 284, 220, 19, 1124, 15136, 220, 21, 17, 20, 284, 220, 17, 20, 15, 15, 59, 568, 18611, 18, 13, 3070, 58465, 1247, 279, 15619, 18854, 95518, 2303, 256, 1124, 9640, 256, 1124, 26888, 90, 17, 20, 15, 15, 15, 92, 284, 1124, 26888, 90, 17, 20, 15, 15, 1124, 15136, 220, 16, 15, 92, 284, 1124, 26888, 90, 17, 20, 15, 15, 92, 1124, 15136, 1124, 26888, 90, 16, 15, 532, 256, 1124, 60, 2303, 256, 8704, 1124, 11520, 26888, 90, 17, 20, 15, 15, 92, 284, 220, 20, 15, 59, 701, 419, 15491, 9606, 311, 25, 2303, 256, 1124, 9640, 256, 220, 20, 15, 1124, 15136, 1124, 26888, 90, 16, 15, 532, 256, 1124, 2533, 19, 13, 3070, 62339, 95518, 2303, 256, 481, 41109, 8168, 2022, 25, 17767, 17, 20, 15, 15, 15, 284, 220, 17, 20, 1124, 15136, 220, 16, 15, 15, 15, 59, 701, 6388, 311, 1124, 11520, 26888, 90, 17, 20, 92, 1124, 15136, 1124, 26888, 90, 16, 15, 15, 15, 92, 284, 220, 20, 1124, 15136, 220, 16, 15, 59, 26888, 90, 16, 15, 92, 284, 220, 20, 15, 59, 26888, 90, 16, 15, 11035, 568, 2303, 256, 481, 47124, 938, 56204, 42396, 28137, 382, 44500, 11, 279, 43799, 1352, 315, 1124, 11520, 26888, 90, 17, 20, 15, 15, 15, 11035, 8, 374, 1124, 11520, 79075, 90, 20, 15, 59, 26888, 90, 16, 15, 3417, 59, 3593, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] ================================================================================ >>> End of first sample inspection <<< ================================================================================ [2025-08-04 08:33:03,890] [WARNING] [lr_schedules.py:683:get_lr] Attempting to get learning rate from scheduler before it has started wandb: Currently logged in as: fengqi2016 (team-promptia) to https://api.wandb.ai. Use `wandb login --relogin` to force relogin wandb: Tracking run with wandb version 0.21.0 wandb: Run data is saved locally in /home/user1/P/20250803/wandb/run-20250804_083304-2dbthh6k wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run Qwen3-32B_Bespoke-Stratos-17k_finetune wandb: ⭐️ View project at https://wandb.ai/team-promptia/Model_Training wandb: 🚀 View run at https://wandb.ai/team-promptia/Model_Training/runs/2dbthh6k 0%| | 0/522 [00:00>> Printing the first sample of the first training batch <<< ================================================================================ [Input IDs]: [151644, 8948, 198, 7771, 3476, 438, 458, 17847, 17601, 26364, 23966, 4755, 1526, 264, 36438, 1293, 7274, 1882, 1573, 8241, 279, 1590, 23560, 323, 13382, 9904, 13, 1096, 7460, 22570, 304, 264, 15817, 10775, 315, 6358, 11, 28285, 4849, 11, 26403, 11, 31734, 23391, 11, 21844, 11, 1182, 376, 4527, 11, 323, 19569, 311, 2225, 1632, 12, 24712, 291, 7274, 1882, 13, 5209, 5944, 697, 2033, 1119, 1378, 1887, 14158, 25, 35187, 323, 12478, 13, 758, 279, 35187, 3772, 11, 7716, 697, 32711, 1882, 1667, 279, 5189, 3561, 25, 82639, 7265, 3575, 5854, 2450, 91, 29, 314, 60565, 448, 7354, 18663, 448, 5196, 77, 1699, 8275, 82639, 408, 3575, 5854, 2450, 91, 29, 8886, 3019, 1265, 2924, 11682, 37764, 1741, 438, 3181, 285, 7024, 4755, 11, 28285, 4849, 9760, 14613, 11, 86781, 287, 501, 6708, 11, 68863, 279, 13403, 315, 279, 1482, 7354, 11, 73185, 894, 5975, 11, 323, 17493, 5853, 3681, 7354, 13, 758, 279, 12478, 3772, 11, 3118, 389, 5257, 13553, 11, 47439, 804, 11, 323, 62751, 504, 279, 35187, 3772, 11, 59726, 3042, 279, 1590, 6291, 429, 498, 81477, 4396, 13, 576, 6291, 1265, 7146, 264, 19819, 11, 13382, 11, 63594, 7493, 1707, 323, 7716, 5871, 3019, 4362, 311, 5545, 279, 16688, 11, 23126, 438, 11017, 25, 82639, 7265, 3575, 50274, 91, 29, 314, 11822, 23126, 11, 23560, 11, 323, 2797, 6291, 92, 82639, 408, 3575, 50274, 91, 29, 4695, 11, 1430, 311, 11625, 279, 2701, 3405, 1526, 279, 3403, 17501, 25, 151645, 198, 151644, 872, 198, 31115, 458, 32156, 13027, 729, 7907, 504, 279, 2661, 9934, 13, 576, 729, 1265, 1896, 31369, 438, 1946, 323, 1173, 279, 2550, 13, 28424, 1618, 279, 729, 1283, 279, 7271, 38437, 525, 2661, 458, 1334, 315, 5109, 13, 6771, 601, 78064, 279, 1334, 448, 57960, 14824, 18785, 90, 32, 59, 2359, 26056, 1291, 13989, 12947, 4615, 3383, 374, 1602, 4285, 13, 1446, 1184, 311, 1477, 279, 897, 5927, 553, 279, 729, 57960, 1318, 90, 11894, 25547, 32, 15087, 382, 11894, 4346, 340, 262, 2629, 284, 220, 15, 198, 262, 369, 600, 284, 220, 16, 311, 362, 1954, 198, 286, 369, 502, 284, 600, 10, 16, 311, 362, 1954, 198, 310, 2629, 284, 2629, 488, 16581, 1188, 32, 989, 7574, 32, 3809, 2467, 11884, 32, 989, 8465, 32, 3809, 9365, 715, 262, 470, 2629, 271, 641, 2805, 11, 419, 729, 4990, 678, 12460, 13530, 315, 24953, 504, 279, 1334, 323, 11367, 279, 897, 57960, 2359, 59, 11008, 3993, 59, 37018, 90, 32, 989, 7574, 32, 3809, 13989, 90, 32, 989, 17960, 15136, 362, 3809, 60, 11035, 1291, 59, 8052, 3993, 3, 311, 279, 2629, 13, 4615, 3383, 374, 311, 1477, 279, 2629, 13, 18611, 9112, 25, 57960, 2359, 59, 11008, 3993, 59, 37018, 90, 32, 15170, 33, 11035, 1291, 59, 8052, 3993, 3, 374, 279, 7546, 12804, 729, 13, 18611, 2505, 15042, 4710, 785, 1156, 1555, 5610, 57960, 10374, 13233, 76025, 31716, 11, 279, 1372, 315, 1273, 5048, 311, 1795, 13, 18611, 4854, 1273, 1142, 5610, 1378, 5128, 25, 279, 1156, 1555, 5610, 400, 45, 54876, 279, 1379, 315, 279, 1334, 11, 323, 279, 2086, 1555, 5610, 400, 45, 3, 25780, 18663, 553, 12621, 13, 18611, 5097, 15042, 4710, 785, 2550, 1265, 6644, 6896, 57960, 10374, 13233, 76025, 31716, 5128, 1380, 279, 400, 72, 47822, 339, 31716, 1555, 5610, 279, 4226, 369, 279, 400, 72, 47822, 339, 31716, 1273, 1142, 13, 18611, 12925, 4710, 3, 16, 59, 273, 80, 350, 59, 273, 80, 16, 20, 3, 4710, 3, 16, 59, 273, 80, 451, 59, 273, 80, 17, 4955, 1733, 16, 15, 61, 20, 3, 4710, 3, 16, 59, 273, 80, 59, 1318, 90, 9190, 315, 92, 93, 45, 93, 59, 1318, 90, 1975, 678, 1273, 5048, 92, 93, 59, 273, 80, 17, 4955, 1733, 16, 15, 61, 20, 3, 4710, 3, 16, 59, 273, 80, 362, 989, 17960, 273, 80, 16, 15, 61, 24, 3, 18611, 17571, 5571, 18611, 17, 198, 18, 198, 19, 220, 17, 220, 18, 198, 18, 198, 16, 220, 19, 220, 16, 271, 17571, 9258, 18611, 15, 198, 19, 271, 69769, 4710, 5338, 3393, 11538, 25, 57960, 2359, 59, 11008, 3993, 59, 37018, 90, 21, 15170, 23, 11035, 1291, 59, 8052, 3993, 41715, 2359, 59, 11008, 3993, 59, 37018, 90, 22, 15170, 16, 17, 11035, 1291, 59, 8052, 3993, 41715, 2359, 59, 11008, 3993, 59, 37018, 90, 20, 15170, 21, 11035, 1291, 59, 8052, 3993, 28, 15, 3, 4710, 15666, 3393, 11538, 25, 57960, 2359, 59, 11008, 3993, 59, 37018, 90, 20, 15170, 19, 11035, 1291, 59, 8052, 3993, 41715, 2359, 59, 11008, 3993, 59, 37018, 90, 17, 15170, 16, 11035, 1291, 59, 8052, 3993, 41715, 2359, 59, 11008, 3993, 59, 37018, 90, 20, 15170, 19, 11035, 1291, 59, 8052, 3993, 28, 19, 25046, 151645, 198, 151644, 77091, 198, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 21403, 419, 3491, 13, 2055, 11, 582, 1184, 311, 12564, 279, 2629, 315, 6422, 1188, 64, 488, 293, 24254, 64, 33279, 593, 369, 678, 13530, 320, 64, 11, 293, 8, 304, 279, 1334, 13, 576, 30339, 5486, 1035, 387, 311, 29629, 916, 678, 13530, 11, 11047, 1817, 4647, 11, 323, 2629, 1105, 705, 13, 1988, 3783, 11, 279, 16982, 1977, 429, 451, 646, 387, 705, 311, 220, 17, 68, 20, 13, 8670, 1290, 11, 1576, 369, 451, 28, 17, 68, 20, 11, 279, 1372, 315, 13530, 374, 2163, 220, 17, 68, 16, 15, 11, 892, 374, 1616, 2238, 2409, 13, 2055, 279, 64098, 80049, 5486, 374, 8491, 537, 2087, 311, 975, 1588, 13, 1205, 1184, 264, 46478, 1616, 382, 80022, 11, 1077, 594, 1744, 911, 279, 35972, 7493, 1588, 13, 576, 6422, 315, 320, 64, 488, 293, 24254, 64, 33279, 568, 6771, 594, 39721, 279, 7493, 4766, 279, 6422, 13, 320, 64, 488, 293, 24254, 64, 33279, 8, 284, 220, 16, 14186, 488, 220, 16, 3470, 13, 2055, 279, 6422, 315, 320, 16, 14186, 488, 220, 16, 3470, 568, 2055, 279, 2629, 374, 279, 2629, 916, 678, 13530, 315, 6422, 7, 16, 14186, 488, 220, 16, 3470, 3593, 14190, 11, 714, 1246, 646, 582, 12564, 419, 29720, 30, 6771, 594, 23643, 3204, 2750, 315, 264, 323, 293, 382, 10061, 594, 2908, 3204, 2750, 315, 220, 16, 14186, 488, 220, 16, 3470, 13, 8704, 264, 323, 293, 525, 6785, 25780, 320, 41968, 429, 807, 525, 5424, 315, 279, 1334, 701, 1817, 315, 220, 16, 14186, 323, 220, 16, 3470, 374, 264, 6785, 1931, 1372, 2686, 1091, 476, 6144, 311, 220, 16, 13, 2055, 862, 2629, 374, 1948, 220, 15, 323, 220, 17, 13, 1988, 2474, 264, 323, 293, 525, 518, 3245, 220, 16, 11, 279, 8028, 2629, 374, 220, 17, 320, 9309, 264, 323, 293, 525, 220, 16, 568, 13824, 902, 25, 421, 264, 374, 220, 16, 11, 1221, 220, 16, 14186, 374, 220, 16, 13, 2055, 220, 16, 14186, 488, 16, 3470, 979, 264, 28, 16, 323, 293, 28, 16, 374, 220, 17, 11, 892, 6696, 6422, 220, 17, 13, 1988, 421, 264, 28, 16, 323, 293, 28, 17, 11, 1221, 220, 16, 488, 220, 15, 13, 20, 284, 220, 16, 13, 20, 11, 6422, 374, 220, 16, 13, 88190, 382, 4416, 279, 3204, 2750, 369, 6422, 7, 16, 14186, 488, 220, 16, 3470, 8, 646, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 6771, 594, 1490, 979, 1817, 1142, 8573, 382, 5338, 11, 279, 6422, 374, 220, 15, 25, 979, 220, 16, 14186, 488, 220, 16, 3470, 366, 220, 16, 13, 2055, 979, 279, 2629, 315, 24450, 27687, 1127, 374, 2686, 1091, 220, 16, 13, 3555, 2750, 315, 264, 323, 293, 26553, 419, 30, 6771, 594, 1490, 13, 6771, 594, 55327, 844, 279, 31205, 220, 16, 14186, 488, 220, 16, 3470, 366, 220, 16, 13, 71059, 2176, 11067, 553, 668, 320, 11284, 264, 323, 293, 525, 6785, 11, 419, 374, 5420, 701, 582, 633, 293, 488, 264, 366, 668, 13, 45902, 81, 3726, 438, 668, 481, 264, 481, 293, 861, 220, 15, 13, 30370, 220, 16, 311, 2176, 11067, 25, 668, 481, 64, 481, 65, 488, 16, 861, 16, 11397, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 13, 2055, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 220, 16, 382, 4416, 369, 264, 323, 293, 2604, 17, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 518, 3245, 220, 16, 320, 333, 2987, 264, 28, 17, 323, 293, 28, 17, 11, 1221, 320, 16, 2376, 16, 11730, 16, 11, 892, 16819, 220, 16, 13, 2055, 279, 31205, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 1035, 1373, 429, 2176, 264, 323, 293, 525, 2604, 18, 11, 714, 3783, 11, 1077, 594, 1490, 1447, 14190, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 13, 1752, 3110, 11, 264, 28, 18, 11, 293, 28, 17, 25, 320, 17, 2376, 16, 8, 284, 17, 29, 16, 11397, 220, 16, 14, 18, 488, 16, 14, 17, 284, 20, 14, 21, 366, 16, 13, 13824, 220, 20, 14, 21, 374, 220, 15, 13, 23, 18, 18, 11, 892, 6422, 374, 220, 15, 13, 2055, 304, 419, 1142, 11, 279, 2629, 1035, 16792, 220, 15, 13, 2055, 9834, 11, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 11, 1221, 279, 2629, 374, 220, 15, 382, 2679, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 11, 1221, 279, 2629, 374, 2604, 16, 1939, 14190, 1077, 594, 1490, 13, 6771, 594, 1896, 264, 28, 17, 323, 293, 28, 17, 13, 320, 64, 12, 16, 2376, 65, 12, 16, 11730, 16, 9, 16, 28, 16, 13, 2055, 220, 16, 14186, 488, 16, 3470, 284, 220, 16, 14, 17, 488, 16, 14, 17, 28, 16, 11397, 6422, 374, 220, 16, 382, 2679, 264, 28, 17, 323, 293, 28, 18, 25, 320, 16, 2376, 17, 11730, 17, 29, 16, 11397, 2629, 374, 220, 16, 14, 17, 488, 16, 14, 18, 28, 20, 14, 21, 366, 16, 11397, 6422, 220, 15, 382, 14190, 419, 4977, 51033, 13, 13824, 304, 279, 1156, 3110, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 16819, 220, 16, 13, 2055, 279, 2629, 374, 6896, 220, 16, 13, 2055, 279, 6422, 374, 220, 16, 382, 3983, 421, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 6896, 220, 16, 11, 1221, 279, 2629, 374, 220, 16, 13, 2055, 279, 31205, 220, 16, 14186, 488, 16, 3470, 2604, 16, 374, 13578, 311, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 13, 2055, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 11, 279, 2629, 374, 2604, 16, 382, 4416, 279, 3204, 2750, 315, 6422, 7, 16, 14186, 488, 16, 3470, 8, 525, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 9211, 279, 7192, 3204, 2629, 374, 220, 16, 10, 16, 28, 17, 11, 892, 13666, 979, 264, 323, 293, 525, 2176, 220, 16, 13, 2055, 279, 6422, 646, 387, 220, 17, 1172, 421, 264, 28, 16, 323, 293, 28, 16, 382, 4416, 1077, 594, 1438, 419, 1495, 13, 1752, 1817, 6716, 320, 64, 11, 293, 701, 279, 3204, 19026, 525, 1447, 12, 220, 17, 11, 421, 264, 28, 16, 323, 293, 28, 16, 382, 12, 220, 16, 11, 421, 320, 64, 28, 16, 323, 293, 28, 16, 8, 902, 13, 13824, 11, 369, 3110, 11, 264, 28, 16, 323, 293, 28, 17, 25, 220, 16, 488, 220, 15, 13, 20, 284, 16, 13, 20, 11397, 6422, 220, 16, 13, 2055, 979, 2987, 264, 476, 293, 374, 220, 16, 11, 714, 537, 2176, 13, 2521, 979, 264, 28, 17, 323, 293, 28, 17, 25, 2629, 220, 16, 11397, 6422, 220, 16, 382, 14190, 11, 279, 2629, 220, 16, 14186, 488, 16, 3470, 646, 387, 2604, 16, 1496, 979, 264, 323, 293, 525, 8131, 13, 8909, 264, 28, 17, 323, 293, 28, 16, 25, 2629, 374, 220, 16, 13, 20, 11397, 6422, 220, 16, 382, 4416, 279, 18527, 374, 220, 16, 304, 279, 2701, 5048, 1447, 49244, 320, 64, 28, 16, 323, 293, 2604, 17, 8, 476, 320, 64, 9922, 17, 323, 293, 28, 16, 8, 11397, 2629, 374, 320, 16, 488, 220, 16, 3470, 8, 1380, 293, 9922, 17, 11, 892, 374, 220, 16, 488, 2494, 2651, 15, 13, 20, 11, 773, 2629, 374, 1948, 220, 16, 323, 220, 16, 13, 20, 11397, 6422, 220, 16, 13, 2521, 979, 2176, 264, 323, 293, 525, 220, 17, 11397, 2629, 220, 16, 13, 2521, 979, 264, 28, 17, 323, 293, 28, 17, 11397, 2629, 220, 16, 13, 2521, 1008, 27459, 1380, 220, 16, 14186, 488, 16, 3470, 2604, 16, 714, 366, 17, 382, 14190, 11, 369, 3110, 11, 264, 28, 17, 323, 293, 28, 18, 13, 2629, 374, 220, 15, 13, 20, 488, 220, 15, 13, 18, 18, 18, 1112, 284, 220, 15, 13, 23, 18, 18, 11, 892, 374, 2686, 1091, 220, 16, 13, 2055, 6422, 220, 15, 13, 2055, 304, 429, 1142, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 220, 16, 9, 17, 28, 17, 29, 16, 13, 2055, 279, 2629, 374, 2686, 1091, 220, 16, 382, 4416, 279, 3204, 19026, 311, 279, 2629, 646, 1172, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 6771, 594, 22049, 551, 678, 3204, 13530, 320, 64, 11, 293, 8, 1119, 1493, 2326, 11059, 382, 4416, 279, 2790, 2629, 374, 220, 17, 353, 356, 16, 34, 16, 320, 1782, 1372, 315, 13530, 1380, 2176, 525, 220, 16, 82, 8, 488, 220, 16, 353, 320, 4082, 315, 13530, 1380, 6896, 825, 374, 220, 16, 11, 5519, 279, 1372, 315, 13530, 1380, 2176, 525, 220, 17, 8, 488, 220, 15, 369, 678, 1008, 13530, 382, 14190, 11, 902, 13, 9211, 979, 264, 28, 16, 323, 293, 28, 17, 11, 279, 2629, 374, 220, 16, 13, 20, 11397, 6422, 374, 220, 16, 13, 34239, 11, 979, 264, 28, 17, 323, 293, 28, 16, 11, 1852, 13, 2055, 678, 13530, 1380, 6896, 825, 374, 220, 16, 16792, 220, 16, 1817, 13, 7281, 11, 13530, 1380, 2176, 525, 220, 17, 25, 2629, 220, 16, 11397, 220, 16, 13, 393, 4720, 1380, 264, 28, 16, 323, 293, 28, 16, 25, 2629, 220, 17, 11397, 220, 17, 13, 3555, 911, 1008, 13530, 1939, 14190, 11, 1077, 594, 1490, 13, 3197, 264, 28, 17, 323, 293, 28, 18, 25, 2629, 374, 220, 15, 13, 20, 488, 220, 15, 13, 18, 18, 18, 1112, 284, 220, 15, 13, 23, 18, 18, 11397, 6422, 220, 15, 13, 2055, 18527, 374, 220, 15, 382, 2679, 264, 28, 18, 323, 293, 28, 18, 25, 2629, 374, 220, 17, 14, 18, 11397, 220, 15, 13, 21, 21, 21, 11, 6422, 220, 15, 382, 2679, 264, 28, 17, 323, 293, 28, 17, 25, 2629, 374, 220, 16, 11397, 6422, 220, 16, 382, 2679, 264, 28, 16, 323, 293, 28, 18, 25, 2629, 220, 16, 488, 220, 16, 14, 18, 11397, 220, 16, 13, 18, 18, 18, 11397, 6422, 220, 16, 382, 4416, 304, 419, 1142, 11, 18527, 374, 220, 16, 382, 14190, 11, 773, 979, 264, 28, 16, 323, 293, 374, 894, 1008, 1372, 320, 8088, 537, 220, 16, 701, 279, 2629, 374, 220, 16, 488, 220, 16, 3470, 11, 892, 374, 1948, 220, 16, 323, 220, 17, 13, 2055, 279, 6422, 374, 220, 16, 13, 2055, 279, 18527, 374, 220, 16, 369, 678, 13530, 1380, 6896, 825, 374, 220, 16, 382, 7039, 11, 1077, 594, 1744, 911, 13530, 1380, 2176, 525, 220, 16, 13, 5005, 2629, 374, 220, 17, 11397, 6422, 220, 17, 13, 2055, 429, 594, 264, 18527, 315, 220, 17, 817, 6716, 382, 2461, 13530, 1380, 2176, 525, 220, 17, 25, 2629, 374, 220, 16, 11397, 18527, 220, 16, 382, 3983, 3783, 11, 1128, 911, 264, 28, 17, 323, 293, 28, 17, 30, 7414, 11, 2629, 374, 220, 16, 11397, 18527, 220, 16, 382, 3838, 911, 13530, 1380, 825, 374, 220, 17, 323, 279, 1008, 374, 220, 18, 30, 5005, 2629, 374, 220, 16, 14, 17, 488, 16, 14, 18, 284, 220, 20, 14, 21, 11397, 6422, 220, 15, 13, 2055, 18527, 220, 15, 382, 4416, 279, 1376, 374, 311, 1760, 1447, 12, 576, 1372, 315, 13530, 315, 220, 16, 82, 320, 66, 16, 5157, 220, 17, 8, 54916, 553, 220, 17, 382, 12, 576, 1372, 315, 13530, 1380, 6896, 825, 374, 220, 16, 25, 272, 16, 6599, 5035, 5424, 481, 272, 16, 8, 11397, 714, 2474, 1817, 6716, 374, 6509, 3055, 320, 72, 75638, 701, 773, 421, 279, 1334, 702, 856, 6174, 323, 379, 2477, 12, 3154, 11, 1221, 279, 1372, 315, 13530, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 374, 856, 6599, 88, 568, 1988, 2474, 13530, 525, 11457, 448, 600, 75638, 11, 714, 304, 279, 3491, 11, 279, 13530, 525, 678, 12460, 13530, 320, 72, 10327, 8, 1380, 600, 75638, 13, 2055, 304, 279, 1334, 11, 369, 1817, 220, 16, 323, 1817, 2477, 12, 16, 429, 4041, 1283, 432, 11, 432, 594, 264, 6716, 13, 2055, 279, 2790, 374, 856, 33247, 11, 1380, 856, 374, 279, 1760, 315, 220, 16, 82, 323, 379, 374, 279, 1760, 315, 2477, 12, 16, 82, 13, 9211, 369, 1817, 220, 16, 323, 1817, 2477, 12, 16, 304, 279, 1334, 11, 421, 279, 220, 16, 374, 1573, 279, 2477, 12, 16, 11, 432, 594, 29994, 3055, 13, 2055, 279, 2790, 1372, 374, 856, 33247, 382, 12209, 11, 369, 13530, 1380, 2176, 525, 220, 17, 82, 25, 279, 1760, 374, 320, 66, 17, 5157, 220, 17, 8, 54916, 553, 220, 16, 382, 49574, 11, 13530, 1380, 825, 374, 220, 17, 323, 279, 1008, 374, 220, 16, 25, 1846, 525, 2669, 29994, 304, 279, 856, 33247, 4647, 11, 773, 807, 16792, 220, 16, 1817, 382, 14190, 11, 714, 979, 264, 28, 16, 323, 293, 28, 17, 11, 279, 18527, 374, 220, 16, 13, 3197, 264, 28, 17, 323, 293, 28, 16, 11, 279, 6716, 320, 72, 10327, 8, 1035, 537, 387, 6509, 1576, 502, 1969, 387, 861, 72, 13, 2055, 304, 279, 1334, 11, 421, 264, 220, 17, 4041, 1573, 264, 220, 16, 11, 279, 6716, 320, 72, 10327, 8, 1035, 387, 320, 17, 11, 16, 8, 11397, 714, 502, 374, 600, 10, 16, 11, 714, 2474, 502, 374, 5080, 11, 279, 1334, 5424, 525, 362, 989, 1125, 362, 3809, 1125, 773, 279, 6716, 374, 320, 32, 989, 1125, 362, 3809, 2467, 284, 320, 17, 11, 16, 701, 714, 2474, 279, 2038, 36398, 320, 32, 989, 60, 488, 362, 3809, 2467, 11884, 32, 989, 60, 353, 362, 3809, 2467, 11397, 320, 17, 10, 16, 24254, 17, 9, 16, 8, 284, 220, 18, 14, 17, 11397, 6422, 220, 16, 13, 2055, 304, 419, 1142, 11, 432, 594, 279, 1852, 438, 320, 16, 11, 17, 8, 304, 3793, 315, 279, 2629, 13, 2055, 279, 18527, 374, 220, 16, 15484, 315, 279, 1973, 382, 14190, 11, 714, 979, 279, 6716, 374, 320, 64, 11, 293, 8, 1380, 264, 374, 220, 17, 323, 293, 374, 220, 16, 11, 279, 2629, 374, 320, 17, 10, 16, 24254, 17, 9, 16, 8, 284, 220, 18, 14, 17, 11397, 6422, 220, 16, 13, 2055, 429, 594, 279, 1852, 438, 421, 264, 572, 220, 16, 323, 293, 572, 220, 17, 382, 4416, 304, 279, 1334, 11, 678, 13530, 1380, 825, 2392, 374, 220, 16, 323, 279, 1008, 374, 537, 320, 1580, 29820, 315, 1973, 8, 16792, 220, 16, 13, 2055, 279, 1760, 315, 1741, 13530, 374, 856, 33247, 1380, 856, 374, 279, 1760, 315, 220, 16, 82, 11, 323, 379, 374, 279, 1760, 315, 2477, 12, 16, 82, 382, 3983, 1083, 11, 279, 13530, 1380, 2176, 525, 220, 17, 82, 16792, 220, 16, 1817, 382, 4416, 279, 2629, 646, 387, 10865, 1495, 1119, 1447, 1242, 284, 220, 17, 353, 356, 16, 77433, 62, 17, 488, 220, 16, 353, 320, 34, 16, 353, 356, 14179, 2985, 8, 488, 220, 16, 353, 356, 17, 77433, 62, 17, 488, 2629, 315, 1008, 13530, 429, 16792, 220, 16, 382, 14190, 11, 714, 525, 1052, 1008, 13530, 429, 16792, 220, 16, 30, 6771, 594, 1490, 13, 1752, 3110, 11, 264, 28, 17, 323, 293, 28, 18, 11397, 2629, 220, 20, 14, 21, 11397, 220, 15, 13, 2055, 902, 13, 3555, 911, 264, 28, 16, 323, 293, 28, 18, 25, 2629, 374, 320, 16, 10, 18, 24254, 16, 9, 18, 8, 284, 19, 14, 18, 11397, 6422, 220, 16, 13, 2055, 429, 594, 949, 315, 279, 356, 16, 353, 356, 14179, 2985, 4647, 13, 2055, 9834, 382, 3983, 1128, 911, 13530, 1380, 2176, 525, 220, 18, 30, 5005, 2629, 374, 220, 17, 14, 18, 11397, 6422, 220, 15, 382, 4416, 279, 1172, 1008, 13530, 429, 16792, 220, 16, 525, 279, 13530, 1380, 2176, 5424, 525, 220, 17, 382, 4416, 279, 2790, 2629, 374, 1447, 1242, 284, 220, 17, 353, 320, 66, 16, 353, 320, 66, 16, 481, 16, 5620, 17, 8, 488, 220, 16, 353, 320, 66, 16, 353, 320, 77, 481, 272, 16, 593, 488, 220, 16, 353, 320, 66, 17, 353, 320, 66, 17, 481, 16, 5620, 17, 8, 4710, 17949, 1447, 12, 576, 1156, 4647, 374, 279, 13530, 315, 220, 16, 82, 25, 1052, 525, 356, 1337, 16, 11, 220, 17, 8, 13530, 11, 1817, 28720, 220, 17, 382, 12, 576, 2086, 4647, 374, 279, 13530, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 25, 1052, 525, 272, 16, 353, 320, 77, 481, 272, 16, 8, 1741, 13530, 11, 1817, 28720, 220, 16, 382, 12, 576, 4843, 4647, 374, 279, 13530, 1380, 2176, 525, 220, 17, 25, 356, 1337, 17, 11, 220, 17, 8, 13530, 11, 1817, 28720, 220, 16, 382, 2403, 1008, 13530, 16792, 220, 15, 13, 2055, 279, 2629, 374, 279, 2629, 315, 1493, 2326, 3793, 382, 3872, 419, 4396, 30, 6771, 594, 1273, 419, 2348, 279, 6077, 11127, 382, 5338, 6077, 1946, 1447, 2271, 1142, 220, 16, 1447, 18, 271, 19, 220, 17, 220, 18, 271, 66, 16, 374, 279, 1760, 315, 220, 16, 82, 25, 220, 15, 13, 272, 17, 374, 1760, 315, 220, 17, 82, 25, 220, 16, 382, 4416, 2629, 1035, 387, 220, 15, 320, 1499, 1156, 4647, 8, 488, 220, 15, 320, 11284, 272, 16, 374, 220, 15, 8, 488, 320, 16, 6599, 15, 5620, 17, 8, 11397, 220, 15, 13, 2055, 2629, 374, 220, 15, 13, 15920, 9071, 279, 6077, 2550, 382, 15666, 1273, 1142, 1447, 18, 271, 16, 220, 19, 220, 16, 271, 66, 16, 374, 220, 17, 13, 272, 17, 374, 220, 15, 13, 3800, 374, 220, 16, 320, 1782, 220, 19, 3593, 4416, 1447, 17, 353, 320, 17, 9, 16, 14, 17, 8, 284, 220, 17, 353, 16, 284, 17, 4710, 10, 220, 16, 353, 320, 17, 353, 16, 8, 284, 220, 17, 4710, 10, 220, 15, 11397, 2790, 2629, 220, 19, 13, 15920, 9071, 279, 6077, 2550, 382, 4416, 419, 4977, 311, 975, 382, 14037, 1273, 1142, 25, 1077, 594, 1896, 264, 28, 508, 17, 11, 17, 936, 5005, 272, 16, 28, 15, 11, 272, 17, 28, 17, 13, 576, 2629, 1265, 387, 356, 7, 17, 11, 17, 4806, 16, 28, 16, 13, 2055, 320, 17, 9, 16, 14, 17, 4806, 16, 28, 16, 13, 2055, 2629, 374, 220, 16, 13, 6771, 594, 12564, 320, 17, 10, 17, 24254, 17, 9, 17, 8, 284, 19, 14, 19, 28, 16, 11397, 6422, 220, 16, 13, 2055, 9834, 382, 14037, 1273, 1142, 25, 508, 16, 11, 16, 11, 17, 936, 272, 16, 28, 17, 11, 3800, 28, 16, 320, 1782, 220, 17, 568, 272, 17, 28, 16, 382, 1242, 1035, 387, 220, 17, 353, 320, 17, 9, 16, 14, 17, 8, 11397, 220, 17, 353, 16, 28, 17, 4710, 10, 220, 17, 9, 16, 11397, 220, 17, 4710, 10, 220, 15, 320, 11284, 272, 17, 374, 220, 16, 11, 356, 7, 16, 11, 17, 8, 374, 220, 15, 692, 7595, 2629, 220, 19, 382, 10061, 594, 12564, 678, 13530, 1447, 7, 16, 11, 16, 1648, 2629, 374, 320, 17, 24254, 16, 9, 16, 8, 11397, 6422, 220, 17, 382, 7, 16, 11, 17, 1648, 2629, 320, 18, 14, 17, 11397, 16, 692, 7, 16, 11, 17, 1648, 2629, 320, 18, 14, 17, 11397, 16, 692, 4416, 2790, 2629, 220, 17, 10, 16, 10, 16, 28, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 508, 16, 11, 17, 11, 17, 936, 272, 16, 28, 16, 11, 3800, 28, 17, 320, 1782, 1378, 220, 17, 82, 568, 272, 17, 28, 17, 382, 1242, 1447, 17, 9, 15, 320, 11284, 272, 16, 374, 220, 16, 11, 773, 356, 7, 16, 11, 17, 8, 374, 220, 15, 8, 4710, 10, 220, 16, 9, 17, 11397, 220, 17, 4710, 10, 356, 7, 17, 11, 17, 4806, 16, 11397, 16, 4710, 7595, 220, 17, 10, 16, 28, 18, 382, 785, 13530, 525, 1447, 7, 16, 11, 17, 1648, 320, 16, 10, 17, 24254, 17, 8, 284, 16, 13, 20, 11397, 6422, 220, 16, 271, 7, 16, 11, 17, 1648, 1852, 438, 3403, 11397, 16, 271, 7, 17, 11, 17, 1648, 2629, 220, 16, 11397, 16, 271, 4416, 2790, 220, 16, 10, 16, 10, 16, 28, 18, 13, 39970, 382, 4416, 1039, 14806, 4278, 369, 1493, 5048, 382, 44500, 11, 279, 5486, 374, 311, 12564, 1447, 1242, 284, 220, 17, 353, 320, 66, 16, 353, 320, 66, 16, 12, 16, 8, 442, 220, 17, 8, 488, 320, 66, 16, 353, 320, 77, 481, 272, 16, 593, 488, 320, 66, 17, 353, 320, 66, 17, 481, 16, 8, 442, 220, 17, 692, 17949, 1447, 12, 576, 13530, 315, 220, 16, 82, 16792, 220, 17, 1817, 13, 5624, 315, 1741, 13530, 374, 356, 1337, 16, 11, 17, 8, 11397, 272, 16, 6599, 66, 16, 12, 16, 5620, 17, 11397, 30270, 553, 220, 17, 6696, 272, 16, 6599, 66, 16, 12, 16, 3593, 14190, 3783, 11, 3783, 13, 6771, 594, 1490, 25, 220, 17, 353, 320, 66, 16, 5157, 220, 17, 8, 374, 220, 17, 353, 320, 66, 16, 6599, 66, 16, 12, 16, 5620, 17, 8, 284, 272, 16, 6599, 66, 16, 12, 16, 568, 1988, 304, 279, 14806, 3403, 11, 279, 1156, 4647, 374, 220, 17, 353, 320, 66, 16, 5157, 220, 17, 8, 11397, 892, 374, 220, 17, 6599, 66, 16, 6599, 66, 16, 12, 16, 5620, 17, 8, 284, 272, 16, 6599, 66, 16, 12, 16, 568, 5005, 279, 2086, 4647, 374, 272, 16, 6599, 77, 481, 272, 16, 568, 20861, 4647, 374, 320, 66, 17, 5157, 220, 17, 8, 11397, 320, 66, 17, 6599, 66, 17, 12, 16, 5620, 17, 3593, 4416, 2629, 284, 272, 16, 6599, 66, 16, 12, 16, 8, 488, 272, 16, 6599, 77, 481, 66, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 271, 3983, 3783, 11, 1077, 594, 312, 10187, 1873, 279, 14806, 1447, 1242, 284, 320, 66, 16, 353, 320, 66, 16, 12, 16, 593, 873, 488, 320, 66, 16, 6599, 77, 481, 66, 16, 593, 488, 320, 320, 66, 17, 353, 320, 66, 17, 12, 16, 593, 442, 220, 17, 5125, 23085, 646, 387, 43799, 311, 1447, 1242, 284, 272, 16, 6599, 77, 481, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 442, 220, 17, 4710, 17949, 1447, 66, 16, 6599, 66, 16, 12, 16, 8, 488, 272, 16, 6599, 77, 481, 66, 16, 8, 284, 272, 16, 508, 320, 66, 16, 12, 16, 8, 488, 320, 77, 481, 272, 16, 8, 2279, 284, 272, 16, 320, 77, 12, 16, 692, 4416, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 5157, 220, 17, 692, 4416, 429, 594, 458, 1496, 34288, 14806, 382, 10061, 594, 1273, 419, 448, 279, 1156, 6077, 1447, 17571, 220, 16, 25, 272, 16, 28, 15, 11, 272, 17, 28, 16, 382, 1242, 284, 220, 15, 6599, 18, 12, 16, 8, 488, 320, 16, 9, 15, 5620, 17, 11397, 220, 15, 488, 15, 28, 15, 13, 39970, 382, 17571, 220, 17, 25, 272, 16, 28, 17, 11, 308, 28, 18, 382, 1242, 28, 220, 17, 6599, 18, 12, 16, 8, 488, 320, 15, 8, 11397, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 508, 16, 11, 17, 11, 17, 1125, 272, 16, 28, 16, 11, 272, 17, 28, 17, 11, 308, 28, 18, 382, 1242, 28, 16, 6599, 18, 12, 16, 8, 488, 320, 17, 9, 16, 5620, 17, 11397, 220, 17, 488, 16, 28, 18, 13, 39970, 382, 4416, 279, 14806, 374, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 4416, 279, 3491, 25271, 311, 25009, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 701, 279, 1372, 315, 220, 17, 82, 320, 66, 17, 701, 323, 18950, 419, 14806, 382, 1986, 374, 264, 6765, 25262, 13, 9211, 369, 1817, 1273, 1142, 11, 582, 646, 12564, 279, 4226, 304, 506, 1445, 8, 882, 11, 892, 374, 21555, 2661, 279, 16982, 382, 4416, 279, 7354, 525, 1447, 16, 13, 1752, 1817, 1273, 1142, 1447, 256, 264, 13, 4457, 451, 323, 279, 1334, 382, 256, 293, 13, 4504, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 279, 1372, 315, 220, 17, 82, 320, 66, 17, 3593, 256, 272, 13, 22603, 279, 2629, 438, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 17, 13, 9258, 419, 2629, 382, 4416, 419, 5486, 374, 506, 4140, 353, 308, 701, 892, 374, 21555, 369, 350, 28, 16, 20, 323, 2629, 315, 308, 705, 311, 220, 17, 68, 20, 382, 4416, 1431, 11, 279, 2038, 646, 387, 5326, 438, 11017, 1447, 4418, 350, 382, 2461, 1817, 350, 1273, 5048, 1447, 256, 4457, 451, 382, 256, 4457, 279, 1334, 315, 451, 25780, 382, 256, 4504, 272, 16, 323, 272, 17, 382, 256, 22603, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 256, 8213, 2629, 382, 10061, 594, 1273, 419, 2348, 279, 6077, 1946, 382, 17571, 5571, 220, 16, 1447, 17, 271, 18, 271, 19, 220, 17, 220, 18, 11397, 272, 16, 28, 15, 11, 272, 17, 28, 16, 13, 2629, 28, 15, 6599, 18, 12, 16, 8, 488, 320, 16, 9, 15, 5620, 17, 11397, 15, 13, 39970, 382, 15666, 1273, 1142, 1447, 18, 271, 16, 220, 19, 220, 16, 11397, 272, 16, 28, 17, 11, 2629, 28, 17, 6599, 18, 12, 16, 8, 11397, 19, 13, 272, 17, 28, 15, 13, 2055, 220, 19, 10, 15, 28, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 1334, 508, 16, 11, 16, 11, 17, 11, 17, 936, 308, 28, 19, 382, 66, 16, 28, 17, 11, 272, 17, 28, 17, 382, 1242, 28, 17, 6599, 19, 12, 16, 8, 488, 320, 17, 9, 16, 5620, 17, 11397, 220, 21, 488, 16, 28, 22, 382, 3973, 678, 13530, 1447, 54228, 315, 220, 16, 82, 25, 320, 16, 11, 16, 8, 42972, 220, 17, 1817, 13, 2619, 525, 220, 16, 6716, 320, 11284, 1378, 5424, 701, 773, 220, 17, 9, 16, 28, 17, 382, 54228, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 25, 220, 17, 353, 220, 17, 320, 21423, 220, 17, 323, 220, 17, 8, 11397, 220, 17, 9, 17, 28, 19, 13530, 320, 9547, 220, 16, 448, 1817, 220, 17, 568, 8886, 42972, 220, 16, 11397, 220, 19, 382, 54228, 315, 220, 17, 82, 25, 320, 17, 11, 17, 8, 11397, 220, 16, 6716, 13, 42972, 220, 16, 382, 7595, 2629, 25, 220, 17, 10, 19, 10, 16, 28, 22, 13, 15920, 9071, 279, 14806, 382, 44500, 11, 279, 14806, 4278, 382, 4416, 279, 2038, 1265, 387, 30339, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 12564, 279, 2629, 315, 279, 6422, 2750, 315, 279, 7493, 320, 32, 989, 60, 488, 362, 3809, 2467, 608, 320, 32, 989, 60, 353, 362, 3809, 2467, 369, 678, 12460, 13530, 320, 72, 11, 502, 8, 304, 458, 1334, 13, 16246, 279, 16982, 11, 264, 64098, 80049, 5486, 374, 304, 89277, 1238, 11, 773, 582, 1184, 458, 33340, 6291, 3118, 389, 35972, 25709, 382, 14374, 53084, 198, 16, 13, 3070, 8815, 12240, 278, 70971, 95518, 576, 7493, 320, 32, 989, 60, 488, 362, 3809, 2467, 608, 320, 32, 989, 60, 353, 362, 3809, 2467, 646, 387, 43799, 311, 220, 16, 10360, 989, 60, 488, 220, 16, 10360, 3809, 936, 576, 6422, 315, 419, 2629, 646, 1172, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 3118, 389, 279, 2750, 315, 362, 989, 60, 323, 362, 3809, 26126, 17, 13, 3070, 1592, 30843, 804, 334, 510, 256, 481, 576, 6422, 897, 374, 220, 17, 421, 2176, 5424, 525, 220, 16, 624, 256, 481, 576, 6422, 897, 374, 220, 16, 421, 825, 2392, 374, 220, 16, 323, 279, 1008, 374, 7046, 1091, 220, 16, 11, 476, 2176, 5424, 525, 220, 17, 624, 256, 481, 2009, 1008, 13530, 16792, 220, 15, 311, 279, 2629, 624, 18, 13, 3070, 46588, 5385, 74216, 334, 510, 256, 481, 4504, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 220, 17, 82, 320, 66, 17, 8, 304, 279, 1334, 624, 256, 481, 5443, 1493, 14579, 311, 12564, 279, 2629, 1667, 3614, 17272, 530, 54079, 14257, 504, 279, 23722, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 271, 750, 1887, 3932, 262, 1946, 284, 5708, 43184, 4125, 1005, 6960, 741, 262, 10087, 284, 220, 15, 198, 262, 350, 284, 526, 5384, 58, 3505, 2546, 262, 10087, 1421, 220, 16, 198, 262, 369, 716, 304, 2088, 4140, 982, 286, 451, 284, 526, 5384, 58, 3505, 2546, 286, 10087, 1421, 220, 16, 198, 286, 362, 284, 1140, 9147, 1548, 11, 1946, 58, 3505, 25, 3505, 71722, 10907, 286, 10087, 1421, 451, 198, 286, 272, 16, 284, 220, 15, 198, 286, 272, 17, 284, 220, 15, 198, 286, 369, 1629, 304, 362, 510, 310, 421, 1629, 621, 220, 16, 510, 394, 272, 16, 1421, 220, 16, 198, 310, 4409, 1629, 621, 220, 17, 510, 394, 272, 17, 1421, 220, 16, 198, 286, 2629, 10784, 284, 272, 16, 353, 320, 45, 481, 220, 16, 8, 488, 320, 66, 17, 353, 320, 66, 17, 481, 220, 16, 593, 442, 220, 17, 198, 286, 1173, 19713, 10784, 692, 333, 1304, 606, 563, 621, 13265, 3817, 21082, 262, 1887, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 304, 825, 728, 369, 15024, 11, 5310, 2661, 3460, 1946, 12282, 624, 17, 13, 3070, 2507, 287, 34157, 95518, 1752, 1817, 1273, 1142, 11, 1760, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 220, 17, 82, 320, 66, 17, 8, 304, 279, 1334, 624, 18, 13, 3070, 9190, 74216, 334, 510, 256, 481, 3070, 54228, 315, 220, 16, 82, 95518, 576, 4647, 1565, 66, 16, 353, 320, 66, 16, 481, 220, 16, 8, 442, 220, 17, 63, 6696, 279, 1372, 315, 13530, 315, 220, 16, 82, 11, 1817, 28720, 220, 17, 13, 1096, 374, 43799, 311, 1565, 66, 16, 353, 320, 45, 481, 220, 16, 46186, 304, 279, 14806, 624, 256, 481, 3070, 54228, 15860, 825, 220, 16, 323, 825, 2477, 12, 16, 95518, 4220, 13530, 16792, 220, 16, 1817, 11, 323, 279, 1760, 374, 1565, 66, 16, 353, 320, 45, 481, 272, 16, 8, 18639, 256, 481, 3070, 54228, 315, 220, 17, 82, 95518, 576, 4647, 48651, 66, 17, 353, 320, 66, 17, 481, 220, 16, 593, 442, 220, 17, 63, 6696, 279, 1372, 315, 13530, 315, 220, 17, 82, 11, 1817, 28720, 220, 16, 624, 19, 13, 3070, 5097, 95518, 576, 24182, 2629, 374, 16709, 369, 1817, 1273, 1142, 382, 1986, 5486, 29720, 25271, 279, 3491, 311, 25009, 3151, 5424, 323, 18950, 3614, 17272, 530, 54079, 11, 12942, 304, 458, 506, 8204, 8, 6291, 817, 1273, 1142, 11, 892, 374, 22823, 369, 279, 2661, 16982, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] [Labels]: [-100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, -100, 151667, 271, 151668, 271, 27, 91, 7265, 3575, 5854, 2450, 91, 1339, 32313, 11, 1077, 594, 21403, 419, 3491, 13, 2055, 11, 582, 1184, 311, 12564, 279, 2629, 315, 6422, 1188, 64, 488, 293, 24254, 64, 33279, 593, 369, 678, 13530, 320, 64, 11, 293, 8, 304, 279, 1334, 13, 576, 30339, 5486, 1035, 387, 311, 29629, 916, 678, 13530, 11, 11047, 1817, 4647, 11, 323, 2629, 1105, 705, 13, 1988, 3783, 11, 279, 16982, 1977, 429, 451, 646, 387, 705, 311, 220, 17, 68, 20, 13, 8670, 1290, 11, 1576, 369, 451, 28, 17, 68, 20, 11, 279, 1372, 315, 13530, 374, 2163, 220, 17, 68, 16, 15, 11, 892, 374, 1616, 2238, 2409, 13, 2055, 279, 64098, 80049, 5486, 374, 8491, 537, 2087, 311, 975, 1588, 13, 1205, 1184, 264, 46478, 1616, 382, 80022, 11, 1077, 594, 1744, 911, 279, 35972, 7493, 1588, 13, 576, 6422, 315, 320, 64, 488, 293, 24254, 64, 33279, 568, 6771, 594, 39721, 279, 7493, 4766, 279, 6422, 13, 320, 64, 488, 293, 24254, 64, 33279, 8, 284, 220, 16, 14186, 488, 220, 16, 3470, 13, 2055, 279, 6422, 315, 320, 16, 14186, 488, 220, 16, 3470, 568, 2055, 279, 2629, 374, 279, 2629, 916, 678, 13530, 315, 6422, 7, 16, 14186, 488, 220, 16, 3470, 3593, 14190, 11, 714, 1246, 646, 582, 12564, 419, 29720, 30, 6771, 594, 23643, 3204, 2750, 315, 264, 323, 293, 382, 10061, 594, 2908, 3204, 2750, 315, 220, 16, 14186, 488, 220, 16, 3470, 13, 8704, 264, 323, 293, 525, 6785, 25780, 320, 41968, 429, 807, 525, 5424, 315, 279, 1334, 701, 1817, 315, 220, 16, 14186, 323, 220, 16, 3470, 374, 264, 6785, 1931, 1372, 2686, 1091, 476, 6144, 311, 220, 16, 13, 2055, 862, 2629, 374, 1948, 220, 15, 323, 220, 17, 13, 1988, 2474, 264, 323, 293, 525, 518, 3245, 220, 16, 11, 279, 8028, 2629, 374, 220, 17, 320, 9309, 264, 323, 293, 525, 220, 16, 568, 13824, 902, 25, 421, 264, 374, 220, 16, 11, 1221, 220, 16, 14186, 374, 220, 16, 13, 2055, 220, 16, 14186, 488, 16, 3470, 979, 264, 28, 16, 323, 293, 28, 16, 374, 220, 17, 11, 892, 6696, 6422, 220, 17, 13, 1988, 421, 264, 28, 16, 323, 293, 28, 17, 11, 1221, 220, 16, 488, 220, 15, 13, 20, 284, 220, 16, 13, 20, 11, 6422, 374, 220, 16, 13, 88190, 382, 4416, 279, 3204, 2750, 369, 6422, 7, 16, 14186, 488, 220, 16, 3470, 8, 646, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 6771, 594, 1490, 979, 1817, 1142, 8573, 382, 5338, 11, 279, 6422, 374, 220, 15, 25, 979, 220, 16, 14186, 488, 220, 16, 3470, 366, 220, 16, 13, 2055, 979, 279, 2629, 315, 24450, 27687, 1127, 374, 2686, 1091, 220, 16, 13, 3555, 2750, 315, 264, 323, 293, 26553, 419, 30, 6771, 594, 1490, 13, 6771, 594, 55327, 844, 279, 31205, 220, 16, 14186, 488, 220, 16, 3470, 366, 220, 16, 13, 71059, 2176, 11067, 553, 668, 320, 11284, 264, 323, 293, 525, 6785, 11, 419, 374, 5420, 701, 582, 633, 293, 488, 264, 366, 668, 13, 45902, 81, 3726, 438, 668, 481, 264, 481, 293, 861, 220, 15, 13, 30370, 220, 16, 311, 2176, 11067, 25, 668, 481, 64, 481, 65, 488, 16, 861, 16, 11397, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 13, 2055, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 220, 16, 382, 4416, 369, 264, 323, 293, 2604, 17, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 518, 3245, 220, 16, 320, 333, 2987, 264, 28, 17, 323, 293, 28, 17, 11, 1221, 320, 16, 2376, 16, 11730, 16, 11, 892, 16819, 220, 16, 13, 2055, 279, 31205, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 1035, 1373, 429, 2176, 264, 323, 293, 525, 2604, 18, 11, 714, 3783, 11, 1077, 594, 1490, 1447, 14190, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 13, 1752, 3110, 11, 264, 28, 18, 11, 293, 28, 17, 25, 320, 17, 2376, 16, 8, 284, 17, 29, 16, 11397, 220, 16, 14, 18, 488, 16, 14, 17, 284, 20, 14, 21, 366, 16, 13, 13824, 220, 20, 14, 21, 374, 220, 15, 13, 23, 18, 18, 11, 892, 6422, 374, 220, 15, 13, 2055, 304, 419, 1142, 11, 279, 2629, 1035, 16792, 220, 15, 13, 2055, 9834, 11, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 861, 16, 11, 1221, 279, 2629, 374, 220, 15, 382, 2679, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 11, 1221, 279, 2629, 374, 2604, 16, 1939, 14190, 1077, 594, 1490, 13, 6771, 594, 1896, 264, 28, 17, 323, 293, 28, 17, 13, 320, 64, 12, 16, 2376, 65, 12, 16, 11730, 16, 9, 16, 28, 16, 13, 2055, 220, 16, 14186, 488, 16, 3470, 284, 220, 16, 14, 17, 488, 16, 14, 17, 28, 16, 11397, 6422, 374, 220, 16, 382, 2679, 264, 28, 17, 323, 293, 28, 18, 25, 320, 16, 2376, 17, 11730, 17, 29, 16, 11397, 2629, 374, 220, 16, 14, 17, 488, 16, 14, 18, 28, 20, 14, 21, 366, 16, 11397, 6422, 220, 15, 382, 14190, 419, 4977, 51033, 13, 13824, 304, 279, 1156, 3110, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 16819, 220, 16, 13, 2055, 279, 2629, 374, 6896, 220, 16, 13, 2055, 279, 6422, 374, 220, 16, 382, 3983, 421, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 6896, 220, 16, 11, 1221, 279, 2629, 374, 220, 16, 13, 2055, 279, 31205, 220, 16, 14186, 488, 16, 3470, 2604, 16, 374, 13578, 311, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 13, 2055, 979, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 2651, 16, 11, 279, 2629, 374, 2604, 16, 382, 4416, 279, 3204, 2750, 315, 6422, 7, 16, 14186, 488, 16, 3470, 8, 525, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 9211, 279, 7192, 3204, 2629, 374, 220, 16, 10, 16, 28, 17, 11, 892, 13666, 979, 264, 323, 293, 525, 2176, 220, 16, 13, 2055, 279, 6422, 646, 387, 220, 17, 1172, 421, 264, 28, 16, 323, 293, 28, 16, 382, 4416, 1077, 594, 1438, 419, 1495, 13, 1752, 1817, 6716, 320, 64, 11, 293, 701, 279, 3204, 19026, 525, 1447, 12, 220, 17, 11, 421, 264, 28, 16, 323, 293, 28, 16, 382, 12, 220, 16, 11, 421, 320, 64, 28, 16, 323, 293, 28, 16, 8, 902, 13, 13824, 11, 369, 3110, 11, 264, 28, 16, 323, 293, 28, 17, 25, 220, 16, 488, 220, 15, 13, 20, 284, 16, 13, 20, 11397, 6422, 220, 16, 13, 2055, 979, 2987, 264, 476, 293, 374, 220, 16, 11, 714, 537, 2176, 13, 2521, 979, 264, 28, 17, 323, 293, 28, 17, 25, 2629, 220, 16, 11397, 6422, 220, 16, 382, 14190, 11, 279, 2629, 220, 16, 14186, 488, 16, 3470, 646, 387, 2604, 16, 1496, 979, 264, 323, 293, 525, 8131, 13, 8909, 264, 28, 17, 323, 293, 28, 16, 25, 2629, 374, 220, 16, 13, 20, 11397, 6422, 220, 16, 382, 4416, 279, 18527, 374, 220, 16, 304, 279, 2701, 5048, 1447, 49244, 320, 64, 28, 16, 323, 293, 2604, 17, 8, 476, 320, 64, 9922, 17, 323, 293, 28, 16, 8, 11397, 2629, 374, 320, 16, 488, 220, 16, 3470, 8, 1380, 293, 9922, 17, 11, 892, 374, 220, 16, 488, 2494, 2651, 15, 13, 20, 11, 773, 2629, 374, 1948, 220, 16, 323, 220, 16, 13, 20, 11397, 6422, 220, 16, 13, 2521, 979, 2176, 264, 323, 293, 525, 220, 17, 11397, 2629, 220, 16, 13, 2521, 979, 264, 28, 17, 323, 293, 28, 17, 11397, 2629, 220, 16, 13, 2521, 1008, 27459, 1380, 220, 16, 14186, 488, 16, 3470, 2604, 16, 714, 366, 17, 382, 14190, 11, 369, 3110, 11, 264, 28, 17, 323, 293, 28, 18, 13, 2629, 374, 220, 15, 13, 20, 488, 220, 15, 13, 18, 18, 18, 1112, 284, 220, 15, 13, 23, 18, 18, 11, 892, 374, 2686, 1091, 220, 16, 13, 2055, 6422, 220, 15, 13, 2055, 304, 429, 1142, 11, 320, 64, 12, 16, 2376, 65, 12, 16, 8, 374, 220, 16, 9, 17, 28, 17, 29, 16, 13, 2055, 279, 2629, 374, 2686, 1091, 220, 16, 382, 4416, 279, 3204, 19026, 311, 279, 2629, 646, 1172, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 13, 6771, 594, 22049, 551, 678, 3204, 13530, 320, 64, 11, 293, 8, 1119, 1493, 2326, 11059, 382, 4416, 279, 2790, 2629, 374, 220, 17, 353, 356, 16, 34, 16, 320, 1782, 1372, 315, 13530, 1380, 2176, 525, 220, 16, 82, 8, 488, 220, 16, 353, 320, 4082, 315, 13530, 1380, 6896, 825, 374, 220, 16, 11, 5519, 279, 1372, 315, 13530, 1380, 2176, 525, 220, 17, 8, 488, 220, 15, 369, 678, 1008, 13530, 382, 14190, 11, 902, 13, 9211, 979, 264, 28, 16, 323, 293, 28, 17, 11, 279, 2629, 374, 220, 16, 13, 20, 11397, 6422, 374, 220, 16, 13, 34239, 11, 979, 264, 28, 17, 323, 293, 28, 16, 11, 1852, 13, 2055, 678, 13530, 1380, 6896, 825, 374, 220, 16, 16792, 220, 16, 1817, 13, 7281, 11, 13530, 1380, 2176, 525, 220, 17, 25, 2629, 220, 16, 11397, 220, 16, 13, 393, 4720, 1380, 264, 28, 16, 323, 293, 28, 16, 25, 2629, 220, 17, 11397, 220, 17, 13, 3555, 911, 1008, 13530, 1939, 14190, 11, 1077, 594, 1490, 13, 3197, 264, 28, 17, 323, 293, 28, 18, 25, 2629, 374, 220, 15, 13, 20, 488, 220, 15, 13, 18, 18, 18, 1112, 284, 220, 15, 13, 23, 18, 18, 11397, 6422, 220, 15, 13, 2055, 18527, 374, 220, 15, 382, 2679, 264, 28, 18, 323, 293, 28, 18, 25, 2629, 374, 220, 17, 14, 18, 11397, 220, 15, 13, 21, 21, 21, 11, 6422, 220, 15, 382, 2679, 264, 28, 17, 323, 293, 28, 17, 25, 2629, 374, 220, 16, 11397, 6422, 220, 16, 382, 2679, 264, 28, 16, 323, 293, 28, 18, 25, 2629, 220, 16, 488, 220, 16, 14, 18, 11397, 220, 16, 13, 18, 18, 18, 11397, 6422, 220, 16, 382, 4416, 304, 419, 1142, 11, 18527, 374, 220, 16, 382, 14190, 11, 773, 979, 264, 28, 16, 323, 293, 374, 894, 1008, 1372, 320, 8088, 537, 220, 16, 701, 279, 2629, 374, 220, 16, 488, 220, 16, 3470, 11, 892, 374, 1948, 220, 16, 323, 220, 17, 13, 2055, 279, 6422, 374, 220, 16, 13, 2055, 279, 18527, 374, 220, 16, 369, 678, 13530, 1380, 6896, 825, 374, 220, 16, 382, 7039, 11, 1077, 594, 1744, 911, 13530, 1380, 2176, 525, 220, 16, 13, 5005, 2629, 374, 220, 17, 11397, 6422, 220, 17, 13, 2055, 429, 594, 264, 18527, 315, 220, 17, 817, 6716, 382, 2461, 13530, 1380, 2176, 525, 220, 17, 25, 2629, 374, 220, 16, 11397, 18527, 220, 16, 382, 3983, 3783, 11, 1128, 911, 264, 28, 17, 323, 293, 28, 17, 30, 7414, 11, 2629, 374, 220, 16, 11397, 18527, 220, 16, 382, 3838, 911, 13530, 1380, 825, 374, 220, 17, 323, 279, 1008, 374, 220, 18, 30, 5005, 2629, 374, 220, 16, 14, 17, 488, 16, 14, 18, 284, 220, 20, 14, 21, 11397, 6422, 220, 15, 13, 2055, 18527, 220, 15, 382, 4416, 279, 1376, 374, 311, 1760, 1447, 12, 576, 1372, 315, 13530, 315, 220, 16, 82, 320, 66, 16, 5157, 220, 17, 8, 54916, 553, 220, 17, 382, 12, 576, 1372, 315, 13530, 1380, 6896, 825, 374, 220, 16, 25, 272, 16, 6599, 5035, 5424, 481, 272, 16, 8, 11397, 714, 2474, 1817, 6716, 374, 6509, 3055, 320, 72, 75638, 701, 773, 421, 279, 1334, 702, 856, 6174, 323, 379, 2477, 12, 3154, 11, 1221, 279, 1372, 315, 13530, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 374, 856, 6599, 88, 568, 1988, 2474, 13530, 525, 11457, 448, 600, 75638, 11, 714, 304, 279, 3491, 11, 279, 13530, 525, 678, 12460, 13530, 320, 72, 10327, 8, 1380, 600, 75638, 13, 2055, 304, 279, 1334, 11, 369, 1817, 220, 16, 323, 1817, 2477, 12, 16, 429, 4041, 1283, 432, 11, 432, 594, 264, 6716, 13, 2055, 279, 2790, 374, 856, 33247, 11, 1380, 856, 374, 279, 1760, 315, 220, 16, 82, 323, 379, 374, 279, 1760, 315, 2477, 12, 16, 82, 13, 9211, 369, 1817, 220, 16, 323, 1817, 2477, 12, 16, 304, 279, 1334, 11, 421, 279, 220, 16, 374, 1573, 279, 2477, 12, 16, 11, 432, 594, 29994, 3055, 13, 2055, 279, 2790, 1372, 374, 856, 33247, 382, 12209, 11, 369, 13530, 1380, 2176, 525, 220, 17, 82, 25, 279, 1760, 374, 320, 66, 17, 5157, 220, 17, 8, 54916, 553, 220, 16, 382, 49574, 11, 13530, 1380, 825, 374, 220, 17, 323, 279, 1008, 374, 220, 16, 25, 1846, 525, 2669, 29994, 304, 279, 856, 33247, 4647, 11, 773, 807, 16792, 220, 16, 1817, 382, 14190, 11, 714, 979, 264, 28, 16, 323, 293, 28, 17, 11, 279, 18527, 374, 220, 16, 13, 3197, 264, 28, 17, 323, 293, 28, 16, 11, 279, 6716, 320, 72, 10327, 8, 1035, 537, 387, 6509, 1576, 502, 1969, 387, 861, 72, 13, 2055, 304, 279, 1334, 11, 421, 264, 220, 17, 4041, 1573, 264, 220, 16, 11, 279, 6716, 320, 72, 10327, 8, 1035, 387, 320, 17, 11, 16, 8, 11397, 714, 502, 374, 600, 10, 16, 11, 714, 2474, 502, 374, 5080, 11, 279, 1334, 5424, 525, 362, 989, 1125, 362, 3809, 1125, 773, 279, 6716, 374, 320, 32, 989, 1125, 362, 3809, 2467, 284, 320, 17, 11, 16, 701, 714, 2474, 279, 2038, 36398, 320, 32, 989, 60, 488, 362, 3809, 2467, 11884, 32, 989, 60, 353, 362, 3809, 2467, 11397, 320, 17, 10, 16, 24254, 17, 9, 16, 8, 284, 220, 18, 14, 17, 11397, 6422, 220, 16, 13, 2055, 304, 419, 1142, 11, 432, 594, 279, 1852, 438, 320, 16, 11, 17, 8, 304, 3793, 315, 279, 2629, 13, 2055, 279, 18527, 374, 220, 16, 15484, 315, 279, 1973, 382, 14190, 11, 714, 979, 279, 6716, 374, 320, 64, 11, 293, 8, 1380, 264, 374, 220, 17, 323, 293, 374, 220, 16, 11, 279, 2629, 374, 320, 17, 10, 16, 24254, 17, 9, 16, 8, 284, 220, 18, 14, 17, 11397, 6422, 220, 16, 13, 2055, 429, 594, 279, 1852, 438, 421, 264, 572, 220, 16, 323, 293, 572, 220, 17, 382, 4416, 304, 279, 1334, 11, 678, 13530, 1380, 825, 2392, 374, 220, 16, 323, 279, 1008, 374, 537, 320, 1580, 29820, 315, 1973, 8, 16792, 220, 16, 13, 2055, 279, 1760, 315, 1741, 13530, 374, 856, 33247, 1380, 856, 374, 279, 1760, 315, 220, 16, 82, 11, 323, 379, 374, 279, 1760, 315, 2477, 12, 16, 82, 382, 3983, 1083, 11, 279, 13530, 1380, 2176, 525, 220, 17, 82, 16792, 220, 16, 1817, 382, 4416, 279, 2629, 646, 387, 10865, 1495, 1119, 1447, 1242, 284, 220, 17, 353, 356, 16, 77433, 62, 17, 488, 220, 16, 353, 320, 34, 16, 353, 356, 14179, 2985, 8, 488, 220, 16, 353, 356, 17, 77433, 62, 17, 488, 2629, 315, 1008, 13530, 429, 16792, 220, 16, 382, 14190, 11, 714, 525, 1052, 1008, 13530, 429, 16792, 220, 16, 30, 6771, 594, 1490, 13, 1752, 3110, 11, 264, 28, 17, 323, 293, 28, 18, 11397, 2629, 220, 20, 14, 21, 11397, 220, 15, 13, 2055, 902, 13, 3555, 911, 264, 28, 16, 323, 293, 28, 18, 25, 2629, 374, 320, 16, 10, 18, 24254, 16, 9, 18, 8, 284, 19, 14, 18, 11397, 6422, 220, 16, 13, 2055, 429, 594, 949, 315, 279, 356, 16, 353, 356, 14179, 2985, 4647, 13, 2055, 9834, 382, 3983, 1128, 911, 13530, 1380, 2176, 525, 220, 18, 30, 5005, 2629, 374, 220, 17, 14, 18, 11397, 6422, 220, 15, 382, 4416, 279, 1172, 1008, 13530, 429, 16792, 220, 16, 525, 279, 13530, 1380, 2176, 5424, 525, 220, 17, 382, 4416, 279, 2790, 2629, 374, 1447, 1242, 284, 220, 17, 353, 320, 66, 16, 353, 320, 66, 16, 481, 16, 5620, 17, 8, 488, 220, 16, 353, 320, 66, 16, 353, 320, 77, 481, 272, 16, 593, 488, 220, 16, 353, 320, 66, 17, 353, 320, 66, 17, 481, 16, 5620, 17, 8, 4710, 17949, 1447, 12, 576, 1156, 4647, 374, 279, 13530, 315, 220, 16, 82, 25, 1052, 525, 356, 1337, 16, 11, 220, 17, 8, 13530, 11, 1817, 28720, 220, 17, 382, 12, 576, 2086, 4647, 374, 279, 13530, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 25, 1052, 525, 272, 16, 353, 320, 77, 481, 272, 16, 8, 1741, 13530, 11, 1817, 28720, 220, 16, 382, 12, 576, 4843, 4647, 374, 279, 13530, 1380, 2176, 525, 220, 17, 25, 356, 1337, 17, 11, 220, 17, 8, 13530, 11, 1817, 28720, 220, 16, 382, 2403, 1008, 13530, 16792, 220, 15, 13, 2055, 279, 2629, 374, 279, 2629, 315, 1493, 2326, 3793, 382, 3872, 419, 4396, 30, 6771, 594, 1273, 419, 2348, 279, 6077, 11127, 382, 5338, 6077, 1946, 1447, 2271, 1142, 220, 16, 1447, 18, 271, 19, 220, 17, 220, 18, 271, 66, 16, 374, 279, 1760, 315, 220, 16, 82, 25, 220, 15, 13, 272, 17, 374, 1760, 315, 220, 17, 82, 25, 220, 16, 382, 4416, 2629, 1035, 387, 220, 15, 320, 1499, 1156, 4647, 8, 488, 220, 15, 320, 11284, 272, 16, 374, 220, 15, 8, 488, 320, 16, 6599, 15, 5620, 17, 8, 11397, 220, 15, 13, 2055, 2629, 374, 220, 15, 13, 15920, 9071, 279, 6077, 2550, 382, 15666, 1273, 1142, 1447, 18, 271, 16, 220, 19, 220, 16, 271, 66, 16, 374, 220, 17, 13, 272, 17, 374, 220, 15, 13, 3800, 374, 220, 16, 320, 1782, 220, 19, 3593, 4416, 1447, 17, 353, 320, 17, 9, 16, 14, 17, 8, 284, 220, 17, 353, 16, 284, 17, 4710, 10, 220, 16, 353, 320, 17, 353, 16, 8, 284, 220, 17, 4710, 10, 220, 15, 11397, 2790, 2629, 220, 19, 13, 15920, 9071, 279, 6077, 2550, 382, 4416, 419, 4977, 311, 975, 382, 14037, 1273, 1142, 25, 1077, 594, 1896, 264, 28, 508, 17, 11, 17, 936, 5005, 272, 16, 28, 15, 11, 272, 17, 28, 17, 13, 576, 2629, 1265, 387, 356, 7, 17, 11, 17, 4806, 16, 28, 16, 13, 2055, 320, 17, 9, 16, 14, 17, 4806, 16, 28, 16, 13, 2055, 2629, 374, 220, 16, 13, 6771, 594, 12564, 320, 17, 10, 17, 24254, 17, 9, 17, 8, 284, 19, 14, 19, 28, 16, 11397, 6422, 220, 16, 13, 2055, 9834, 382, 14037, 1273, 1142, 25, 508, 16, 11, 16, 11, 17, 936, 272, 16, 28, 17, 11, 3800, 28, 16, 320, 1782, 220, 17, 568, 272, 17, 28, 16, 382, 1242, 1035, 387, 220, 17, 353, 320, 17, 9, 16, 14, 17, 8, 11397, 220, 17, 353, 16, 28, 17, 4710, 10, 220, 17, 9, 16, 11397, 220, 17, 4710, 10, 220, 15, 320, 11284, 272, 17, 374, 220, 16, 11, 356, 7, 16, 11, 17, 8, 374, 220, 15, 692, 7595, 2629, 220, 19, 382, 10061, 594, 12564, 678, 13530, 1447, 7, 16, 11, 16, 1648, 2629, 374, 320, 17, 24254, 16, 9, 16, 8, 11397, 6422, 220, 17, 382, 7, 16, 11, 17, 1648, 2629, 320, 18, 14, 17, 11397, 16, 692, 7, 16, 11, 17, 1648, 2629, 320, 18, 14, 17, 11397, 16, 692, 4416, 2790, 2629, 220, 17, 10, 16, 10, 16, 28, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 508, 16, 11, 17, 11, 17, 936, 272, 16, 28, 16, 11, 3800, 28, 17, 320, 1782, 1378, 220, 17, 82, 568, 272, 17, 28, 17, 382, 1242, 1447, 17, 9, 15, 320, 11284, 272, 16, 374, 220, 16, 11, 773, 356, 7, 16, 11, 17, 8, 374, 220, 15, 8, 4710, 10, 220, 16, 9, 17, 11397, 220, 17, 4710, 10, 356, 7, 17, 11, 17, 4806, 16, 11397, 16, 4710, 7595, 220, 17, 10, 16, 28, 18, 382, 785, 13530, 525, 1447, 7, 16, 11, 17, 1648, 320, 16, 10, 17, 24254, 17, 8, 284, 16, 13, 20, 11397, 6422, 220, 16, 271, 7, 16, 11, 17, 1648, 1852, 438, 3403, 11397, 16, 271, 7, 17, 11, 17, 1648, 2629, 220, 16, 11397, 16, 271, 4416, 2790, 220, 16, 10, 16, 10, 16, 28, 18, 13, 39970, 382, 4416, 1039, 14806, 4278, 369, 1493, 5048, 382, 44500, 11, 279, 5486, 374, 311, 12564, 1447, 1242, 284, 220, 17, 353, 320, 66, 16, 353, 320, 66, 16, 12, 16, 8, 442, 220, 17, 8, 488, 320, 66, 16, 353, 320, 77, 481, 272, 16, 593, 488, 320, 66, 17, 353, 320, 66, 17, 481, 16, 8, 442, 220, 17, 692, 17949, 1447, 12, 576, 13530, 315, 220, 16, 82, 16792, 220, 17, 1817, 13, 5624, 315, 1741, 13530, 374, 356, 1337, 16, 11, 17, 8, 11397, 272, 16, 6599, 66, 16, 12, 16, 5620, 17, 11397, 30270, 553, 220, 17, 6696, 272, 16, 6599, 66, 16, 12, 16, 3593, 14190, 3783, 11, 3783, 13, 6771, 594, 1490, 25, 220, 17, 353, 320, 66, 16, 5157, 220, 17, 8, 374, 220, 17, 353, 320, 66, 16, 6599, 66, 16, 12, 16, 5620, 17, 8, 284, 272, 16, 6599, 66, 16, 12, 16, 568, 1988, 304, 279, 14806, 3403, 11, 279, 1156, 4647, 374, 220, 17, 353, 320, 66, 16, 5157, 220, 17, 8, 11397, 892, 374, 220, 17, 6599, 66, 16, 6599, 66, 16, 12, 16, 5620, 17, 8, 284, 272, 16, 6599, 66, 16, 12, 16, 568, 5005, 279, 2086, 4647, 374, 272, 16, 6599, 77, 481, 272, 16, 568, 20861, 4647, 374, 320, 66, 17, 5157, 220, 17, 8, 11397, 320, 66, 17, 6599, 66, 17, 12, 16, 5620, 17, 3593, 4416, 2629, 284, 272, 16, 6599, 66, 16, 12, 16, 8, 488, 272, 16, 6599, 77, 481, 66, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 271, 3983, 3783, 11, 1077, 594, 312, 10187, 1873, 279, 14806, 1447, 1242, 284, 320, 66, 16, 353, 320, 66, 16, 12, 16, 593, 873, 488, 320, 66, 16, 6599, 77, 481, 66, 16, 593, 488, 320, 320, 66, 17, 353, 320, 66, 17, 12, 16, 593, 442, 220, 17, 5125, 23085, 646, 387, 43799, 311, 1447, 1242, 284, 272, 16, 6599, 77, 481, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 442, 220, 17, 4710, 17949, 1447, 66, 16, 6599, 66, 16, 12, 16, 8, 488, 272, 16, 6599, 77, 481, 66, 16, 8, 284, 272, 16, 508, 320, 66, 16, 12, 16, 8, 488, 320, 77, 481, 272, 16, 8, 2279, 284, 272, 16, 320, 77, 12, 16, 692, 4416, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 5157, 220, 17, 692, 4416, 429, 594, 458, 1496, 34288, 14806, 382, 10061, 594, 1273, 419, 448, 279, 1156, 6077, 1447, 17571, 220, 16, 25, 272, 16, 28, 15, 11, 272, 17, 28, 16, 382, 1242, 284, 220, 15, 6599, 18, 12, 16, 8, 488, 320, 16, 9, 15, 5620, 17, 11397, 220, 15, 488, 15, 28, 15, 13, 39970, 382, 17571, 220, 17, 25, 272, 16, 28, 17, 11, 308, 28, 18, 382, 1242, 28, 220, 17, 6599, 18, 12, 16, 8, 488, 320, 15, 8, 11397, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 508, 16, 11, 17, 11, 17, 1125, 272, 16, 28, 16, 11, 272, 17, 28, 17, 11, 308, 28, 18, 382, 1242, 28, 16, 6599, 18, 12, 16, 8, 488, 320, 17, 9, 16, 5620, 17, 11397, 220, 17, 488, 16, 28, 18, 13, 39970, 382, 4416, 279, 14806, 374, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 4416, 279, 3491, 25271, 311, 25009, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 701, 279, 1372, 315, 220, 17, 82, 320, 66, 17, 701, 323, 18950, 419, 14806, 382, 1986, 374, 264, 6765, 25262, 13, 9211, 369, 1817, 1273, 1142, 11, 582, 646, 12564, 279, 4226, 304, 506, 1445, 8, 882, 11, 892, 374, 21555, 2661, 279, 16982, 382, 4416, 279, 7354, 525, 1447, 16, 13, 1752, 1817, 1273, 1142, 1447, 256, 264, 13, 4457, 451, 323, 279, 1334, 382, 256, 293, 13, 4504, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 279, 1372, 315, 220, 17, 82, 320, 66, 17, 3593, 256, 272, 13, 22603, 279, 2629, 438, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 17, 13, 9258, 419, 2629, 382, 4416, 419, 5486, 374, 506, 4140, 353, 308, 701, 892, 374, 21555, 369, 350, 28, 16, 20, 323, 2629, 315, 308, 705, 311, 220, 17, 68, 20, 382, 4416, 1431, 11, 279, 2038, 646, 387, 5326, 438, 11017, 1447, 4418, 350, 382, 2461, 1817, 350, 1273, 5048, 1447, 256, 4457, 451, 382, 256, 4457, 279, 1334, 315, 451, 25780, 382, 256, 4504, 272, 16, 323, 272, 17, 382, 256, 22603, 2629, 284, 272, 16, 6599, 77, 12, 16, 8, 488, 320, 66, 17, 6599, 66, 17, 12, 16, 593, 322, 17, 382, 256, 8213, 2629, 382, 10061, 594, 1273, 419, 2348, 279, 6077, 1946, 382, 17571, 5571, 220, 16, 1447, 17, 271, 18, 271, 19, 220, 17, 220, 18, 11397, 272, 16, 28, 15, 11, 272, 17, 28, 16, 13, 2629, 28, 15, 6599, 18, 12, 16, 8, 488, 320, 16, 9, 15, 5620, 17, 11397, 15, 13, 39970, 382, 15666, 1273, 1142, 1447, 18, 271, 16, 220, 19, 220, 16, 11397, 272, 16, 28, 17, 11, 2629, 28, 17, 6599, 18, 12, 16, 8, 11397, 19, 13, 272, 17, 28, 15, 13, 2055, 220, 19, 10, 15, 28, 19, 13, 39970, 382, 14037, 1273, 1142, 25, 1334, 508, 16, 11, 16, 11, 17, 11, 17, 936, 308, 28, 19, 382, 66, 16, 28, 17, 11, 272, 17, 28, 17, 382, 1242, 28, 17, 6599, 19, 12, 16, 8, 488, 320, 17, 9, 16, 5620, 17, 11397, 220, 21, 488, 16, 28, 22, 382, 3973, 678, 13530, 1447, 54228, 315, 220, 16, 82, 25, 320, 16, 11, 16, 8, 42972, 220, 17, 1817, 13, 2619, 525, 220, 16, 6716, 320, 11284, 1378, 5424, 701, 773, 220, 17, 9, 16, 28, 17, 382, 54228, 1380, 825, 374, 220, 16, 323, 279, 1008, 374, 537, 25, 220, 17, 353, 220, 17, 320, 21423, 220, 17, 323, 220, 17, 8, 11397, 220, 17, 9, 17, 28, 19, 13530, 320, 9547, 220, 16, 448, 1817, 220, 17, 568, 8886, 42972, 220, 16, 11397, 220, 19, 382, 54228, 315, 220, 17, 82, 25, 320, 17, 11, 17, 8, 11397, 220, 16, 6716, 13, 42972, 220, 16, 382, 7595, 2629, 25, 220, 17, 10, 19, 10, 16, 28, 22, 13, 15920, 9071, 279, 14806, 382, 44500, 11, 279, 14806, 4278, 382, 4416, 279, 2038, 1265, 387, 30339, 382, 27, 91, 408, 3575, 5854, 2450, 91, 1339, 27, 91, 7265, 3575, 50274, 91, 1339, 1249, 11625, 419, 3491, 11, 582, 1184, 311, 12564, 279, 2629, 315, 279, 6422, 2750, 315, 279, 7493, 320, 32, 989, 60, 488, 362, 3809, 2467, 608, 320, 32, 989, 60, 353, 362, 3809, 2467, 369, 678, 12460, 13530, 320, 72, 11, 502, 8, 304, 458, 1334, 13, 16246, 279, 16982, 11, 264, 64098, 80049, 5486, 374, 304, 89277, 1238, 11, 773, 582, 1184, 458, 33340, 6291, 3118, 389, 35972, 25709, 382, 14374, 53084, 198, 16, 13, 3070, 8815, 12240, 278, 70971, 95518, 576, 7493, 320, 32, 989, 60, 488, 362, 3809, 2467, 608, 320, 32, 989, 60, 353, 362, 3809, 2467, 646, 387, 43799, 311, 220, 16, 10360, 989, 60, 488, 220, 16, 10360, 3809, 936, 576, 6422, 315, 419, 2629, 646, 1172, 387, 220, 15, 11, 220, 16, 11, 476, 220, 17, 3118, 389, 279, 2750, 315, 362, 989, 60, 323, 362, 3809, 26126, 17, 13, 3070, 1592, 30843, 804, 334, 510, 256, 481, 576, 6422, 897, 374, 220, 17, 421, 2176, 5424, 525, 220, 16, 624, 256, 481, 576, 6422, 897, 374, 220, 16, 421, 825, 2392, 374, 220, 16, 323, 279, 1008, 374, 7046, 1091, 220, 16, 11, 476, 2176, 5424, 525, 220, 17, 624, 256, 481, 2009, 1008, 13530, 16792, 220, 15, 311, 279, 2629, 624, 18, 13, 3070, 46588, 5385, 74216, 334, 510, 256, 481, 4504, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 220, 17, 82, 320, 66, 17, 8, 304, 279, 1334, 624, 256, 481, 5443, 1493, 14579, 311, 12564, 279, 2629, 1667, 3614, 17272, 530, 54079, 14257, 504, 279, 23722, 382, 14374, 12478, 6119, 198, 73594, 12669, 198, 474, 5708, 271, 750, 1887, 3932, 262, 1946, 284, 5708, 43184, 4125, 1005, 6960, 741, 262, 10087, 284, 220, 15, 198, 262, 350, 284, 526, 5384, 58, 3505, 2546, 262, 10087, 1421, 220, 16, 198, 262, 369, 716, 304, 2088, 4140, 982, 286, 451, 284, 526, 5384, 58, 3505, 2546, 286, 10087, 1421, 220, 16, 198, 286, 362, 284, 1140, 9147, 1548, 11, 1946, 58, 3505, 25, 3505, 71722, 10907, 286, 10087, 1421, 451, 198, 286, 272, 16, 284, 220, 15, 198, 286, 272, 17, 284, 220, 15, 198, 286, 369, 1629, 304, 362, 510, 310, 421, 1629, 621, 220, 16, 510, 394, 272, 16, 1421, 220, 16, 198, 310, 4409, 1629, 621, 220, 17, 510, 394, 272, 17, 1421, 220, 16, 198, 286, 2629, 10784, 284, 272, 16, 353, 320, 45, 481, 220, 16, 8, 488, 320, 66, 17, 353, 320, 66, 17, 481, 220, 16, 593, 442, 220, 17, 198, 286, 1173, 19713, 10784, 692, 333, 1304, 606, 563, 621, 13265, 3817, 21082, 262, 1887, 741, 13874, 19324, 14374, 71287, 198, 16, 13, 3070, 31899, 5571, 95518, 576, 1946, 374, 1349, 304, 825, 728, 369, 15024, 11, 5310, 2661, 3460, 1946, 12282, 624, 17, 13, 3070, 2507, 287, 34157, 95518, 1752, 1817, 1273, 1142, 11, 1760, 279, 1372, 315, 220, 16, 82, 320, 66, 16, 8, 323, 220, 17, 82, 320, 66, 17, 8, 304, 279, 1334, 624, 18, 13, 3070, 9190, 74216, 334, 510, 256, 481, 3070, 54228, 315, 220, 16, 82, 95518, 576, 4647, 1565, 66, 16, 353, 320, 66, 16, 481, 220, 16, 8, 442, 220, 17, 63, 6696, 279, 1372, 315, 13530, 315, 220, 16, 82, 11, 1817, 28720, 220, 17, 13, 1096, 374, 43799, 311, 1565, 66, 16, 353, 320, 45, 481, 220, 16, 46186, 304, 279, 14806, 624, 256, 481, 3070, 54228, 15860, 825, 220, 16, 323, 825, 2477, 12, 16, 95518, 4220, 13530, 16792, 220, 16, 1817, 11, 323, 279, 1760, 374, 1565, 66, 16, 353, 320, 45, 481, 272, 16, 8, 18639, 256, 481, 3070, 54228, 315, 220, 17, 82, 95518, 576, 4647, 48651, 66, 17, 353, 320, 66, 17, 481, 220, 16, 593, 442, 220, 17, 63, 6696, 279, 1372, 315, 13530, 315, 220, 17, 82, 11, 1817, 28720, 220, 16, 624, 19, 13, 3070, 5097, 95518, 576, 24182, 2629, 374, 16709, 369, 1817, 1273, 1142, 382, 1986, 5486, 29720, 25271, 279, 3491, 311, 25009, 3151, 5424, 323, 18950, 3614, 17272, 530, 54079, 11, 12942, 304, 458, 506, 8204, 8, 6291, 817, 1273, 1142, 11, 892, 374, 22823, 369, 279, 2661, 16982, 382, 27, 91, 408, 3575, 50274, 91, 29, 151645, 198] ================================================================================ >>> End of first sample inspection <<< ================================================================================ [2025-08-04 08:36:36,248] [WARNING] [stage3.py:2114:step] 2 pytorch allocator cache flushes since last step. this happens when there is high memory pressure and is detrimental to performance. if this is happening frequently consider adjusting settings to reduce memory consumption. If you are unable to make the cache flushes go away consider adding get_accelerator().empty_cache() calls in your training loop to ensure that all ranks flush their caches at the same time 0%| | 1/522 [03:30<30:32:04, 210.99s/it] {'loss': 0.5071, 'grad_norm': 3.433964967727661, 'learning_rate': 0.0, 'epoch': 0.01} 0%| | 1/522 [03:30<30:32:04, 210.99s/it] 0%| | 2/522 [07:08<30:59:37, 214.57s/it] {'loss': 0.5195, 'grad_norm': 3.392178535461426, 'learning_rate': 1.7458343004804496e-06, 'epoch': 0.01} 0%| | 2/522 [07:08<30:59:37, 214.57s/it] 1%| | 3/522 [10:45<31:08:04, 215.96s/it] {'loss': 0.5393, 'grad_norm': 3.3394339084625244, 'learning_rate': 2.767081898734264e-06, 'epoch': 0.02} 1%| | 3/522 [10:45<31:08:04, 215.96s/it] 1%| | 4/522 [13:59<29:47:59, 207.10s/it] {'loss': 0.5174, 'grad_norm': 3.3668129444122314, 'learning_rate': 3.491668600960899e-06, 'epoch': 0.02} 1%| | 4/522 [13:59<29:47:59, 207.10s/it] 1%| | 5/522 [17:37<30:18:50, 211.09s/it] {'loss': 0.4807, 'grad_norm': 1.8558063507080078, 'learning_rate': 4.053701711303581e-06, 'epoch': 0.03} 1%| | 5/522 [17:37<30:18:50, 211.09s/it] 1%| | 6/522 [20:23<28:03:27, 195.75s/it] {'loss': 0.4554, 'grad_norm': 1.5396288633346558, 'learning_rate': 4.512916199214713e-06, 'epoch': 0.03} 1%| | 6/522 [20:23<28:03:27, 195.75s/it] 1%|▏ | 7/522 [23:46<28:22:12, 198.32s/it] {'loss': 0.4631, 'grad_norm': 1.3996226787567139, 'learning_rate': 4.901176516550784e-06, 'epoch': 0.04} 1%|▏ | 7/522 [23:46<28:22:12, 198.32s/it] 2%|▏ | 8/522 [27:46<30:11:27, 211.46s/it] {'loss': 0.444, 'grad_norm': 1.1942473649978638, 'learning_rate': 5.237502901441348e-06, 'epoch': 0.05} 2%|▏ | 8/522 [27:46<30:11:27, 211.46s/it] 2%|▏ | 9/522 [30:43<28:34:59, 200.58s/it] {'loss': 0.4098, 'grad_norm': 0.8220059871673584, 'learning_rate': 5.534163797468528e-06, 'epoch': 0.05} 2%|▏ | 9/522 [30:43<28:34:59, 200.58s/it] 2%|▏ | 10/522 [34:13<28:57:43, 203.64s/it] {'loss': 0.4454, 'grad_norm': 0.7608104348182678, 'learning_rate': 5.799536011784032e-06, 'epoch': 0.06} 2%|▏ | 10/522 [34:13<28:57:43, 203.64s/it] 2%|▏ | 11/522 [38:04<30:06:10, 212.08s/it] {'loss': 0.4429, 'grad_norm': 0.6178146004676819, 'learning_rate': 6.039594379983596e-06, 'epoch': 0.06} 2%|▏ | 11/522 [38:04<30:06:10, 212.08s/it] 2%|▏ | 12/522 [41:51<30:40:40, 216.55s/it] {'loss': 0.3989, 'grad_norm': 0.8610997200012207, 'learning_rate': 6.258750499695163e-06, 'epoch': 0.07} 2%|▏ | 12/522 [41:51<30:40:40, 216.55s/it] 2%|▏ | 13/522 [46:16<32:41:20, 231.20s/it] {'loss': 0.4501, 'grad_norm': 1.0241808891296387, 'learning_rate': 6.460354586790926e-06, 'epoch': 0.07} 2%|▏ | 13/522 [46:16<32:41:20, 231.20s/it] 3%|▎ | 14/522 [50:16<32:59:08, 233.76s/it] {'loss': 0.4288, 'grad_norm': 0.7851793169975281, 'learning_rate': 6.647010817031233e-06, 'epoch': 0.08} 3%|▎ | 14/522 [50:16<32:59:08, 233.76s/it] 3%|▎ | 15/522 [54:49<34:36:21, 245.72s/it] {'loss': 0.4454, 'grad_norm': 0.5859682559967041, 'learning_rate': 6.820783610037844e-06, 'epoch': 0.09} 3%|▎ | 15/522 [54:49<34:36:21, 245.72s/it] 3%|▎ | 16/522 [58:49<34:18:23, 244.08s/it] {'loss': 0.4464, 'grad_norm': 0.5019766092300415, 'learning_rate': 6.983337201921798e-06, 'epoch': 0.09} 3%|▎ | 16/522 [58:49<34:18:23, 244.08s/it] 3%|▎ | 17/522 [1:02:25<33:00:51, 235.35s/it] {'loss': 0.43, 'grad_norm': 0.4275086224079132, 'learning_rate': 7.136032830194117e-06, 'epoch': 0.1} 3%|▎ | 17/522 [1:02:25<33:00:51, 235.35s/it] 3%|▎ | 18/522 [1:06:32<33:27:19, 238.97s/it] {'loss': 0.4354, 'grad_norm': 0.5509775280952454, 'learning_rate': 7.279998097948977e-06, 'epoch': 0.1} 3%|▎ | 18/522 [1:06:32<33:27:19, 238.97s/it] 4%|▎ | 19/522 [1:09:58<32:00:26, 229.08s/it] {'loss': 0.4078, 'grad_norm': 0.5235769748687744, 'learning_rate': 7.416177558924437e-06, 'epoch': 0.11} 4%|▎ | 19/522 [1:09:58<32:00:26, 229.08s/it] 4%|▍ | 20/522 [1:13:44<31:49:06, 228.18s/it] {'loss': 0.42, 'grad_norm': 0.524017333984375, 'learning_rate': 7.54537031226448e-06, 'epoch': 0.11} 4%|▍ | 20/522 [1:13:44<31:49:06, 228.18s/it] 4%|▍ | 21/522 [1:17:42<32:09:59, 231.14s/it] {'loss': 0.4095, 'grad_norm': 0.4501846730709076, 'learning_rate': 7.668258415285047e-06, 'epoch': 0.12} 4%|▍ | 21/522 [1:17:42<32:09:59, 231.14s/it] 4%|▍ | 22/522 [1:21:49<32:45:47, 235.89s/it] {'loss': 0.4222, 'grad_norm': 0.4211798906326294, 'learning_rate': 7.785428680464045e-06, 'epoch': 0.13} 4%|▍ | 22/522 [1:21:49<32:45:47, 235.89s/it] 4%|▍ | 23/522 [1:24:54<30:34:43, 220.61s/it] {'loss': 0.3874, 'grad_norm': 0.36724793910980225, 'learning_rate': 7.89738962323277e-06, 'epoch': 0.13} 4%|▍ | 23/522 [1:24:54<30:34:43, 220.61s/it] 5%|▍ | 24/522 [1:28:40<30:43:26, 222.10s/it] {'loss': 0.4234, 'grad_norm': 0.3620392978191376, 'learning_rate': 8.004584800175612e-06, 'epoch': 0.14} 5%|▍ | 24/522 [1:28:40<30:43:26, 222.10s/it] 5%|▍ | 25/522 [1:32:26<30:49:49, 223.32s/it] {'loss': 0.4178, 'grad_norm': 0.3433455228805542, 'learning_rate': 8.107403422607161e-06, 'epoch': 0.14} 5%|▍ | 25/522 [1:32:26<30:49:49, 223.32s/it] 5%|▍ | 26/522 [1:35:45<29:46:29, 216.11s/it] {'loss': 0.4125, 'grad_norm': 0.3227772116661072, 'learning_rate': 8.206188887271376e-06, 'epoch': 0.15} 5%|▍ | 26/522 [1:35:45<29:46:29, 216.11s/it] 5%|▌ | 27/522 [1:39:38<30:24:50, 221.19s/it] {'loss': 0.4484, 'grad_norm': 0.3061554729938507, 'learning_rate': 8.30124569620279e-06, 'epoch': 0.16} 5%|▌ | 27/522 [1:39:38<30:24:50, 221.19s/it] 5%|▌ | 28/522 [1:43:14<30:08:40, 219.68s/it] {'loss': 0.4138, 'grad_norm': 0.31545695662498474, 'learning_rate': 8.392845117511683e-06, 'epoch': 0.16} 5%|▌ | 28/522 [1:43:14<30:08:40, 219.68s/it] 6%|▌ | 29/522 [1:47:04<30:28:52, 222.58s/it] {'loss': 0.4102, 'grad_norm': 0.27715373039245605, 'learning_rate': 8.481229852375864e-06, 'epoch': 0.17} 6%|▌ | 29/522 [1:47:04<30:28:52, 222.58s/it] 6%|▌ | 30/522 [1:51:08<31:19:58, 229.27s/it] {'loss': 0.418, 'grad_norm': 0.3076964318752289, 'learning_rate': 8.566617910518294e-06, 'epoch': 0.17} 6%|▌ | 30/522 [1:51:08<31:19:58, 229.27s/it] 6%|▌ | 31/522 [1:55:05<31:33:58, 231.44s/it] {'loss': 0.4026, 'grad_norm': 0.2613288164138794, 'learning_rate': 8.649205849987094e-06, 'epoch': 0.18} 6%|▌ | 31/522 [1:55:05<31:33:58, 231.44s/it] 6%|▌ | 32/522 [1:58:07<29:30:12, 216.76s/it] {'loss': 0.373, 'grad_norm': 0.24709492921829224, 'learning_rate': 8.729171502402248e-06, 'epoch': 0.18} 6%|▌ | 32/522 [1:58:07<29:30:12, 216.76s/it] 6%|▋ | 33/522 [2:01:42<29:20:24, 216.00s/it] {'loss': 0.403, 'grad_norm': 0.23974493145942688, 'learning_rate': 8.80667627871786e-06, 'epoch': 0.19} 6%|▋ | 33/522 [2:01:42<29:20:24, 216.00s/it] 7%|▋ | 34/522 [2:05:08<28:53:41, 213.16s/it] {'loss': 0.4234, 'grad_norm': 0.30506637692451477, 'learning_rate': 8.881867130674568e-06, 'epoch': 0.2} 7%|▋ | 34/522 [2:05:08<28:53:41, 213.16s/it] 7%|▋ | 35/522 [2:08:58<29:30:06, 218.08s/it] {'loss': 0.4187, 'grad_norm': 0.2746846079826355, 'learning_rate': 8.954878227854364e-06, 'epoch': 0.2} 7%|▋ | 35/522 [2:08:58<29:30:06, 218.08s/it] 7%|▋ | 36/522 [2:12:49<29:57:45, 221.94s/it] {'loss': 0.416, 'grad_norm': 0.2754661440849304, 'learning_rate': 9.025832398429426e-06, 'epoch': 0.21} 7%|▋ | 36/522 [2:12:49<29:57:45, 221.94s/it] 7%|▋ | 37/522 [2:16:29<29:49:59, 221.44s/it] {'loss': 0.4039, 'grad_norm': 0.23252147436141968, 'learning_rate': 9.09484237246834e-06, 'epoch': 0.21} 7%|▋ | 37/522 [2:16:29<29:49:59, 221.44s/it] 7%|▋ | 38/522 [2:20:13<29:53:13, 222.30s/it] {'loss': 0.4263, 'grad_norm': 0.23882262408733368, 'learning_rate': 9.162011859404886e-06, 'epoch': 0.22} 7%|▋ | 38/522 [2:20:13<29:53:13, 222.30s/it] 7%|▋ | 39/522 [2:24:34<31:23:15, 233.95s/it] {'loss': 0.4126, 'grad_norm': 0.22073571383953094, 'learning_rate': 9.227436485525188e-06, 'epoch': 0.22} 7%|▋ | 39/522 [2:24:34<31:23:15, 233.95s/it] 8%|▊ | 40/522 [2:28:07<30:27:07, 227.44s/it] {'loss': 0.4048, 'grad_norm': 0.23363696038722992, 'learning_rate': 9.29120461274493e-06, 'epoch': 0.23} 8%|▊ | 40/522 [2:28:07<30:27:07, 227.44s/it] 8%|▊ | 41/522 [2:31:43<29:57:00, 224.16s/it] {'loss': 0.4411, 'grad_norm': 0.24060510098934174, 'learning_rate': 9.353398056270042e-06, 'epoch': 0.24} 8%|▊ | 41/522 [2:31:43<29:57:00, 224.16s/it] 8%|▊ | 42/522 [2:35:25<29:47:31, 223.44s/it] {'loss': 0.3827, 'grad_norm': 0.23425370454788208, 'learning_rate': 9.414092715765499e-06, 'epoch': 0.24} 8%|▊ | 42/522 [2:35:25<29:47:31, 223.44s/it] 8%|▊ | 43/522 [2:39:17<30:03:39, 225.93s/it] {'loss': 0.4277, 'grad_norm': 0.2304806262254715, 'learning_rate': 9.473359132247055e-06, 'epoch': 0.25} 8%|▊ | 43/522 [2:39:17<30:03:39, 225.93s/it] 8%|▊ | 44/522 [2:43:23<30:49:02, 232.10s/it] {'loss': 0.4323, 'grad_norm': 0.2170795351266861, 'learning_rate': 9.531262980944493e-06, 'epoch': 0.25} 8%|▊ | 44/522 [2:43:23<30:49:02, 232.10s/it] 9%|▊ | 45/522 [2:47:10<30:32:12, 230.47s/it] {'loss': 0.4218, 'grad_norm': 0.20606695115566254, 'learning_rate': 9.587865508772108e-06, 'epoch': 0.26} 9%|▊ | 45/522 [2:47:10<30:32:12, 230.47s/it] 9%|▉ | 46/522 [2:50:52<30:07:56, 227.89s/it] {'loss': 0.3845, 'grad_norm': 0.23786990344524384, 'learning_rate': 9.643223923713218e-06, 'epoch': 0.26} 9%|▉ | 46/522 [2:50:52<30:07:56, 227.89s/it] 9%|▉ | 47/522 [2:54:46<30:18:42, 229.73s/it] {'loss': 0.4181, 'grad_norm': 0.21756140887737274, 'learning_rate': 9.697391742325131e-06, 'epoch': 0.27} 9%|▉ | 47/522 [2:54:46<30:18:42, 229.73s/it] 9%|▉ | 48/522 [2:58:24<29:47:54, 226.32s/it] {'loss': 0.3939, 'grad_norm': 0.2240249216556549, 'learning_rate': 9.750419100656062e-06, 'epoch': 0.28} 9%|▉ | 48/522 [2:58:24<29:47:54, 226.32s/it] 9%|▉ | 49/522 [3:02:40<30:54:32, 235.25s/it] {'loss': 0.433, 'grad_norm': 0.21226239204406738, 'learning_rate': 9.802353033101567e-06, 'epoch': 0.28} 9%|▉ | 49/522 [3:02:40<30:54:32, 235.25s/it] 10%|▉ | 50/522 [3:06:16<30:05:32, 229.52s/it] {'loss': 0.3934, 'grad_norm': 0.22554899752140045, 'learning_rate': 9.853237723087613e-06, 'epoch': 0.29} 10%|▉ | 50/522 [3:06:16<30:05:32, 229.52s/it] 10%|▉ | 51/522 [3:09:51<29:26:30, 225.03s/it] {'loss': 0.3902, 'grad_norm': 0.2134293168783188, 'learning_rate': 9.90311472892838e-06, 'epoch': 0.29} 10%|▉ | 51/522 [3:09:51<29:26:30, 225.03s/it] 10%|▉ | 52/522 [3:13:55<30:08:29, 230.87s/it] {'loss': 0.4293, 'grad_norm': 0.23476916551589966, 'learning_rate': 9.952023187751824e-06, 'epoch': 0.3} 10%|▉ | 52/522 [3:13:55<30:08:29, 230.87s/it] 10%|█ | 53/522 [3:17:49<30:10:57, 231.68s/it] {'loss': 0.4073, 'grad_norm': 0.19990144670009613, 'learning_rate': 1e-05, 'epoch': 0.3} 10%|█ | 53/522 [3:17:49<30:10:57, 231.68s/it] 10%|█ | 54/522 [3:21:43<30:11:52, 232.29s/it] {'loss': 0.399, 'grad_norm': 0.19277091324329376, 'learning_rate': 1e-05, 'epoch': 0.31} 10%|█ | 54/522 [3:21:43<30:11:52, 232.29s/it] 11%|█ | 55/522 [3:25:07<29:03:09, 223.96s/it] {'loss': 0.4053, 'grad_norm': 0.24185502529144287, 'learning_rate': 1e-05, 'epoch': 0.32} 11%|█ | 55/522 [3:25:07<29:03:09, 223.96s/it] 11%|█ | 56/522 [3:28:31<28:12:09, 217.87s/it] {'loss': 0.406, 'grad_norm': 0.31313204765319824, 'learning_rate': 1e-05, 'epoch': 0.32} 11%|█ | 56/522 [3:28:31<28:12:09, 217.87s/it] 11%|█ | 57/522 [3:32:36<29:12:30, 226.13s/it] {'loss': 0.4149, 'grad_norm': 0.18777069449424744, 'learning_rate': 1e-05, 'epoch': 0.33} 11%|█ | 57/522 [3:32:36<29:12:30, 226.13s/it] 11%|█ | 58/522 [3:36:05<28:29:01, 221.00s/it] {'loss': 0.4128, 'grad_norm': 0.1889013797044754, 'learning_rate': 1e-05, 'epoch': 0.33} 11%|█ | 58/522 [3:36:05<28:29:01, 221.00s/it] 11%|█▏ | 59/522 [3:39:39<28:07:55, 218.74s/it] {'loss': 0.3868, 'grad_norm': 0.19651412963867188, 'learning_rate': 1e-05, 'epoch': 0.34} 11%|█▏ | 59/522 [3:39:39<28:07:55, 218.74s/it] 11%|█▏ | 60/522 [3:43:01<27:26:30, 213.83s/it] {'loss': 0.4043, 'grad_norm': 0.21047908067703247, 'learning_rate': 1e-05, 'epoch': 0.34} 11%|█▏ | 60/522 [3:43:01<27:26:30, 213.83s/it] 12%|█▏ | 61/522 [3:46:45<27:45:37, 216.78s/it] {'loss': 0.4164, 'grad_norm': 0.21318431198596954, 'learning_rate': 1e-05, 'epoch': 0.35} 12%|█▏ | 61/522 [3:46:45<27:45:37, 216.78s/it] 12%|█▏ | 62/522 [3:50:42<28:28:02, 222.79s/it] {'loss': 0.4232, 'grad_norm': 0.1900871843099594, 'learning_rate': 1e-05, 'epoch': 0.36} 12%|█▏ | 62/522 [3:50:42<28:28:02, 222.79s/it] 12%|█▏ | 63/522 [3:54:41<29:03:04, 227.85s/it] {'loss': 0.4146, 'grad_norm': 0.19825881719589233, 'learning_rate': 1e-05, 'epoch': 0.36} 12%|█▏ | 63/522 [3:54:41<29:03:04, 227.85s/it] 12%|█▏ | 64/522 [3:58:09<28:14:03, 221.93s/it] {'loss': 0.3922, 'grad_norm': 0.21604228019714355, 'learning_rate': 1e-05, 'epoch': 0.37} 12%|█▏ | 64/522 [3:58:09<28:14:03, 221.93s/it] 12%|█▏ | 65/522 [4:01:54<28:16:22, 222.72s/it] {'loss': 0.4133, 'grad_norm': 0.20489658415317535, 'learning_rate': 1e-05, 'epoch': 0.37} 12%|█▏ | 65/522 [4:01:54<28:16:22, 222.72s/it] 13%|█▎ | 66/522 [4:05:24<27:43:41, 218.91s/it] {'loss': 0.4138, 'grad_norm': 0.20160818099975586, 'learning_rate': 1e-05, 'epoch': 0.38} 13%|█▎ | 66/522 [4:05:24<27:43:41, 218.91s/it] 13%|█▎ | 67/522 [4:08:28<26:20:05, 208.36s/it] {'loss': 0.3795, 'grad_norm': 0.20471148192882538, 'learning_rate': 1e-05, 'epoch': 0.38} 13%|█▎ | 67/522 [4:08:28<26:20:05, 208.36s/it] 13%|█▎ | 68/522 [4:12:00<26:26:03, 209.61s/it] {'loss': 0.3967, 'grad_norm': 0.20058000087738037, 'learning_rate': 1e-05, 'epoch': 0.39} 13%|█▎ | 68/522 [4:12:00<26:26:03, 209.61s/it] 13%|█▎ | 69/522 [4:16:00<27:30:18, 218.58s/it] {'loss': 0.4188, 'grad_norm': 0.1986096054315567, 'learning_rate': 1e-05, 'epoch': 0.4} 13%|█▎ | 69/522 [4:16:00<27:30:18, 218.58s/it] 13%|█▎ | 70/522 [4:19:23<26:52:46, 214.09s/it] {'loss': 0.3545, 'grad_norm': 0.18272562325000763, 'learning_rate': 1e-05, 'epoch': 0.4} 13%|█▎ | 70/522 [4:19:23<26:52:46, 214.09s/it] 14%|█▎ | 71/522 [4:23:21<27:41:41, 221.07s/it] {'loss': 0.4065, 'grad_norm': 0.1923666149377823, 'learning_rate': 1e-05, 'epoch': 0.41} 14%|█▎ | 71/522 [4:23:21<27:41:41, 221.07s/it] 14%|█▍ | 72/522 [4:26:54<27:20:30, 218.73s/it] {'loss': 0.3903, 'grad_norm': 0.1962745636701584, 'learning_rate': 1e-05, 'epoch': 0.41} 14%|█▍ | 72/522 [4:26:54<27:20:30, 218.73s/it] 14%|█▍ | 73/522 [4:30:14<26:33:54, 212.99s/it] {'loss': 0.396, 'grad_norm': 0.20347648859024048, 'learning_rate': 1e-05, 'epoch': 0.42} 14%|█▍ | 73/522 [4:30:14<26:33:54, 212.99s/it] 14%|█▍ | 74/522 [4:33:54<26:45:48, 215.06s/it] {'loss': 0.4119, 'grad_norm': 0.20337718725204468, 'learning_rate': 1e-05, 'epoch': 0.43} 14%|█▍ | 74/522 [4:33:54<26:45:48, 215.06s/it] 14%|█▍ | 75/522 [4:37:49<27:28:55, 221.33s/it] {'loss': 0.4165, 'grad_norm': 0.18478763103485107, 'learning_rate': 1e-05, 'epoch': 0.43} 14%|█▍ | 75/522 [4:37:49<27:28:55, 221.33s/it] 15%|█▍ | 76/522 [4:41:05<26:26:38, 213.45s/it] {'loss': 0.4031, 'grad_norm': 0.20651264488697052, 'learning_rate': 1e-05, 'epoch': 0.44} 15%|█▍ | 76/522 [4:41:05<26:26:38, 213.45s/it] 15%|█▍ | 77/522 [4:44:59<27:10:20, 219.82s/it] {'loss': 0.4176, 'grad_norm': 0.19098536670207977, 'learning_rate': 1e-05, 'epoch': 0.44} 15%|█▍ | 77/522 [4:44:59<27:10:20, 219.82s/it] 15%|█▍ | 78/522 [4:48:32<26:50:21, 217.62s/it] {'loss': 0.4059, 'grad_norm': 0.2041967362165451, 'learning_rate': 1e-05, 'epoch': 0.45} 15%|█▍ | 78/522 [4:48:32<26:50:21, 217.62s/it] 15%|█▌ | 79/522 [4:52:05<26:37:43, 216.40s/it] {'loss': 0.4064, 'grad_norm': 0.1949312686920166, 'learning_rate': 1e-05, 'epoch': 0.45} 15%|█▌ | 79/522 [4:52:05<26:37:43, 216.40s/it] 15%|█▌ | 80/522 [4:56:04<27:24:06, 223.18s/it] {'loss': 0.401, 'grad_norm': 0.18837955594062805, 'learning_rate': 1e-05, 'epoch': 0.46} 15%|█▌ | 80/522 [4:56:04<27:24:06, 223.18s/it] 16%|█▌ | 81/522 [4:59:25<26:30:34, 216.40s/it] {'loss': 0.3952, 'grad_norm': 0.21776925027370453, 'learning_rate': 1e-05, 'epoch': 0.47} 16%|█▌ | 81/522 [4:59:25<26:30:34, 216.40s/it] 16%|█▌ | 82/522 [5:03:04<26:33:52, 217.35s/it] {'loss': 0.4166, 'grad_norm': 0.21793542802333832, 'learning_rate': 1e-05, 'epoch': 0.47} 16%|█▌ | 82/522 [5:03:04<26:33:52, 217.35s/it] 16%|█▌ | 83/522 [5:06:50<26:48:58, 219.91s/it] {'loss': 0.3968, 'grad_norm': 0.18455015122890472, 'learning_rate': 1e-05, 'epoch': 0.48} 16%|█▌ | 83/522 [5:06:50<26:48:58, 219.91s/it] 16%|█▌ | 84/522 [5:10:42<27:10:57, 223.42s/it] {'loss': 0.4305, 'grad_norm': 0.21880027651786804, 'learning_rate': 1e-05, 'epoch': 0.48} 16%|█▌ | 84/522 [5:10:42<27:10:57, 223.42s/it] 16%|█▋ | 85/522 [5:14:43<27:45:20, 228.65s/it] {'loss': 0.3897, 'grad_norm': 0.1923980861902237, 'learning_rate': 1e-05, 'epoch': 0.49} 16%|█▋ | 85/522 [5:14:43<27:45:20, 228.65s/it] 16%|█▋ | 86/522 [5:18:31<27:40:58, 228.57s/it] {'loss': 0.4051, 'grad_norm': 0.21221278607845306, 'learning_rate': 1e-05, 'epoch': 0.49} 16%|█▋ | 86/522 [5:18:31<27:40:58, 228.57s/it] 17%|█▋ | 87/522 [5:22:36<28:12:58, 233.51s/it] {'loss': 0.4218, 'grad_norm': 0.1844545602798462, 'learning_rate': 1e-05, 'epoch': 0.5} 17%|█▋ | 87/522 [5:22:36<28:12:58, 233.51s/it] 17%|█▋ | 88/522 [5:26:20<27:47:12, 230.49s/it] {'loss': 0.4099, 'grad_norm': 0.18485848605632782, 'learning_rate': 1e-05, 'epoch': 0.51} 17%|█▋ | 88/522 [5:26:20<27:47:12, 230.49s/it] 17%|█▋ | 89/522 [5:30:01<27:23:45, 227.77s/it] {'loss': 0.4071, 'grad_norm': 0.2057962715625763, 'learning_rate': 1e-05, 'epoch': 0.51} 17%|█▋ | 89/522 [5:30:01<27:23:45, 227.77s/it] 17%|█▋ | 90/522 [5:34:13<28:11:21, 234.91s/it] {'loss': 0.4108, 'grad_norm': 0.17509949207305908, 'learning_rate': 1e-05, 'epoch': 0.52} 17%|█▋ | 90/522 [5:34:13<28:11:21, 234.91s/it] 17%|█▋ | 91/522 [5:37:33<26:52:51, 224.53s/it] {'loss': 0.3944, 'grad_norm': 0.18609851598739624, 'learning_rate': 1e-05, 'epoch': 0.52} 17%|█▋ | 91/522 [5:37:33<26:52:51, 224.53s/it] 18%|█▊ | 92/522 [5:41:19<26:53:19, 225.12s/it] {'loss': 0.3962, 'grad_norm': 0.1771414428949356, 'learning_rate': 1e-05, 'epoch': 0.53} 18%|█▊ | 92/522 [5:41:19<26:53:19, 225.12s/it] 18%|█▊ | 93/522 [5:44:53<26:24:11, 221.57s/it] {'loss': 0.3872, 'grad_norm': 0.1909027248620987, 'learning_rate': 1e-05, 'epoch': 0.53} 18%|█▊ | 93/522 [5:44:53<26:24:11, 221.57s/it] 18%|█▊ | 94/522 [5:48:33<26:17:05, 221.09s/it] {'loss': 0.4151, 'grad_norm': 0.20868661999702454, 'learning_rate': 1e-05, 'epoch': 0.54} 18%|█▊ | 94/522 [5:48:33<26:17:05, 221.09s/it] 18%|█▊ | 95/522 [5:52:18<26:23:12, 222.47s/it] {'loss': 0.4015, 'grad_norm': 0.20356768369674683, 'learning_rate': 1e-05, 'epoch': 0.55} 18%|█▊ | 95/522 [5:52:18<26:23:12, 222.47s/it] 18%|█▊ | 96/522 [5:56:03<26:23:50, 223.08s/it] {'loss': 0.4199, 'grad_norm': 0.1917429119348526, 'learning_rate': 1e-05, 'epoch': 0.55} 18%|█▊ | 96/522 [5:56:03<26:23:50, 223.08s/it] 19%|█▊ | 97/522 [5:59:49<26:27:41, 224.14s/it] {'loss': 0.3892, 'grad_norm': 0.1962801218032837, 'learning_rate': 1e-05, 'epoch': 0.56} 19%|█▊ | 97/522 [5:59:49<26:27:41, 224.14s/it] 19%|█▉ | 98/522 [6:03:55<27:10:15, 230.70s/it] {'loss': 0.4265, 'grad_norm': 0.1986369490623474, 'learning_rate': 1e-05, 'epoch': 0.56} 19%|█▉ | 98/522 [6:03:55<27:10:15, 230.70s/it] 19%|█▉ | 99/522 [6:07:22<26:16:16, 223.59s/it] {'loss': 0.3941, 'grad_norm': 0.2014651894569397, 'learning_rate': 1e-05, 'epoch': 0.57} 19%|█▉ | 99/522 [6:07:22<26:16:16, 223.59s/it] 19%|█▉ | 100/522 [6:10:38<25:12:59, 215.12s/it] {'loss': 0.4011, 'grad_norm': 0.20510804653167725, 'learning_rate': 1e-05, 'epoch': 0.57} 19%|█▉ | 100/522 [6:10:38<25:12:59, 215.12s/it] 19%|█▉ | 101/522 [6:14:12<25:08:21, 214.97s/it] {'loss': 0.4176, 'grad_norm': 0.2089812010526657, 'learning_rate': 1e-05, 'epoch': 0.58} 19%|█▉ | 101/522 [6:14:12<25:08:21, 214.97s/it] 20%|█▉ | 102/522 [6:17:42<24:52:58, 213.28s/it] {'loss': 0.4199, 'grad_norm': 0.21303489804267883, 'learning_rate': 1e-05, 'epoch': 0.59} 20%|█▉ | 102/522 [6:17:42<24:52:58, 213.28s/it] 20%|█▉ | 103/522 [6:21:06<24:29:38, 210.45s/it] {'loss': 0.4078, 'grad_norm': 0.1848217248916626, 'learning_rate': 1e-05, 'epoch': 0.59} 20%|█▉ | 103/522 [6:21:06<24:29:38, 210.45s/it] 20%|█▉ | 104/522 [6:24:53<25:01:51, 215.58s/it] {'loss': 0.3942, 'grad_norm': 0.21211403608322144, 'learning_rate': 1e-05, 'epoch': 0.6} 20%|█▉ | 104/522 [6:24:53<25:01:51, 215.58s/it] 20%|██ | 105/522 [6:28:26<24:53:24, 214.88s/it] {'loss': 0.3947, 'grad_norm': 0.21379685401916504, 'learning_rate': 1e-05, 'epoch': 0.6} 20%|██ | 105/522 [6:28:26<24:53:24, 214.88s/it] 20%|██ | 106/522 [6:32:04<24:54:37, 215.57s/it] {'loss': 0.4106, 'grad_norm': 0.19577474892139435, 'learning_rate': 1e-05, 'epoch': 0.61} 20%|██ | 106/522 [6:32:04<24:54:37, 215.57s/it] 20%|██ | 107/522 [6:35:38<24:47:54, 215.12s/it] {'loss': 0.4078, 'grad_norm': 0.1953229457139969, 'learning_rate': 1e-05, 'epoch': 0.61} 20%|██ | 107/522 [6:35:38<24:47:54, 215.12s/it] 21%|██ | 108/522 [6:39:31<25:21:46, 220.55s/it] {'loss': 0.4206, 'grad_norm': 0.20205391943454742, 'learning_rate': 1e-05, 'epoch': 0.62} 21%|██ | 108/522 [6:39:31<25:21:46, 220.55s/it] 21%|██ | 109/522 [6:42:58<24:49:41, 216.42s/it] {'loss': 0.3777, 'grad_norm': 0.2077985256910324, 'learning_rate': 1e-05, 'epoch': 0.63} 21%|██ | 109/522 [6:42:58<24:49:41, 216.42s/it] 21%|██ | 110/522 [6:47:16<26:12:23, 228.99s/it] {'loss': 0.4429, 'grad_norm': 0.19248704612255096, 'learning_rate': 1e-05, 'epoch': 0.63} 21%|██ | 110/522 [6:47:16<26:12:23, 228.99s/it] 21%|██▏ | 111/522 [6:51:02<26:03:05, 228.19s/it] {'loss': 0.4193, 'grad_norm': 0.185924232006073, 'learning_rate': 1e-05, 'epoch': 0.64} 21%|██▏ | 111/522 [6:51:02<26:03:05, 228.19s/it] 21%|██▏ | 112/522 [6:54:54<26:05:52, 229.15s/it] {'loss': 0.4306, 'grad_norm': 0.19052712619304657, 'learning_rate': 1e-05, 'epoch': 0.64} 21%|██▏ | 112/522 [6:54:54<26:05:52, 229.15s/it] 22%|██▏ | 113/522 [6:58:22<25:19:16, 222.88s/it] {'loss': 0.4, 'grad_norm': 0.20746831595897675, 'learning_rate': 1e-05, 'epoch': 0.65} 22%|██▏ | 113/522 [6:58:22<25:19:16, 222.88s/it] 22%|██▏ | 114/522 [7:02:06<25:18:33, 223.32s/it] {'loss': 0.4175, 'grad_norm': 0.2245045006275177, 'learning_rate': 1e-05, 'epoch': 0.65} 22%|██▏ | 114/522 [7:02:06<25:18:33, 223.32s/it] 22%|██▏ | 115/522 [7:05:12<23:57:35, 211.93s/it] {'loss': 0.4222, 'grad_norm': 0.2076449692249298, 'learning_rate': 1e-05, 'epoch': 0.66} 22%|██▏ | 115/522 [7:05:12<23:57:35, 211.93s/it] 22%|██▏ | 116/522 [7:08:31<23:28:38, 208.17s/it] {'loss': 0.3959, 'grad_norm': 0.1907033920288086, 'learning_rate': 1e-05, 'epoch': 0.67} 22%|██▏ | 116/522 [7:08:31<23:28:38, 208.17s/it] 22%|██▏ | 117/522 [7:12:04<23:34:38, 209.58s/it] {'loss': 0.4051, 'grad_norm': 0.19864502549171448, 'learning_rate': 1e-05, 'epoch': 0.67} 22%|██▏ | 117/522 [7:12:04<23:34:38, 209.58s/it] 23%|██▎ | 118/522 [7:16:08<24:39:57, 219.80s/it] {'loss': 0.4278, 'grad_norm': 0.18813501298427582, 'learning_rate': 1e-05, 'epoch': 0.68} 23%|██▎ | 118/522 [7:16:08<24:39:57, 219.80s/it] 23%|██▎ | 119/522 [7:19:56<24:53:58, 222.43s/it] {'loss': 0.4255, 'grad_norm': 0.19468307495117188, 'learning_rate': 1e-05, 'epoch': 0.68} 23%|██▎ | 119/522 [7:19:56<24:53:58, 222.43s/it] 23%|██▎ | 120/522 [7:23:16<24:04:06, 215.54s/it] {'loss': 0.4018, 'grad_norm': 0.20664997398853302, 'learning_rate': 1e-05, 'epoch': 0.69} 23%|██▎ | 120/522 [7:23:16<24:04:06, 215.54s/it] 23%|██▎ | 121/522 [7:27:26<25:10:19, 225.98s/it] {'loss': 0.4179, 'grad_norm': 0.1985282301902771, 'learning_rate': 1e-05, 'epoch': 0.7} 23%|██▎ | 121/522 [7:27:26<25:10:19, 225.98s/it] 23%|██▎ | 122/522 [7:30:40<24:03:12, 216.48s/it] {'loss': 0.4032, 'grad_norm': 0.2011347860097885, 'learning_rate': 1e-05, 'epoch': 0.7} 23%|██▎ | 122/522 [7:30:40<24:03:12, 216.48s/it] 24%|██▎ | 123/522 [7:34:10<23:47:09, 214.61s/it] {'loss': 0.3938, 'grad_norm': 0.21484628319740295, 'learning_rate': 1e-05, 'epoch': 0.71} 24%|██▎ | 123/522 [7:34:10<23:47:09, 214.61s/it] 24%|██▍ | 124/522 [7:38:14<24:41:43, 223.38s/it] {'loss': 0.4272, 'grad_norm': 0.22117756307125092, 'learning_rate': 1e-05, 'epoch': 0.71} 24%|██▍ | 124/522 [7:38:14<24:41:43, 223.38s/it] 24%|██▍ | 125/522 [7:42:46<26:14:30, 237.96s/it] {'loss': 0.4306, 'grad_norm': 0.1940140277147293, 'learning_rate': 1e-05, 'epoch': 0.72} 24%|██▍ | 125/522 [7:42:46<26:14:30, 237.96s/it] 24%|██▍ | 126/522 [7:46:17<25:17:03, 229.86s/it] {'loss': 0.3965, 'grad_norm': 0.19883696734905243, 'learning_rate': 1e-05, 'epoch': 0.72} 24%|██▍ | 126/522 [7:46:17<25:17:03, 229.86s/it] 24%|██▍ | 127/522 [7:49:28<23:56:56, 218.27s/it] {'loss': 0.4022, 'grad_norm': 0.21102900803089142, 'learning_rate': 1e-05, 'epoch': 0.73} 24%|██▍ | 127/522 [7:49:28<23:56:56, 218.27s/it] 25%|██▍ | 128/522 [7:52:58<23:35:25, 215.55s/it] {'loss': 0.4072, 'grad_norm': 0.20890825986862183, 'learning_rate': 1e-05, 'epoch': 0.74} 25%|██▍ | 128/522 [7:52:58<23:35:25, 215.55s/it] 25%|██▍ | 129/522 [7:56:43<23:50:38, 218.42s/it] {'loss': 0.4137, 'grad_norm': 0.20628947019577026, 'learning_rate': 1e-05, 'epoch': 0.74} 25%|██▍ | 129/522 [7:56:43<23:50:38, 218.42s/it] 25%|██▍ | 130/522 [8:00:19<23:43:37, 217.90s/it] {'loss': 0.4285, 'grad_norm': 0.1889195591211319, 'learning_rate': 1e-05, 'epoch': 0.75} 25%|██▍ | 130/522 [8:00:19<23:43:37, 217.90s/it] 25%|██▌ | 131/522 [8:03:37<23:00:06, 211.78s/it] {'loss': 0.3922, 'grad_norm': 0.19509896636009216, 'learning_rate': 1e-05, 'epoch': 0.75} 25%|██▌ | 131/522 [8:03:37<23:00:06, 211.78s/it] 25%|██▌ | 132/522 [8:07:30<23:37:53, 218.14s/it] {'loss': 0.3989, 'grad_norm': 0.1983235478401184, 'learning_rate': 1e-05, 'epoch': 0.76} 25%|██▌ | 132/522 [8:07:30<23:37:53, 218.14s/it] 25%|██▌ | 133/522 [8:11:17<23:51:49, 220.85s/it] {'loss': 0.3992, 'grad_norm': 0.2097218632698059, 'learning_rate': 1e-05, 'epoch': 0.76} 25%|██▌ | 133/522 [8:11:17<23:51:49, 220.85s/it] 26%|██▌ | 134/522 [8:14:41<23:15:42, 215.83s/it] {'loss': 0.3887, 'grad_norm': 0.2029070109128952, 'learning_rate': 1e-05, 'epoch': 0.77} 26%|██▌ | 134/522 [8:14:41<23:15:42, 215.83s/it] 26%|██▌ | 135/522 [8:18:02<22:43:08, 211.34s/it] {'loss': 0.413, 'grad_norm': 0.21439237892627716, 'learning_rate': 1e-05, 'epoch': 0.78} 26%|██▌ | 135/522 [8:18:02<22:43:08, 211.34s/it] 26%|██▌ | 136/522 [8:22:09<23:48:35, 222.06s/it] {'loss': 0.4104, 'grad_norm': 0.20276977121829987, 'learning_rate': 1e-05, 'epoch': 0.78} 26%|██▌ | 136/522 [8:22:09<23:48:35, 222.06s/it] 26%|██▌ | 137/522 [8:25:40<23:23:21, 218.71s/it] {'loss': 0.3829, 'grad_norm': 0.19822850823402405, 'learning_rate': 1e-05, 'epoch': 0.79} 26%|██▌ | 137/522 [8:25:40<23:23:21, 218.71s/it] 26%|██▋ | 138/522 [8:29:38<23:55:59, 224.37s/it] {'loss': 0.4243, 'grad_norm': 0.20038196444511414, 'learning_rate': 1e-05, 'epoch': 0.79} 26%|██▋ | 138/522 [8:29:38<23:55:59, 224.37s/it] 27%|██▋ | 139/522 [8:33:09<23:26:56, 220.41s/it] {'loss': 0.4226, 'grad_norm': 0.21138237416744232, 'learning_rate': 1e-05, 'epoch': 0.8} 27%|██▋ | 139/522 [8:33:09<23:26:56, 220.41s/it] 27%|██▋ | 140/522 [8:37:20<24:22:26, 229.70s/it] {'loss': 0.4329, 'grad_norm': 0.19814085960388184, 'learning_rate': 1e-05, 'epoch': 0.8} 27%|██▋ | 140/522 [8:37:20<24:22:26, 229.70s/it] 27%|██▋ | 141/522 [8:40:54<23:48:28, 224.96s/it] {'loss': 0.3966, 'grad_norm': 0.23101955652236938, 'learning_rate': 1e-05, 'epoch': 0.81} 27%|██▋ | 141/522 [8:40:54<23:48:28, 224.96s/it] 27%|██▋ | 142/522 [8:44:51<24:07:11, 228.50s/it] {'loss': 0.4243, 'grad_norm': 0.19725167751312256, 'learning_rate': 1e-05, 'epoch': 0.82} 27%|██▋ | 142/522 [8:44:51<24:07:11, 228.50s/it] 27%|██▋ | 143/522 [8:48:15<23:17:07, 221.18s/it] {'loss': 0.3915, 'grad_norm': 0.19960622489452362, 'learning_rate': 1e-05, 'epoch': 0.82} 27%|██▋ | 143/522 [8:48:15<23:17:07, 221.18s/it] 28%|██▊ | 144/522 [8:51:53<23:08:19, 220.37s/it] {'loss': 0.4234, 'grad_norm': 0.21025054156780243, 'learning_rate': 1e-05, 'epoch': 0.83} 28%|██▊ | 144/522 [8:51:53<23:08:19, 220.37s/it] 28%|██▊ | 145/522 [8:55:57<23:47:52, 227.25s/it] {'loss': 0.411, 'grad_norm': 0.191615492105484, 'learning_rate': 1e-05, 'epoch': 0.83} 28%|██▊ | 145/522 [8:55:57<23:47:52, 227.25s/it] 28%|██▊ | 146/522 [9:00:02<24:17:29, 232.58s/it] {'loss': 0.407, 'grad_norm': 0.19255498051643372, 'learning_rate': 1e-05, 'epoch': 0.84} 28%|██▊ | 146/522 [9:00:02<24:17:29, 232.58s/it] 28%|██▊ | 147/522 [9:03:13<22:56:14, 220.20s/it] {'loss': 0.3799, 'grad_norm': 0.22371193766593933, 'learning_rate': 1e-05, 'epoch': 0.84} 28%|██▊ | 147/522 [9:03:13<22:56:14, 220.20s/it] 28%|██▊ | 148/522 [9:07:13<23:28:54, 226.03s/it] {'loss': 0.4086, 'grad_norm': 0.19320175051689148, 'learning_rate': 1e-05, 'epoch': 0.85} 28%|██▊ | 148/522 [9:07:13<23:28:54, 226.03s/it] 29%|██▊ | 149/522 [9:10:37<22:43:51, 219.39s/it] {'loss': 0.3941, 'grad_norm': 0.20558588206768036, 'learning_rate': 1e-05, 'epoch': 0.86} 29%|██▊ | 149/522 [9:10:37<22:43:51, 219.39s/it] 29%|██▊ | 150/522 [9:14:22<22:51:51, 221.27s/it] {'loss': 0.4109, 'grad_norm': 0.1944589912891388, 'learning_rate': 1e-05, 'epoch': 0.86} 29%|██▊ | 150/522 [9:14:22<22:51:51, 221.27s/it] 29%|██▉ | 151/522 [9:18:06<22:53:28, 222.12s/it] {'loss': 0.4219, 'grad_norm': 0.19100606441497803, 'learning_rate': 1e-05, 'epoch': 0.87} 29%|██▉ | 151/522 [9:18:06<22:53:28, 222.12s/it] 29%|██▉ | 152/522 [9:21:17<21:50:48, 212.56s/it] {'loss': 0.3718, 'grad_norm': 0.18863484263420105, 'learning_rate': 1e-05, 'epoch': 0.87} 29%|██▉ | 152/522 [9:21:17<21:50:48, 212.56s/it] 29%|██▉ | 153/522 [9:25:09<22:23:54, 218.52s/it] {'loss': 0.4245, 'grad_norm': 0.1991277039051056, 'learning_rate': 1e-05, 'epoch': 0.88} 29%|██▉ | 153/522 [9:25:09<22:23:54, 218.52s/it] 30%|██▉ | 154/522 [9:28:21<21:31:27, 210.56s/it] {'loss': 0.3949, 'grad_norm': 0.19414730370044708, 'learning_rate': 1e-05, 'epoch': 0.88} 30%|██▉ | 154/522 [9:28:21<21:31:27, 210.56s/it] 30%|██▉ | 155/522 [9:31:53<21:30:07, 210.92s/it] {'loss': 0.4001, 'grad_norm': 0.19155029952526093, 'learning_rate': 1e-05, 'epoch': 0.89} 30%|██▉ | 155/522 [9:31:53<21:30:07, 210.92s/it] 30%|██▉ | 156/522 [9:35:29<21:36:40, 212.57s/it] {'loss': 0.41, 'grad_norm': 0.2065476030111313, 'learning_rate': 1e-05, 'epoch': 0.9} 30%|██▉ | 156/522 [9:35:29<21:36:40, 212.57s/it] 30%|███ | 157/522 [9:39:13<21:53:18, 215.89s/it] {'loss': 0.4024, 'grad_norm': 0.1787327527999878, 'learning_rate': 1e-05, 'epoch': 0.9} 30%|███ | 157/522 [9:39:13<21:53:18, 215.89s/it] 30%|███ | 158/522 [9:43:22<22:49:26, 225.73s/it] {'loss': 0.4233, 'grad_norm': 0.18633633852005005, 'learning_rate': 1e-05, 'epoch': 0.91} 30%|███ | 158/522 [9:43:22<22:49:26, 225.73s/it] 30%|███ | 159/522 [9:47:18<23:05:33, 229.02s/it] {'loss': 0.39, 'grad_norm': 0.1741340309381485, 'learning_rate': 1e-05, 'epoch': 0.91} 30%|███ | 159/522 [9:47:18<23:05:33, 229.02s/it] 31%|███ | 160/522 [9:50:31<21:55:13, 217.99s/it] {'loss': 0.4015, 'grad_norm': 0.19309590756893158, 'learning_rate': 1e-05, 'epoch': 0.92} 31%|███ | 160/522 [9:50:31<21:55:13, 217.99s/it] 31%|███ | 161/522 [9:54:37<22:42:24, 226.44s/it] {'loss': 0.4144, 'grad_norm': 0.17815431952476501, 'learning_rate': 1e-05, 'epoch': 0.92} 31%|███ | 161/522 [9:54:37<22:42:24, 226.44s/it] 31%|███ | 162/522 [9:57:54<21:45:40, 217.61s/it] {'loss': 0.3673, 'grad_norm': 0.19347625970840454, 'learning_rate': 1e-05, 'epoch': 0.93} 31%|███ | 162/522 [9:57:54<21:45:40, 217.61s/it] 31%|███ | 163/522 [10:01:45<22:06:05, 221.63s/it] {'loss': 0.4045, 'grad_norm': 0.1915934532880783, 'learning_rate': 1e-05, 'epoch': 0.94} 31%|███ | 163/522 [10:01:45<22:06:05, 221.63s/it] 31%|███▏ | 164/522 [10:05:33<22:14:29, 223.66s/it] {'loss': 0.4209, 'grad_norm': 0.2024698108434677, 'learning_rate': 1e-05, 'epoch': 0.94} 31%|███▏ | 164/522 [10:05:33<22:14:29, 223.66s/it] 32%|███▏ | 165/522 [10:08:59<21:38:35, 218.25s/it] {'loss': 0.4243, 'grad_norm': 0.20962944626808167, 'learning_rate': 1e-05, 'epoch': 0.95} 32%|███▏ | 165/522 [10:08:59<21:38:35, 218.25s/it] 32%|███▏ | 166/522 [10:12:36<21:32:24, 217.82s/it] {'loss': 0.3856, 'grad_norm': 0.19781175255775452, 'learning_rate': 1e-05, 'epoch': 0.95} 32%|███▏ | 166/522 [10:12:36<21:32:24, 217.82s/it] 32%|███▏ | 167/522 [10:16:29<21:56:08, 222.45s/it] {'loss': 0.4049, 'grad_norm': 0.1757676601409912, 'learning_rate': 1e-05, 'epoch': 0.96} 32%|███▏ | 167/522 [10:16:29<21:56:08, 222.45s/it] 32%|███▏ | 168/522 [10:20:11<21:52:05, 222.39s/it] {'loss': 0.3931, 'grad_norm': 0.18791785836219788, 'learning_rate': 1e-05, 'epoch': 0.97} 32%|███▏ | 168/522 [10:20:11<21:52:05, 222.39s/it] 32%|███▏ | 169/522 [10:23:43<21:30:53, 219.42s/it] {'loss': 0.4055, 'grad_norm': 0.19994640350341797, 'learning_rate': 1e-05, 'epoch': 0.97} 32%|███▏ | 169/522 [10:23:43<21:30:53, 219.42s/it] 33%|███▎ | 170/522 [10:27:27<21:33:50, 220.54s/it] {'loss': 0.4003, 'grad_norm': 0.1911086142063141, 'learning_rate': 1e-05, 'epoch': 0.98} 33%|███▎ | 170/522 [10:27:27<21:33:50, 220.54s/it] 33%|███▎ | 171/522 [10:31:40<22:28:27, 230.50s/it] {'loss': 0.4293, 'grad_norm': 0.1885630190372467, 'learning_rate': 1e-05, 'epoch': 0.98} 33%|███▎ | 171/522 [10:31:40<22:28:27, 230.50s/it] 33%|███▎ | 172/522 [10:35:07<21:42:41, 223.32s/it] {'loss': 0.4, 'grad_norm': 0.20040088891983032, 'learning_rate': 1e-05, 'epoch': 0.99} 33%|███▎ | 172/522 [10:35:07<21:42:41, 223.32s/it] 33%|███▎ | 173/522 [10:38:54<21:44:45, 224.31s/it] {'loss': 0.4364, 'grad_norm': 0.19344641268253326, 'learning_rate': 1e-05, 'epoch': 0.99} 33%|███▎ | 173/522 [10:38:54<21:44:45, 224.31s/it] 33%|███▎ | 174/522 [10:42:51<22:04:15, 228.32s/it] {'loss': 0.4148, 'grad_norm': 0.1822534203529358, 'learning_rate': 1e-05, 'epoch': 1.0} 33%|███▎ | 174/522 [10:42:51<22:04:15, 228.32s/it] 34%|███▎ | 175/522 [10:43:08<15:53:52, 164.93s/it] {'loss': 0.3696, 'grad_norm': 0.1822534203529358, 'learning_rate': 1e-05, 'epoch': 1.0} 34%|███▎ | 175/522 [10:43:08<15:53:52, 164.93s/it] 34%|███▎ | 176/522 [10:49:22<21:52:24, 227.58s/it] {'loss': 0.388, 'grad_norm': 0.620218813419342, 'learning_rate': 1e-05, 'epoch': 1.01} 34%|███▎ | 176/522 [10:49:22<21:52:24, 227.58s/it] 34%|███▍ | 177/522 [10:53:02<21:35:29, 225.30s/it] {'loss': 0.3802, 'grad_norm': 0.22112099826335907, 'learning_rate': 1e-05, 'epoch': 1.01} 34%|███▍ | 177/522 [10:53:02<21:35:29, 225.30s/it] 34%|███▍ | 178/522 [10:57:07<22:05:43, 231.23s/it] {'loss': 0.3889, 'grad_norm': 0.2227335274219513, 'learning_rate': 1e-05, 'epoch': 1.02} 34%|███▍ | 178/522 [10:57:07<22:05:43, 231.23s/it] 34%|███▍ | 179/522 [11:00:16<20:50:06, 218.68s/it] {'loss': 0.3533, 'grad_norm': 0.20816756784915924, 'learning_rate': 1e-05, 'epoch': 1.02} 34%|███▍ | 179/522 [11:00:16<20:50:06, 218.68s/it] 34%|███▍ | 180/522 [11:03:24<19:53:25, 209.37s/it] {'loss': 0.3521, 'grad_norm': 0.2031523734331131, 'learning_rate': 1e-05, 'epoch': 1.03} 34%|███▍ | 180/522 [11:03:24<19:53:25, 209.37s/it] 35%|███▍ | 181/522 [11:07:08<20:15:13, 213.82s/it] {'loss': 0.3692, 'grad_norm': 0.2567701041698456, 'learning_rate': 1e-05, 'epoch': 1.03} 35%|███▍ | 181/522 [11:07:08<20:15:13, 213.82s/it] 35%|███▍ | 182/522 [11:10:52<20:28:03, 216.72s/it] {'loss': 0.3565, 'grad_norm': 0.21384017169475555, 'learning_rate': 1e-05, 'epoch': 1.04} 35%|███▍ | 182/522 [11:10:52<20:28:03, 216.72s/it] 35%|███▌ | 183/522 [11:14:21<20:11:58, 214.51s/it] {'loss': 0.3804, 'grad_norm': 0.2004983276128769, 'learning_rate': 1e-05, 'epoch': 1.05} 35%|███▌ | 183/522 [11:14:21<20:11:58, 214.51s/it] 35%|███▌ | 184/522 [11:17:52<20:01:47, 213.33s/it] {'loss': 0.3695, 'grad_norm': 0.21606996655464172, 'learning_rate': 1e-05, 'epoch': 1.05} 35%|███▌ | 184/522 [11:17:52<20:01:47, 213.33s/it] 35%|███▌ | 185/522 [11:21:31<20:07:54, 215.06s/it] {'loss': 0.3777, 'grad_norm': 0.1930302381515503, 'learning_rate': 1e-05, 'epoch': 1.06} 35%|███▌ | 185/522 [11:21:31<20:07:54, 215.06s/it] 36%|███▌ | 186/522 [11:24:43<19:25:57, 208.21s/it] {'loss': 0.3451, 'grad_norm': 0.21570707857608795, 'learning_rate': 1e-05, 'epoch': 1.06} 36%|███▌ | 186/522 [11:24:43<19:25:57, 208.21s/it] 36%|███▌ | 187/522 [11:28:18<19:33:10, 210.12s/it] {'loss': 0.3775, 'grad_norm': 0.21275046467781067, 'learning_rate': 1e-05, 'epoch': 1.07} 36%|███▌ | 187/522 [11:28:18<19:33:10, 210.12s/it] 36%|███▌ | 188/522 [11:32:10<20:07:06, 216.85s/it] {'loss': 0.3925, 'grad_norm': 0.2052377462387085, 'learning_rate': 1e-05, 'epoch': 1.07} 36%|███▌ | 188/522 [11:32:10<20:07:06, 216.85s/it] 36%|███▌ | 189/522 [11:36:08<20:38:44, 223.20s/it] {'loss': 0.3721, 'grad_norm': 0.20157966017723083, 'learning_rate': 1e-05, 'epoch': 1.08} 36%|███▌ | 189/522 [11:36:08<20:38:44, 223.20s/it] 36%|███▋ | 190/522 [11:39:42<20:18:40, 220.24s/it] {'loss': 0.3691, 'grad_norm': 0.19828763604164124, 'learning_rate': 1e-05, 'epoch': 1.09} 36%|███▋ | 190/522 [11:39:42<20:18:40, 220.24s/it] 37%|███▋ | 191/522 [11:43:32<20:31:28, 223.23s/it] {'loss': 0.3677, 'grad_norm': 0.1955816000699997, 'learning_rate': 1e-05, 'epoch': 1.09} 37%|███▋ | 191/522 [11:43:32<20:31:28, 223.23s/it] 37%|███▋ | 192/522 [11:47:00<20:02:44, 218.68s/it] {'loss': 0.3689, 'grad_norm': 0.20183224976062775, 'learning_rate': 1e-05, 'epoch': 1.1} 37%|███▋ | 192/522 [11:47:00<20:02:44, 218.68s/it] 37%|███▋ | 193/522 [11:50:01<18:58:00, 207.54s/it] {'loss': 0.3277, 'grad_norm': 0.21135906875133514, 'learning_rate': 1e-05, 'epoch': 1.1} 37%|███▋ | 193/522 [11:50:01<18:58:00, 207.54s/it] 37%|███▋ | 194/522 [11:53:57<19:41:09, 216.06s/it] {'loss': 0.3825, 'grad_norm': 0.1977703869342804, 'learning_rate': 1e-05, 'epoch': 1.11} 37%|███▋ | 194/522 [11:53:57<19:41:09, 216.06s/it] 37%|███▋ | 195/522 [11:57:49<20:02:27, 220.64s/it] {'loss': 0.3837, 'grad_norm': 0.1844356656074524, 'learning_rate': 1e-05, 'epoch': 1.11} 37%|███▋ | 195/522 [11:57:49<20:02:27, 220.64s/it] 38%|███▊ | 196/522 [12:01:09<19:26:25, 214.68s/it] {'loss': 0.3796, 'grad_norm': 0.22664231061935425, 'learning_rate': 1e-05, 'epoch': 1.12} 38%|███▊ | 196/522 [12:01:09<19:26:25, 214.68s/it] 38%|███▊ | 197/522 [12:04:26<18:53:00, 209.17s/it] {'loss': 0.3428, 'grad_norm': 0.1808972954750061, 'learning_rate': 1e-05, 'epoch': 1.13} 38%|███▊ | 197/522 [12:04:26<18:53:00, 209.17s/it] 38%|███▊ | 198/522 [12:08:17<19:25:38, 215.86s/it] {'loss': 0.3756, 'grad_norm': 0.18607941269874573, 'learning_rate': 1e-05, 'epoch': 1.13} 38%|███▊ | 198/522 [12:08:17<19:25:38, 215.86s/it] 38%|███▊ | 199/522 [12:12:01<19:34:05, 218.10s/it] {'loss': 0.3439, 'grad_norm': 0.1953880935907364, 'learning_rate': 1e-05, 'epoch': 1.14} 38%|███▊ | 199/522 [12:12:01<19:34:05, 218.10s/it] 38%|███▊ | 200/522 [12:14:55<18:20:00, 204.97s/it] {'loss': 0.3505, 'grad_norm': 0.19738876819610596, 'learning_rate': 1e-05, 'epoch': 1.14} 38%|███▊ | 200/522 [12:14:55<18:20:00, 204.97s/it] 39%|███▊ | 201/522 [12:18:14<18:06:42, 203.12s/it] {'loss': 0.351, 'grad_norm': 0.1925484538078308, 'learning_rate': 1e-05, 'epoch': 1.15} 39%|███▊ | 201/522 [12:18:14<18:06:42, 203.12s/it] 39%|███▊ | 202/522 [12:21:47<18:19:16, 206.11s/it] {'loss': 0.3865, 'grad_norm': 0.2049640715122223, 'learning_rate': 1e-05, 'epoch': 1.16} 39%|███▊ | 202/522 [12:21:47<18:19:16, 206.11s/it] 39%|███▉ | 203/522 [12:24:44<17:30:18, 197.55s/it] {'loss': 0.3612, 'grad_norm': 0.21929340064525604, 'learning_rate': 1e-05, 'epoch': 1.16} 39%|███▉ | 203/522 [12:24:44<17:30:18, 197.55s/it] 39%|███▉ | 204/522 [12:28:08<17:36:03, 199.26s/it] {'loss': 0.369, 'grad_norm': 0.18611623346805573, 'learning_rate': 1e-05, 'epoch': 1.17} 39%|███▉ | 204/522 [12:28:08<17:36:03, 199.26s/it] 39%|███▉ | 205/522 [12:32:13<18:45:55, 213.11s/it] {'loss': 0.3871, 'grad_norm': 0.18556064367294312, 'learning_rate': 1e-05, 'epoch': 1.17} 39%|███▉ | 205/522 [12:32:13<18:45:55, 213.11s/it] 39%|███▉ | 206/522 [12:36:15<19:27:23, 221.66s/it] {'loss': 0.3811, 'grad_norm': 0.2099313884973526, 'learning_rate': 1e-05, 'epoch': 1.18} 39%|███▉ | 206/522 [12:36:15<19:27:23, 221.66s/it] 40%|███▉ | 207/522 [12:39:53<19:18:34, 220.68s/it] {'loss': 0.3579, 'grad_norm': 0.19222228229045868, 'learning_rate': 1e-05, 'epoch': 1.18} 40%|███▉ | 207/522 [12:39:53<19:18:34, 220.68s/it] 40%|███▉ | 208/522 [12:43:10<18:37:38, 213.56s/it] {'loss': 0.3565, 'grad_norm': 0.19332610070705414, 'learning_rate': 1e-05, 'epoch': 1.19} 40%|███▉ | 208/522 [12:43:10<18:37:38, 213.56s/it] 40%|████ | 209/522 [12:46:39<18:26:20, 212.08s/it] {'loss': 0.3745, 'grad_norm': 0.1865576207637787, 'learning_rate': 1e-05, 'epoch': 1.2} 40%|████ | 209/522 [12:46:39<18:26:20, 212.08s/it] 40%|████ | 210/522 [12:50:12<18:24:47, 212.46s/it] {'loss': 0.3357, 'grad_norm': 0.1807744950056076, 'learning_rate': 1e-05, 'epoch': 1.2} 40%|████ | 210/522 [12:50:12<18:24:47, 212.46s/it] 40%|████ | 211/522 [12:54:15<19:09:27, 221.76s/it] {'loss': 0.3941, 'grad_norm': 0.2059413194656372, 'learning_rate': 1e-05, 'epoch': 1.21} 40%|████ | 211/522 [12:54:15<19:09:27, 221.76s/it] 41%|████ | 212/522 [12:58:32<19:59:50, 232.23s/it] {'loss': 0.3896, 'grad_norm': 0.1810489445924759, 'learning_rate': 1e-05, 'epoch': 1.21} 41%|████ | 212/522 [12:58:32<19:59:50, 232.23s/it] 41%|████ | 213/522 [13:01:52<19:06:24, 222.60s/it] {'loss': 0.3518, 'grad_norm': 0.2079351842403412, 'learning_rate': 1e-05, 'epoch': 1.22} 41%|████ | 213/522 [13:01:52<19:06:24, 222.60s/it] 41%|████ | 214/522 [13:05:28<18:52:28, 220.61s/it] {'loss': 0.376, 'grad_norm': 0.18779966235160828, 'learning_rate': 1e-05, 'epoch': 1.22} 41%|████ | 214/522 [13:05:28<18:52:28, 220.61s/it] 41%|████ | 215/522 [13:08:37<18:00:37, 211.20s/it] {'loss': 0.3292, 'grad_norm': 0.20203232765197754, 'learning_rate': 1e-05, 'epoch': 1.23} 41%|████ | 215/522 [13:08:37<18:00:37, 211.20s/it] 41%|████▏ | 216/522 [13:12:40<18:44:56, 220.58s/it] {'loss': 0.3633, 'grad_norm': 0.18959388136863708, 'learning_rate': 1e-05, 'epoch': 1.24} 41%|████▏ | 216/522 [13:12:40<18:44:56, 220.58s/it] 42%|████▏ | 217/522 [13:16:43<19:15:11, 227.25s/it] {'loss': 0.3913, 'grad_norm': 0.1918056458234787, 'learning_rate': 1e-05, 'epoch': 1.24} 42%|████▏ | 217/522 [13:16:43<19:15:11, 227.25s/it] 42%|████▏ | 218/522 [13:20:19<18:54:53, 223.99s/it] {'loss': 0.3471, 'grad_norm': 0.1959446370601654, 'learning_rate': 1e-05, 'epoch': 1.25} 42%|████▏ | 218/522 [13:20:19<18:54:53, 223.99s/it] 42%|████▏ | 219/522 [13:23:24<17:52:43, 212.42s/it] {'loss': 0.3375, 'grad_norm': 0.2162327617406845, 'learning_rate': 1e-05, 'epoch': 1.25} 42%|████▏ | 219/522 [13:23:24<17:52:43, 212.42s/it] 42%|████▏ | 220/522 [13:27:33<18:44:20, 223.38s/it] {'loss': 0.3871, 'grad_norm': 0.1908765435218811, 'learning_rate': 1e-05, 'epoch': 1.26} 42%|████▏ | 220/522 [13:27:33<18:44:20, 223.38s/it] 42%|████▏ | 221/522 [13:31:41<19:17:01, 230.64s/it] {'loss': 0.3869, 'grad_norm': 0.19315458834171295, 'learning_rate': 1e-05, 'epoch': 1.26} 42%|████▏ | 221/522 [13:31:41<19:17:01, 230.64s/it] 43%|████▎ | 222/522 [13:35:34<19:17:22, 231.47s/it] {'loss': 0.386, 'grad_norm': 0.19747774302959442, 'learning_rate': 1e-05, 'epoch': 1.27} 43%|████▎ | 222/522 [13:35:34<19:17:22, 231.47s/it] 43%|████▎ | 223/522 [13:38:52<18:23:30, 221.44s/it] {'loss': 0.3571, 'grad_norm': 0.18304622173309326, 'learning_rate': 1e-05, 'epoch': 1.28} 43%|████▎ | 223/522 [13:38:52<18:23:30, 221.44s/it] 43%|████▎ | 224/522 [13:43:05<19:06:27, 230.83s/it] {'loss': 0.3853, 'grad_norm': 0.20058946311473846, 'learning_rate': 1e-05, 'epoch': 1.28} 43%|████▎ | 224/522 [13:43:05<19:06:27, 230.83s/it] 43%|████▎ | 225/522 [13:46:36<18:32:16, 224.70s/it] {'loss': 0.3739, 'grad_norm': 0.19703547656536102, 'learning_rate': 1e-05, 'epoch': 1.29} 43%|████▎ | 225/522 [13:46:36<18:32:16, 224.70s/it] 43%|████▎ | 226/522 [13:50:11<18:14:36, 221.88s/it] {'loss': 0.3639, 'grad_norm': 0.18456818163394928, 'learning_rate': 1e-05, 'epoch': 1.29} 43%|████▎ | 226/522 [13:50:11<18:14:36, 221.88s/it] 43%|████▎ | 227/522 [13:53:46<18:01:31, 219.97s/it] {'loss': 0.3508, 'grad_norm': 0.1911889761686325, 'learning_rate': 1e-05, 'epoch': 1.3} 43%|████▎ | 227/522 [13:53:46<18:01:31, 219.97s/it] 44%|████▎ | 228/522 [13:57:33<18:07:47, 222.00s/it] {'loss': 0.3799, 'grad_norm': 0.20028844475746155, 'learning_rate': 1e-05, 'epoch': 1.3} 44%|████▎ | 228/522 [13:57:33<18:07:47, 222.00s/it] 44%|████▍ | 229/522 [14:01:27<18:22:00, 225.67s/it] {'loss': 0.4, 'grad_norm': 0.20102117955684662, 'learning_rate': 1e-05, 'epoch': 1.31} 44%|████▍ | 229/522 [14:01:27<18:22:00, 225.67s/it] 44%|████▍ | 230/522 [14:05:30<18:43:20, 230.82s/it] {'loss': 0.3733, 'grad_norm': 0.18324953317642212, 'learning_rate': 1e-05, 'epoch': 1.32} 44%|████▍ | 230/522 [14:05:30<18:43:20, 230.82s/it] 44%|████▍ | 231/522 [14:09:46<19:15:43, 238.30s/it] {'loss': 0.3821, 'grad_norm': 0.18891215324401855, 'learning_rate': 1e-05, 'epoch': 1.32} 44%|████▍ | 231/522 [14:09:46<19:15:43, 238.30s/it] 44%|████▍ | 232/522 [14:12:52<17:56:20, 222.69s/it] {'loss': 0.3402, 'grad_norm': 0.19027648866176605, 'learning_rate': 1e-05, 'epoch': 1.33} 44%|████▍ | 232/522 [14:12:52<17:56:20, 222.69s/it] 45%|████▍ | 233/522 [14:17:02<18:31:26, 230.75s/it] {'loss': 0.4104, 'grad_norm': 0.2402012199163437, 'learning_rate': 1e-05, 'epoch': 1.33} 45%|████▍ | 233/522 [14:17:02<18:31:26, 230.75s/it] 45%|████▍ | 234/522 [14:21:00<18:37:52, 232.89s/it] {'loss': 0.366, 'grad_norm': 0.18844956159591675, 'learning_rate': 1e-05, 'epoch': 1.34} 45%|████▍ | 234/522 [14:21:00<18:37:52, 232.89s/it] 45%|████▌ | 235/522 [14:25:27<19:24:04, 243.36s/it] {'loss': 0.4162, 'grad_norm': 0.1863301396369934, 'learning_rate': 1e-05, 'epoch': 1.34} 45%|████▌ | 235/522 [14:25:27<19:24:04, 243.36s/it] 45%|████▌ | 236/522 [14:29:03<18:40:51, 235.15s/it] {'loss': 0.359, 'grad_norm': 0.1869444102048874, 'learning_rate': 1e-05, 'epoch': 1.35} 45%|████▌ | 236/522 [14:29:03<18:40:51, 235.15s/it] 45%|████▌ | 237/522 [14:33:03<18:42:43, 236.36s/it] {'loss': 0.3643, 'grad_norm': 0.21427297592163086, 'learning_rate': 1e-05, 'epoch': 1.36} 45%|████▌ | 237/522 [14:33:03<18:42:43, 236.36s/it] 46%|████▌ | 238/522 [14:36:41<18:13:50, 231.09s/it] {'loss': 0.361, 'grad_norm': 0.1866866797208786, 'learning_rate': 1e-05, 'epoch': 1.36} 46%|████▌ | 238/522 [14:36:41<18:13:50, 231.09s/it] 46%|████▌ | 239/522 [14:40:30<18:06:55, 230.45s/it] {'loss': 0.3634, 'grad_norm': 0.20647411048412323, 'learning_rate': 1e-05, 'epoch': 1.37} 46%|████▌ | 239/522 [14:40:30<18:06:55, 230.45s/it] 46%|████▌ | 240/522 [14:44:15<17:54:20, 228.58s/it] {'loss': 0.3912, 'grad_norm': 0.19638046622276306, 'learning_rate': 1e-05, 'epoch': 1.37} 46%|████▌ | 240/522 [14:44:15<17:54:20, 228.58s/it] 46%|████▌ | 241/522 [14:48:08<17:57:53, 230.16s/it] {'loss': 0.3823, 'grad_norm': 0.20908358693122864, 'learning_rate': 1e-05, 'epoch': 1.38} 46%|████▌ | 241/522 [14:48:08<17:57:53, 230.16s/it] 46%|████▋ | 242/522 [14:51:48<17:39:37, 227.06s/it] {'loss': 0.3598, 'grad_norm': 0.18632566928863525, 'learning_rate': 1e-05, 'epoch': 1.38} 46%|████▋ | 242/522 [14:51:48<17:39:37, 227.06s/it] 47%|████▋ | 243/522 [14:55:32<17:31:42, 226.18s/it] {'loss': 0.3442, 'grad_norm': 0.19587033987045288, 'learning_rate': 1e-05, 'epoch': 1.39} 47%|████▋ | 243/522 [14:55:32<17:31:42, 226.18s/it] 47%|████▋ | 244/522 [14:58:58<16:59:53, 220.12s/it] {'loss': 0.383, 'grad_norm': 0.22610890865325928, 'learning_rate': 1e-05, 'epoch': 1.4} 47%|████▋ | 244/522 [14:58:58<16:59:53, 220.12s/it] 47%|████▋ | 245/522 [15:03:17<17:49:11, 231.59s/it] {'loss': 0.3949, 'grad_norm': 0.19246821105480194, 'learning_rate': 1e-05, 'epoch': 1.4} 47%|████▋ | 245/522 [15:03:17<17:49:11, 231.59s/it] 47%|████▋ | 246/522 [15:06:58<17:30:50, 228.44s/it] {'loss': 0.3611, 'grad_norm': 0.19965526461601257, 'learning_rate': 1e-05, 'epoch': 1.41} 47%|████▋ | 246/522 [15:06:58<17:30:50, 228.44s/it] 47%|████▋ | 247/522 [15:10:35<17:11:02, 224.95s/it] {'loss': 0.3789, 'grad_norm': 0.19402875006198883, 'learning_rate': 1e-05, 'epoch': 1.41} 47%|████▋ | 247/522 [15:10:35<17:11:02, 224.95s/it] 48%|████▊ | 248/522 [15:14:23<17:12:35, 226.11s/it] {'loss': 0.3826, 'grad_norm': 0.19922074675559998, 'learning_rate': 1e-05, 'epoch': 1.42} 48%|████▊ | 248/522 [15:14:23<17:12:35, 226.11s/it] 48%|████▊ | 249/522 [15:18:20<17:23:33, 229.35s/it] {'loss': 0.3605, 'grad_norm': 0.19090113043785095, 'learning_rate': 1e-05, 'epoch': 1.43} 48%|████▊ | 249/522 [15:18:20<17:23:33, 229.35s/it] 48%|████▊ | 250/522 [15:22:01<17:07:56, 226.75s/it] {'loss': 0.378, 'grad_norm': 0.19832906126976013, 'learning_rate': 1e-05, 'epoch': 1.43} 48%|████▊ | 250/522 [15:22:01<17:07:56, 226.75s/it] 48%|████▊ | 251/522 [15:26:12<17:36:42, 233.96s/it] {'loss': 0.3857, 'grad_norm': 0.20129987597465515, 'learning_rate': 1e-05, 'epoch': 1.44} 48%|████▊ | 251/522 [15:26:12<17:36:42, 233.96s/it] 48%|████▊ | 252/522 [15:29:50<17:10:59, 229.11s/it] {'loss': 0.3473, 'grad_norm': 0.2236517071723938, 'learning_rate': 1e-05, 'epoch': 1.44} 48%|████▊ | 252/522 [15:29:50<17:10:59, 229.11s/it] 48%|████▊ | 253/522 [15:33:49<17:21:00, 232.20s/it] {'loss': 0.3933, 'grad_norm': 0.20464195311069489, 'learning_rate': 1e-05, 'epoch': 1.45} 48%|████▊ | 253/522 [15:33:49<17:21:00, 232.20s/it] 49%|████▊ | 254/522 [15:37:44<17:20:26, 232.93s/it] {'loss': 0.3734, 'grad_norm': 0.17142289876937866, 'learning_rate': 1e-05, 'epoch': 1.45} 49%|████▊ | 254/522 [15:37:44<17:20:26, 232.93s/it] 49%|████▉ | 255/522 [15:41:04<16:33:07, 223.17s/it] {'loss': 0.3611, 'grad_norm': 0.19511514902114868, 'learning_rate': 1e-05, 'epoch': 1.46} 49%|████▉ | 255/522 [15:41:04<16:33:07, 223.17s/it] 49%|████▉ | 256/522 [15:44:58<16:44:11, 226.51s/it] {'loss': 0.3819, 'grad_norm': 0.19904446601867676, 'learning_rate': 1e-05, 'epoch': 1.47} 49%|████▉ | 256/522 [15:44:58<16:44:11, 226.51s/it] 49%|████▉ | 257/522 [15:49:07<17:10:04, 233.23s/it] {'loss': 0.3705, 'grad_norm': 0.17978838086128235, 'learning_rate': 1e-05, 'epoch': 1.47} 49%|████▉ | 257/522 [15:49:07<17:10:04, 233.23s/it] 49%|████▉ | 258/522 [15:52:55<16:58:39, 231.51s/it] {'loss': 0.3803, 'grad_norm': 0.19577071070671082, 'learning_rate': 1e-05, 'epoch': 1.48} 49%|████▉ | 258/522 [15:52:55<16:58:39, 231.51s/it] 50%|████▉ | 259/522 [15:56:54<17:04:18, 233.68s/it] {'loss': 0.3911, 'grad_norm': 0.19896183907985687, 'learning_rate': 1e-05, 'epoch': 1.48} 50%|████▉ | 259/522 [15:56:54<17:04:18, 233.68s/it] 50%|████▉ | 260/522 [16:00:43<16:55:26, 232.54s/it] {'loss': 0.372, 'grad_norm': 0.19960924983024597, 'learning_rate': 1e-05, 'epoch': 1.49} 50%|████▉ | 260/522 [16:00:43<16:55:26, 232.54s/it] 50%|█████ | 261/522 [16:03:56<15:59:06, 220.48s/it] {'loss': 0.3612, 'grad_norm': 0.19399036467075348, 'learning_rate': 1e-05, 'epoch': 1.49} 50%|█████ | 261/522 [16:03:56<15:59:06, 220.48s/it] 50%|█████ | 262/522 [16:07:42<16:03:29, 222.34s/it] {'loss': 0.3526, 'grad_norm': 0.19241730868816376, 'learning_rate': 1e-05, 'epoch': 1.5} 50%|█████ | 262/522 [16:07:42<16:03:29, 222.34s/it] 50%|█████ | 263/522 [16:11:12<15:42:34, 218.36s/it] {'loss': 0.3415, 'grad_norm': 0.1913290023803711, 'learning_rate': 1e-05, 'epoch': 1.51} 50%|█████ | 263/522 [16:11:12<15:42:34, 218.36s/it] 51%|█████ | 264/522 [16:14:51<15:40:46, 218.78s/it] {'loss': 0.3563, 'grad_norm': 0.19935548305511475, 'learning_rate': 1e-05, 'epoch': 1.51} 51%|█████ | 264/522 [16:14:51<15:40:46, 218.78s/it] 51%|█████ | 265/522 [16:18:24<15:29:39, 217.04s/it] {'loss': 0.3821, 'grad_norm': 0.2140403687953949, 'learning_rate': 1e-05, 'epoch': 1.52} 51%|█████ | 265/522 [16:18:24<15:29:39, 217.04s/it] 51%|█████ | 266/522 [16:22:27<15:58:30, 224.65s/it] {'loss': 0.3966, 'grad_norm': 0.17725776135921478, 'learning_rate': 1e-05, 'epoch': 1.52} 51%|█████ | 266/522 [16:22:27<15:58:30, 224.65s/it] 51%|█████ | 267/522 [16:25:42<15:16:48, 215.72s/it] {'loss': 0.341, 'grad_norm': 0.1895029991865158, 'learning_rate': 1e-05, 'epoch': 1.53} 51%|█████ | 267/522 [16:25:42<15:16:48, 215.72s/it] 51%|█████▏ | 268/522 [16:29:39<15:40:39, 222.20s/it] {'loss': 0.3734, 'grad_norm': 0.18697047233581543, 'learning_rate': 1e-05, 'epoch': 1.53} 51%|█████▏ | 268/522 [16:29:39<15:40:39, 222.20s/it] 52%|█████▏ | 269/522 [16:33:08<15:20:51, 218.38s/it] {'loss': 0.3826, 'grad_norm': 0.22105221450328827, 'learning_rate': 1e-05, 'epoch': 1.54} 52%|█████▏ | 269/522 [16:33:08<15:20:51, 218.38s/it] 52%|█████▏ | 270/522 [16:37:14<15:52:08, 226.70s/it] {'loss': 0.3731, 'grad_norm': 0.18542589247226715, 'learning_rate': 1e-05, 'epoch': 1.55} 52%|█████▏ | 270/522 [16:37:14<15:52:08, 226.70s/it] 52%|█████▏ | 271/522 [16:41:16<16:06:23, 231.01s/it] {'loss': 0.3807, 'grad_norm': 0.18708570301532745, 'learning_rate': 1e-05, 'epoch': 1.55} 52%|█████▏ | 271/522 [16:41:16<16:06:23, 231.01s/it] 52%|█████▏ | 272/522 [16:45:12<16:09:09, 232.60s/it] {'loss': 0.3896, 'grad_norm': 0.21819010376930237, 'learning_rate': 1e-05, 'epoch': 1.56} 52%|█████▏ | 272/522 [16:45:12<16:09:09, 232.60s/it] 52%|█████▏ | 273/522 [16:48:49<15:45:46, 227.90s/it] {'loss': 0.3835, 'grad_norm': 0.19098959863185883, 'learning_rate': 1e-05, 'epoch': 1.56} 52%|█████▏ | 273/522 [16:48:49<15:45:46, 227.90s/it] 52%|█████▏ | 274/522 [16:52:35<15:39:46, 227.36s/it] {'loss': 0.393, 'grad_norm': 0.2058309018611908, 'learning_rate': 1e-05, 'epoch': 1.57} 52%|█████▏ | 274/522 [16:52:35<15:39:46, 227.36s/it] 53%|█████▎ | 275/522 [16:56:06<15:15:23, 222.36s/it] {'loss': 0.3965, 'grad_norm': 0.19236424565315247, 'learning_rate': 1e-05, 'epoch': 1.57} 53%|█████▎ | 275/522 [16:56:06<15:15:23, 222.36s/it] 53%|█████▎ | 276/522 [16:59:56<15:21:05, 224.66s/it] {'loss': 0.3775, 'grad_norm': 0.19877493381500244, 'learning_rate': 1e-05, 'epoch': 1.58} 53%|█████▎ | 276/522 [16:59:56<15:21:05, 224.66s/it] 53%|█████▎ | 277/522 [17:04:17<16:01:53, 235.57s/it] {'loss': 0.3675, 'grad_norm': 0.18011285364627838, 'learning_rate': 1e-05, 'epoch': 1.59} 53%|█████▎ | 277/522 [17:04:17<16:01:53, 235.57s/it] 53%|█████▎ | 278/522 [17:08:04<15:47:49, 233.07s/it] {'loss': 0.3664, 'grad_norm': 0.21812540292739868, 'learning_rate': 1e-05, 'epoch': 1.59} 53%|█████▎ | 278/522 [17:08:04<15:47:49, 233.07s/it] 53%|█████▎ | 279/522 [17:11:53<15:39:30, 231.98s/it] {'loss': 0.36, 'grad_norm': 0.16634312272071838, 'learning_rate': 1e-05, 'epoch': 1.6} 53%|█████▎ | 279/522 [17:11:53<15:39:30, 231.98s/it] 54%|█████▎ | 280/522 [17:15:50<15:41:26, 233.42s/it] {'loss': 0.3792, 'grad_norm': 0.19553346931934357, 'learning_rate': 1e-05, 'epoch': 1.6} 54%|█████▎ | 280/522 [17:15:50<15:41:26, 233.42s/it] 54%|█████▍ | 281/522 [17:19:26<15:15:59, 228.05s/it] {'loss': 0.3692, 'grad_norm': 0.20812265574932098, 'learning_rate': 1e-05, 'epoch': 1.61} 54%|█████▍ | 281/522 [17:19:26<15:15:59, 228.05s/it] 54%|█████▍ | 282/522 [17:23:45<15:49:59, 237.50s/it] {'loss': 0.3823, 'grad_norm': 0.24649550020694733, 'learning_rate': 1e-05, 'epoch': 1.61} 54%|█████▍ | 282/522 [17:23:45<15:49:59, 237.50s/it] 54%|█████▍ | 283/522 [17:27:44<15:47:22, 237.84s/it] {'loss': 0.3692, 'grad_norm': 0.16663730144500732, 'learning_rate': 1e-05, 'epoch': 1.62} 54%|█████▍ | 283/522 [17:27:44<15:47:22, 237.84s/it] 54%|█████▍ | 284/522 [17:31:41<15:42:50, 237.69s/it] {'loss': 0.3943, 'grad_norm': 0.18113335967063904, 'learning_rate': 1e-05, 'epoch': 1.63} 54%|█████▍ | 284/522 [17:31:41<15:42:50, 237.69s/it] 55%|█████▍ | 285/522 [17:35:42<15:43:10, 238.78s/it] {'loss': 0.3918, 'grad_norm': 0.1927473247051239, 'learning_rate': 1e-05, 'epoch': 1.63} 55%|█████▍ | 285/522 [17:35:42<15:43:10, 238.78s/it] 55%|█████▍ | 286/522 [17:39:12<15:04:41, 230.01s/it] {'loss': 0.3731, 'grad_norm': 0.18235300481319427, 'learning_rate': 1e-05, 'epoch': 1.64} 55%|█████▍ | 286/522 [17:39:12<15:04:41, 230.01s/it] 55%|█████▍ | 287/522 [17:42:52<14:49:08, 227.02s/it] {'loss': 0.3676, 'grad_norm': 0.1763211041688919, 'learning_rate': 1e-05, 'epoch': 1.64} 55%|█████▍ | 287/522 [17:42:52<14:49:08, 227.02s/it] 55%|█████▌ | 288/522 [17:46:45<14:52:11, 228.77s/it] {'loss': 0.383, 'grad_norm': 0.1813199520111084, 'learning_rate': 1e-05, 'epoch': 1.65} 55%|█████▌ | 288/522 [17:46:45<14:52:11, 228.77s/it] 55%|█████▌ | 289/522 [17:50:35<14:49:59, 229.18s/it] {'loss': 0.3597, 'grad_norm': 0.17224375903606415, 'learning_rate': 1e-05, 'epoch': 1.65} 55%|█████▌ | 289/522 [17:50:35<14:49:59, 229.18s/it] 56%|█████▌ | 290/522 [17:54:38<15:02:06, 233.30s/it] {'loss': 0.3859, 'grad_norm': 0.17313852906227112, 'learning_rate': 1e-05, 'epoch': 1.66} 56%|█████▌ | 290/522 [17:54:38<15:02:06, 233.30s/it] 56%|█████▌ | 291/522 [17:58:27<14:53:33, 232.09s/it] {'loss': 0.3695, 'grad_norm': 0.18884246051311493, 'learning_rate': 1e-05, 'epoch': 1.67} 56%|█████▌ | 291/522 [17:58:27<14:53:33, 232.09s/it] 56%|█████▌ | 292/522 [18:01:48<14:14:07, 222.81s/it] {'loss': 0.3632, 'grad_norm': 0.17995579540729523, 'learning_rate': 1e-05, 'epoch': 1.67} 56%|█████▌ | 292/522 [18:01:48<14:14:07, 222.81s/it] 56%|█████▌ | 293/522 [18:05:37<14:16:36, 224.44s/it] {'loss': 0.3772, 'grad_norm': 0.1728638857603073, 'learning_rate': 1e-05, 'epoch': 1.68} 56%|█████▌ | 293/522 [18:05:37<14:16:36, 224.44s/it] 56%|█████▋ | 294/522 [18:09:20<14:11:11, 224.00s/it] {'loss': 0.39, 'grad_norm': 0.1914519965648651, 'learning_rate': 1e-05, 'epoch': 1.68} 56%|█████▋ | 294/522 [18:09:20<14:11:11, 224.00s/it] 57%|█████▋ | 295/522 [18:13:14<14:19:32, 227.19s/it] {'loss': 0.3953, 'grad_norm': 0.19205808639526367, 'learning_rate': 1e-05, 'epoch': 1.69} 57%|█████▋ | 295/522 [18:13:14<14:19:32, 227.19s/it] 57%|█████▋ | 296/522 [18:16:43<13:55:20, 221.77s/it] {'loss': 0.372, 'grad_norm': 0.1802854686975479, 'learning_rate': 1e-05, 'epoch': 1.7} 57%|█████▋ | 296/522 [18:16:43<13:55:20, 221.77s/it] 57%|█████▋ | 297/522 [18:20:56<14:26:53, 231.17s/it] {'loss': 0.3465, 'grad_norm': 0.16798654198646545, 'learning_rate': 1e-05, 'epoch': 1.7} 57%|█████▋ | 297/522 [18:20:56<14:26:53, 231.17s/it] 57%|█████▋ | 298/522 [18:24:42<14:16:56, 229.54s/it] {'loss': 0.3657, 'grad_norm': 0.1871871054172516, 'learning_rate': 1e-05, 'epoch': 1.71} 57%|█████▋ | 298/522 [18:24:42<14:16:56, 229.54s/it] 57%|█████▋ | 299/522 [18:29:00<14:44:21, 237.95s/it] {'loss': 0.3941, 'grad_norm': 0.18999744951725006, 'learning_rate': 1e-05, 'epoch': 1.71} 57%|█████▋ | 299/522 [18:29:00<14:44:21, 237.95s/it] 57%|█████▋ | 300/522 [18:32:47<14:28:41, 234.78s/it] {'loss': 0.3804, 'grad_norm': 0.1833273023366928, 'learning_rate': 1e-05, 'epoch': 1.72} 57%|█████▋ | 300/522 [18:32:47<14:28:41, 234.78s/it] 58%|█████▊ | 301/522 [18:36:26<14:07:10, 230.00s/it] {'loss': 0.3881, 'grad_norm': 0.17344166338443756, 'learning_rate': 1e-05, 'epoch': 1.72} 58%|█████▊ | 301/522 [18:36:26<14:07:10, 230.00s/it] 58%|█████▊ | 302/522 [18:39:54<13:39:44, 223.57s/it] {'loss': 0.3478, 'grad_norm': 0.20113961398601532, 'learning_rate': 1e-05, 'epoch': 1.73} 58%|█████▊ | 302/522 [18:39:54<13:39:44, 223.57s/it] 58%|█████▊ | 303/522 [18:43:55<13:55:02, 228.78s/it] {'loss': 0.3781, 'grad_norm': 0.15764889121055603, 'learning_rate': 1e-05, 'epoch': 1.74} 58%|█████▊ | 303/522 [18:43:55<13:55:02, 228.78s/it] 58%|█████▊ | 304/522 [18:47:31<13:36:21, 224.69s/it] {'loss': 0.3673, 'grad_norm': 0.18953463435173035, 'learning_rate': 1e-05, 'epoch': 1.74} 58%|█████▊ | 304/522 [18:47:31<13:36:21, 224.69s/it] 58%|█████▊ | 305/522 [18:51:04<13:19:59, 221.20s/it] {'loss': 0.3784, 'grad_norm': 0.20128783583641052, 'learning_rate': 1e-05, 'epoch': 1.75} 58%|█████▊ | 305/522 [18:51:04<13:19:59, 221.20s/it] 59%|█████▊ | 306/522 [18:54:47<13:18:58, 221.94s/it] {'loss': 0.3894, 'grad_norm': 0.1916579157114029, 'learning_rate': 1e-05, 'epoch': 1.75} 59%|█████▊ | 306/522 [18:54:47<13:18:58, 221.94s/it] 59%|█████▉ | 307/522 [18:58:51<13:38:42, 228.48s/it] {'loss': 0.3858, 'grad_norm': 0.19730639457702637, 'learning_rate': 1e-05, 'epoch': 1.76} 59%|█████▉ | 307/522 [18:58:51<13:38:42, 228.48s/it] 59%|█████▉ | 308/522 [19:02:24<13:17:48, 223.68s/it] {'loss': 0.3628, 'grad_norm': 0.1788087636232376, 'learning_rate': 1e-05, 'epoch': 1.76} 59%|█████▉ | 308/522 [19:02:24<13:17:48, 223.68s/it] 59%|█████▉ | 309/522 [19:06:19<13:27:05, 227.35s/it] {'loss': 0.374, 'grad_norm': 0.1911086142063141, 'learning_rate': 1e-05, 'epoch': 1.77} 59%|█████▉ | 309/522 [19:06:19<13:27:05, 227.35s/it] 59%|█████▉ | 310/522 [19:10:20<13:36:52, 231.19s/it] {'loss': 0.3717, 'grad_norm': 0.18494293093681335, 'learning_rate': 1e-05, 'epoch': 1.78} 59%|█████▉ | 310/522 [19:10:20<13:36:52, 231.19s/it] 60%|█████▉ | 311/522 [19:14:12<13:34:20, 231.57s/it] {'loss': 0.3549, 'grad_norm': 0.18637889623641968, 'learning_rate': 1e-05, 'epoch': 1.78} 60%|█████▉ | 311/522 [19:14:12<13:34:20, 231.57s/it] 60%|█████▉ | 312/522 [19:17:33<12:58:25, 222.41s/it] {'loss': 0.3869, 'grad_norm': 0.20969294011592865, 'learning_rate': 1e-05, 'epoch': 1.79} 60%|█████▉ | 312/522 [19:17:33<12:58:25, 222.41s/it] 60%|█████▉ | 313/522 [19:21:27<13:07:07, 225.97s/it] {'loss': 0.3901, 'grad_norm': 0.18577538430690765, 'learning_rate': 1e-05, 'epoch': 1.79} 60%|█████▉ | 313/522 [19:21:27<13:07:07, 225.97s/it] 60%|██████ | 314/522 [19:24:17<12:04:18, 208.94s/it] {'loss': 0.359, 'grad_norm': 0.19159157574176788, 'learning_rate': 1e-05, 'epoch': 1.8} 60%|██████ | 314/522 [19:24:17<12:04:18, 208.94s/it] 60%|██████ | 315/522 [19:27:51<12:06:24, 210.55s/it] {'loss': 0.3724, 'grad_norm': 0.18957668542861938, 'learning_rate': 1e-05, 'epoch': 1.8} 60%|██████ | 315/522 [19:27:51<12:06:24, 210.55s/it] 61%|██████ | 316/522 [19:32:05<12:47:55, 223.67s/it] {'loss': 0.3882, 'grad_norm': 0.19634008407592773, 'learning_rate': 1e-05, 'epoch': 1.81} 61%|██████ | 316/522 [19:32:05<12:47:55, 223.67s/it] 61%|██████ | 317/522 [19:36:09<13:04:45, 229.69s/it] {'loss': 0.38, 'grad_norm': 0.2063300758600235, 'learning_rate': 1e-05, 'epoch': 1.82} 61%|██████ | 317/522 [19:36:09<13:04:45, 229.69s/it] 61%|██████ | 318/522 [19:39:40<12:41:53, 224.08s/it] {'loss': 0.3666, 'grad_norm': 0.17975583672523499, 'learning_rate': 1e-05, 'epoch': 1.82} 61%|██████ | 318/522 [19:39:40<12:41:53, 224.08s/it] 61%|██████ | 319/522 [19:43:13<12:27:12, 220.85s/it] {'loss': 0.3697, 'grad_norm': 0.17396098375320435, 'learning_rate': 1e-05, 'epoch': 1.83} 61%|██████ | 319/522 [19:43:13<12:27:12, 220.85s/it] 61%|██████▏ | 320/522 [19:47:08<12:37:49, 225.09s/it] {'loss': 0.3676, 'grad_norm': 0.18190887570381165, 'learning_rate': 1e-05, 'epoch': 1.83} 61%|██████▏ | 320/522 [19:47:08<12:37:49, 225.09s/it] 61%|██████▏ | 321/522 [19:50:02<11:42:38, 209.74s/it] {'loss': 0.3683, 'grad_norm': 0.22799207270145416, 'learning_rate': 1e-05, 'epoch': 1.84} 61%|██████▏ | 321/522 [19:50:02<11:42:38, 209.74s/it] 62%|██████▏ | 322/522 [19:53:38<11:45:08, 211.54s/it] {'loss': 0.3769, 'grad_norm': 0.1949261724948883, 'learning_rate': 1e-05, 'epoch': 1.84} 62%|██████▏ | 322/522 [19:53:38<11:45:08, 211.54s/it] 62%|██████▏ | 323/522 [19:57:28<12:00:00, 217.09s/it] {'loss': 0.3813, 'grad_norm': 0.18445351719856262, 'learning_rate': 1e-05, 'epoch': 1.85} 62%|██████▏ | 323/522 [19:57:28<12:00:00, 217.09s/it] 62%|██████▏ | 324/522 [20:01:02<11:53:35, 216.24s/it] {'loss': 0.3622, 'grad_norm': 0.20983055233955383, 'learning_rate': 1e-05, 'epoch': 1.86} 62%|██████▏ | 324/522 [20:01:02<11:53:35, 216.24s/it] 62%|██████▏ | 325/522 [20:04:59<12:10:37, 222.53s/it] {'loss': 0.3868, 'grad_norm': 0.19037997722625732, 'learning_rate': 1e-05, 'epoch': 1.86} 62%|██████▏ | 325/522 [20:04:59<12:10:37, 222.53s/it] 62%|██████▏ | 326/522 [20:08:23<11:48:15, 216.81s/it] {'loss': 0.3696, 'grad_norm': 0.1845826804637909, 'learning_rate': 1e-05, 'epoch': 1.87} 62%|██████▏ | 326/522 [20:08:23<11:48:15, 216.81s/it] 63%|██████▎ | 327/522 [20:12:18<12:02:35, 222.34s/it] {'loss': 0.3718, 'grad_norm': 0.19997912645339966, 'learning_rate': 1e-05, 'epoch': 1.87} 63%|██████▎ | 327/522 [20:12:18<12:02:35, 222.34s/it] 63%|██████▎ | 328/522 [20:15:59<11:57:40, 221.96s/it] {'loss': 0.3744, 'grad_norm': 0.1910652071237564, 'learning_rate': 1e-05, 'epoch': 1.88} 63%|██████▎ | 328/522 [20:15:59<11:57:40, 221.96s/it] 63%|██████▎ | 329/522 [20:19:41<11:53:55, 221.95s/it] {'loss': 0.377, 'grad_norm': 0.20061074197292328, 'learning_rate': 1e-05, 'epoch': 1.88} 63%|██████▎ | 329/522 [20:19:41<11:53:55, 221.95s/it] 63%|██████▎ | 330/522 [20:23:23<11:49:59, 221.87s/it] {'loss': 0.3753, 'grad_norm': 0.1833958476781845, 'learning_rate': 1e-05, 'epoch': 1.89} 63%|██████▎ | 330/522 [20:23:23<11:49:59, 221.87s/it] 63%|██████▎ | 331/522 [20:26:41<11:24:10, 214.92s/it] {'loss': 0.3589, 'grad_norm': 0.19612354040145874, 'learning_rate': 1e-05, 'epoch': 1.9} 63%|██████▎ | 331/522 [20:26:41<11:24:10, 214.92s/it] 64%|██████▎ | 332/522 [20:30:04<11:08:28, 211.10s/it] {'loss': 0.348, 'grad_norm': 0.2078871876001358, 'learning_rate': 1e-05, 'epoch': 1.9} 64%|██████▎ | 332/522 [20:30:04<11:08:28, 211.10s/it] 64%|██████▍ | 333/522 [20:33:13<10:44:53, 204.73s/it] {'loss': 0.3529, 'grad_norm': 0.19245688617229462, 'learning_rate': 1e-05, 'epoch': 1.91} 64%|██████▍ | 333/522 [20:33:13<10:44:53, 204.73s/it] 64%|██████▍ | 334/522 [20:36:50<10:52:39, 208.29s/it] {'loss': 0.3713, 'grad_norm': 0.20029056072235107, 'learning_rate': 1e-05, 'epoch': 1.91} 64%|██████▍ | 334/522 [20:36:50<10:52:39, 208.29s/it] 64%|██████▍ | 335/522 [20:40:36<11:05:17, 213.46s/it] {'loss': 0.3695, 'grad_norm': 0.19585877656936646, 'learning_rate': 1e-05, 'epoch': 1.92} 64%|██████▍ | 335/522 [20:40:36<11:05:17, 213.46s/it] 64%|██████▍ | 336/522 [20:44:22<11:13:39, 217.31s/it] {'loss': 0.3853, 'grad_norm': 0.202496737241745, 'learning_rate': 1e-05, 'epoch': 1.92} 64%|██████▍ | 336/522 [20:44:22<11:13:39, 217.31s/it] 65%|██████▍ | 337/522 [20:47:32<10:44:47, 209.12s/it] {'loss': 0.3472, 'grad_norm': 0.205092653632164, 'learning_rate': 1e-05, 'epoch': 1.93} 65%|██████▍ | 337/522 [20:47:32<10:44:47, 209.12s/it] 65%|██████▍ | 338/522 [20:50:47<10:28:00, 204.79s/it] {'loss': 0.3416, 'grad_norm': 0.17597973346710205, 'learning_rate': 1e-05, 'epoch': 1.94} 65%|██████▍ | 338/522 [20:50:47<10:28:00, 204.79s/it] 65%|██████▍ | 339/522 [20:55:00<11:08:59, 219.34s/it] {'loss': 0.3727, 'grad_norm': 0.16586275398731232, 'learning_rate': 1e-05, 'epoch': 1.94} 65%|██████▍ | 339/522 [20:55:00<11:08:59, 219.34s/it] 65%|██████▌ | 340/522 [20:59:01<11:24:44, 225.74s/it] {'loss': 0.3788, 'grad_norm': 0.1860012263059616, 'learning_rate': 1e-05, 'epoch': 1.95} 65%|██████▌ | 340/522 [20:59:01<11:24:44, 225.74s/it] 65%|██████▌ | 341/522 [21:02:51<11:25:20, 227.19s/it] {'loss': 0.3938, 'grad_norm': 0.20166611671447754, 'learning_rate': 1e-05, 'epoch': 1.95} 65%|██████▌ | 341/522 [21:02:51<11:25:20, 227.19s/it] 66%|██████▌ | 342/522 [21:06:29<11:13:26, 224.48s/it] {'loss': 0.3963, 'grad_norm': 0.1869850903749466, 'learning_rate': 1e-05, 'epoch': 1.96} 66%|██████▌ | 342/522 [21:06:29<11:13:26, 224.48s/it] 66%|██████▌ | 343/522 [21:10:49<11:41:19, 235.08s/it] {'loss': 0.3801, 'grad_norm': 0.1834947019815445, 'learning_rate': 1e-05, 'epoch': 1.97} 66%|██████▌ | 343/522 [21:10:49<11:41:19, 235.08s/it] 66%|██████▌ | 344/522 [21:13:47<10:46:26, 217.90s/it] {'loss': 0.3522, 'grad_norm': 0.20078714191913605, 'learning_rate': 1e-05, 'epoch': 1.97} 66%|██████▌ | 344/522 [21:13:47<10:46:26, 217.90s/it] 66%|██████▌ | 345/522 [21:17:39<10:54:56, 222.01s/it] {'loss': 0.383, 'grad_norm': 0.21399059891700745, 'learning_rate': 1e-05, 'epoch': 1.98} 66%|██████▌ | 345/522 [21:17:39<10:54:56, 222.01s/it] 66%|██████▋ | 346/522 [21:21:34<11:03:21, 226.14s/it] {'loss': 0.4027, 'grad_norm': 0.1860620230436325, 'learning_rate': 1e-05, 'epoch': 1.98} 66%|██████▋ | 346/522 [21:21:34<11:03:21, 226.14s/it] 66%|██████▋ | 347/522 [21:25:47<11:22:56, 234.15s/it] {'loss': 0.378, 'grad_norm': 0.1878887116909027, 'learning_rate': 1e-05, 'epoch': 1.99} 66%|██████▋ | 347/522 [21:25:47<11:22:56, 234.15s/it] 67%|██████▋ | 348/522 [21:28:54<10:37:57, 219.99s/it] {'loss': 0.3616, 'grad_norm': 0.20891515910625458, 'learning_rate': 1e-05, 'epoch': 1.99} 67%|██████▋ | 348/522 [21:28:54<10:37:57, 219.99s/it] 67%|██████▋ | 349/522 [21:32:48<10:46:02, 224.06s/it] {'loss': 0.3668, 'grad_norm': 0.1791428029537201, 'learning_rate': 1e-05, 'epoch': 2.0} 67%|██████▋ | 349/522 [21:32:48<10:46:02, 224.06s/it] 67%|██████▋ | 350/522 [21:32:54<7:35:28, 158.89s/it] {'loss': 0.2764, 'grad_norm': 0.1791428029537201, 'learning_rate': 1e-05, 'epoch': 2.0} 67%|██████▋ | 350/522 [21:32:54<7:35:28, 158.89s/it] 67%|██████▋ | 351/522 [21:38:57<10:27:09, 220.06s/it] {'loss': 0.3414, 'grad_norm': 0.6552899479866028, 'learning_rate': 1e-05, 'epoch': 2.01} 67%|██████▋ | 351/522 [21:38:57<10:27:09, 220.06s/it] 67%|██████▋ | 352/522 [21:43:03<10:45:19, 227.76s/it] {'loss': 0.3545, 'grad_norm': 0.2690008878707886, 'learning_rate': 1e-05, 'epoch': 2.01} 67%|██████▋ | 352/522 [21:43:03<10:45:19, 227.76s/it] 68%|██████▊ | 353/522 [21:46:43<10:35:09, 225.50s/it] {'loss': 0.3234, 'grad_norm': 0.22666722536087036, 'learning_rate': 1e-05, 'epoch': 2.02} 68%|██████▊ | 353/522 [21:46:43<10:35:09, 225.50s/it] 68%|██████▊ | 354/522 [21:50:05<10:11:43, 218.48s/it] {'loss': 0.3428, 'grad_norm': 0.3185184597969055, 'learning_rate': 1e-05, 'epoch': 2.02} 68%|██████▊ | 354/522 [21:50:05<10:11:43, 218.48s/it] 68%|██████▊ | 355/522 [21:54:00<10:21:52, 223.43s/it] {'loss': 0.3206, 'grad_norm': 0.27285733819007874, 'learning_rate': 1e-05, 'epoch': 2.03} 68%|██████▊ | 355/522 [21:54:00<10:21:52, 223.43s/it] 68%|██████▊ | 356/522 [21:57:51<10:24:10, 225.60s/it] {'loss': 0.3292, 'grad_norm': 0.23944039642810822, 'learning_rate': 1e-05, 'epoch': 2.03} 68%|██████▊ | 356/522 [21:57:51<10:24:10, 225.60s/it] 68%|██████▊ | 357/522 [22:01:57<10:37:35, 231.85s/it] {'loss': 0.3352, 'grad_norm': 0.20759402215480804, 'learning_rate': 1e-05, 'epoch': 2.04} 68%|██████▊ | 357/522 [22:01:57<10:37:35, 231.85s/it] 69%|██████▊ | 358/522 [22:05:46<10:30:47, 230.78s/it] {'loss': 0.3131, 'grad_norm': 0.23229221999645233, 'learning_rate': 1e-05, 'epoch': 2.05} 69%|██████▊ | 358/522 [22:05:46<10:30:47, 230.78s/it] 69%|██████▉ | 359/522 [22:10:03<10:48:36, 238.75s/it] {'loss': 0.3423, 'grad_norm': 0.23911689221858978, 'learning_rate': 1e-05, 'epoch': 2.05} 69%|██████▉ | 359/522 [22:10:03<10:48:36, 238.75s/it] 69%|██████▉ | 360/522 [22:13:39<10:26:02, 231.86s/it] {'loss': 0.2983, 'grad_norm': 0.2150339037179947, 'learning_rate': 1e-05, 'epoch': 2.06} 69%|██████▉ | 360/522 [22:13:39<10:26:02, 231.86s/it] 69%|██████▉ | 361/522 [22:16:59<9:56:31, 222.31s/it] {'loss': 0.3123, 'grad_norm': 0.20684407651424408, 'learning_rate': 1e-05, 'epoch': 2.06} 69%|██████▉ | 361/522 [22:16:59<9:56:31, 222.31s/it] 69%|██████▉ | 362/522 [22:19:50<9:12:05, 207.03s/it] {'loss': 0.3195, 'grad_norm': 0.21363359689712524, 'learning_rate': 1e-05, 'epoch': 2.07} 69%|██████▉ | 362/522 [22:19:50<9:12:05, 207.03s/it] 70%|██████▉ | 363/522 [22:23:27<9:16:12, 209.89s/it] {'loss': 0.3167, 'grad_norm': 0.1965213119983673, 'learning_rate': 1e-05, 'epoch': 2.07} 70%|██████▉ | 363/522 [22:23:27<9:16:12, 209.89s/it] 70%|██████▉ | 364/522 [22:27:10<9:23:34, 214.02s/it] {'loss': 0.3341, 'grad_norm': 0.23243218660354614, 'learning_rate': 1e-05, 'epoch': 2.08} 70%|██████▉ | 364/522 [22:27:10<9:23:34, 214.02s/it] 70%|██████▉ | 365/522 [22:30:28<9:07:10, 209.11s/it] {'loss': 0.3333, 'grad_norm': 0.23584993183612823, 'learning_rate': 1e-05, 'epoch': 2.09} 70%|██████▉ | 365/522 [22:30:28<9:07:10, 209.11s/it] 70%|███████ | 366/522 [22:35:10<10:00:15, 230.87s/it] {'loss': 0.3588, 'grad_norm': 0.18454039096832275, 'learning_rate': 1e-05, 'epoch': 2.09} 70%|███████ | 366/522 [22:35:10<10:00:15, 230.87s/it] 70%|███████ | 367/522 [22:38:33<9:35:01, 222.59s/it] {'loss': 0.3249, 'grad_norm': 0.21377336978912354, 'learning_rate': 1e-05, 'epoch': 2.1} 70%|███████ | 367/522 [22:38:33<9:35:01, 222.59s/it] 70%|███████ | 368/522 [22:42:23<9:37:16, 224.91s/it] {'loss': 0.3336, 'grad_norm': 0.19451841711997986, 'learning_rate': 1e-05, 'epoch': 2.1} 70%|███████ | 368/522 [22:42:23<9:37:16, 224.91s/it] 71%|███████ | 369/522 [22:45:49<9:19:03, 219.24s/it] {'loss': 0.3238, 'grad_norm': 0.18748031556606293, 'learning_rate': 1e-05, 'epoch': 2.11} 71%|███████ | 369/522 [22:45:49<9:19:03, 219.24s/it] 71%|███████ | 370/522 [22:49:53<9:34:15, 226.68s/it] {'loss': 0.3113, 'grad_norm': 0.18917271494865417, 'learning_rate': 1e-05, 'epoch': 2.11} 71%|███████ | 370/522 [22:49:53<9:34:15, 226.68s/it] 71%|███████ | 371/522 [22:53:32<9:24:46, 224.41s/it] {'loss': 0.3194, 'grad_norm': 0.19899535179138184, 'learning_rate': 1e-05, 'epoch': 2.12} 71%|███████ | 371/522 [22:53:32<9:24:46, 224.41s/it] 71%|███████▏ | 372/522 [22:56:57<9:06:18, 218.52s/it] {'loss': 0.3263, 'grad_norm': 0.21914702653884888, 'learning_rate': 1e-05, 'epoch': 2.13} 71%|███████▏ | 372/522 [22:56:57<9:06:18, 218.52s/it] 71%|███████▏ | 373/522 [23:00:36<9:03:09, 218.72s/it] {'loss': 0.3241, 'grad_norm': 0.2111915498971939, 'learning_rate': 1e-05, 'epoch': 2.13} 71%|███████▏ | 373/522 [23:00:36<9:03:09, 218.72s/it] 72%|███████▏ | 374/522 [23:04:04<8:51:14, 215.37s/it] {'loss': 0.3178, 'grad_norm': 0.2062242478132248, 'learning_rate': 1e-05, 'epoch': 2.14} 72%|███████▏ | 374/522 [23:04:04<8:51:14, 215.37s/it] 72%|███████▏ | 375/522 [23:08:01<9:03:15, 221.73s/it] {'loss': 0.3377, 'grad_norm': 0.21022172272205353, 'learning_rate': 1e-05, 'epoch': 2.14} 72%|███████▏ | 375/522 [23:08:01<9:03:15, 221.73s/it] 72%|███████▏ | 376/522 [23:11:27<8:48:31, 217.20s/it] {'loss': 0.3317, 'grad_norm': 0.1946343332529068, 'learning_rate': 1e-05, 'epoch': 2.15} 72%|███████▏ | 376/522 [23:11:27<8:48:31, 217.20s/it] 72%|███████▏ | 377/522 [23:15:05<8:45:30, 217.45s/it] {'loss': 0.3339, 'grad_norm': 0.200165256857872, 'learning_rate': 1e-05, 'epoch': 2.16} 72%|███████▏ | 377/522 [23:15:05<8:45:30, 217.45s/it] 72%|███████▏ | 378/522 [23:18:53<8:49:21, 220.57s/it] {'loss': 0.3125, 'grad_norm': 0.20083366334438324, 'learning_rate': 1e-05, 'epoch': 2.16} 72%|███████▏ | 378/522 [23:18:53<8:49:21, 220.57s/it] 73%|███████▎ | 379/522 [23:22:52<8:58:44, 226.05s/it] {'loss': 0.3307, 'grad_norm': 0.19477520883083344, 'learning_rate': 1e-05, 'epoch': 2.17} 73%|███████▎ | 379/522 [23:22:52<8:58:44, 226.05s/it] 73%|███████▎ | 380/522 [23:26:09<8:34:23, 217.35s/it] {'loss': 0.2984, 'grad_norm': 0.21406316757202148, 'learning_rate': 1e-05, 'epoch': 2.17} 73%|███████▎ | 380/522 [23:26:09<8:34:23, 217.35s/it] 73%|███████▎ | 381/522 [23:29:50<8:33:20, 218.45s/it] {'loss': 0.3078, 'grad_norm': 0.18211780488491058, 'learning_rate': 1e-05, 'epoch': 2.18} 73%|███████▎ | 381/522 [23:29:50<8:33:20, 218.45s/it] 73%|███████▎ | 382/522 [23:33:13<8:18:59, 213.85s/it] {'loss': 0.3078, 'grad_norm': 0.20456579327583313, 'learning_rate': 1e-05, 'epoch': 2.18} 73%|███████▎ | 382/522 [23:33:13<8:18:59, 213.85s/it] 73%|███████▎ | 383/522 [23:37:12<8:33:07, 221.49s/it] {'loss': 0.3483, 'grad_norm': 0.20314082503318787, 'learning_rate': 1e-05, 'epoch': 2.19} 73%|███████▎ | 383/522 [23:37:12<8:33:07, 221.49s/it] 74%|███████▎ | 384/522 [23:41:34<8:57:00, 233.48s/it] {'loss': 0.3407, 'grad_norm': 0.20263607800006866, 'learning_rate': 1e-05, 'epoch': 2.2} 74%|███████▎ | 384/522 [23:41:34<8:57:00, 233.48s/it] 74%|███████▍ | 385/522 [23:45:17<8:45:42, 230.24s/it] {'loss': 0.3261, 'grad_norm': 0.22509407997131348, 'learning_rate': 1e-05, 'epoch': 2.2} 74%|███████▍ | 385/522 [23:45:17<8:45:42, 230.24s/it] 74%|███████▍ | 386/522 [23:48:57<8:34:57, 227.19s/it] {'loss': 0.3057, 'grad_norm': 0.19405777752399445, 'learning_rate': 1e-05, 'epoch': 2.21} 74%|███████▍ | 386/522 [23:48:57<8:34:57, 227.19s/it] 74%|███████▍ | 387/522 [23:52:38<8:27:04, 225.36s/it] {'loss': 0.3294, 'grad_norm': 0.2043442279100418, 'learning_rate': 1e-05, 'epoch': 2.21} 74%|███████▍ | 387/522 [23:52:38<8:27:04, 225.36s/it] 74%|███████▍ | 388/522 [23:56:19<8:20:34, 224.14s/it] {'loss': 0.3249, 'grad_norm': 0.21228884160518646, 'learning_rate': 1e-05, 'epoch': 2.22} 74%|███████▍ | 388/522 [23:56:19<8:20:34, 224.14s/it] 75%|███████▍ | 389/522 [23:59:48<8:06:26, 219.45s/it] {'loss': 0.3383, 'grad_norm': 0.2021314799785614, 'learning_rate': 1e-05, 'epoch': 2.22} 75%|███████▍ | 389/522 [23:59:48<8:06:26, 219.45s/it] 75%|███████▍ | 390/522 [24:03:36<8:08:44, 222.15s/it] {'loss': 0.3372, 'grad_norm': 0.20553581416606903, 'learning_rate': 1e-05, 'epoch': 2.23} 75%|███████▍ | 390/522 [24:03:36<8:08:44, 222.15s/it] 75%|███████▍ | 391/522 [24:06:48<7:45:23, 213.16s/it] {'loss': 0.3101, 'grad_norm': 0.2095128446817398, 'learning_rate': 1e-05, 'epoch': 2.24} 75%|███████▍ | 391/522 [24:06:48<7:45:23, 213.16s/it] 75%|███████▌ | 392/522 [24:10:23<7:42:40, 213.55s/it] {'loss': 0.3223, 'grad_norm': 0.2034343034029007, 'learning_rate': 1e-05, 'epoch': 2.24} 75%|███████▌ | 392/522 [24:10:23<7:42:40, 213.55s/it] 75%|███████▌ | 393/522 [24:14:29<8:00:23, 223.44s/it] {'loss': 0.342, 'grad_norm': 0.19158557057380676, 'learning_rate': 1e-05, 'epoch': 2.25} 75%|███████▌ | 393/522 [24:14:29<8:00:23, 223.44s/it] 75%|███████▌ | 394/522 [24:18:21<8:01:59, 225.93s/it] {'loss': 0.33, 'grad_norm': 0.18197081983089447, 'learning_rate': 1e-05, 'epoch': 2.25} 75%|███████▌ | 394/522 [24:18:21<8:01:59, 225.93s/it] 76%|███████▌ | 395/522 [24:21:58<7:52:44, 223.34s/it] {'loss': 0.342, 'grad_norm': 0.20841264724731445, 'learning_rate': 1e-05, 'epoch': 2.26} 76%|███████▌ | 395/522 [24:21:58<7:52:44, 223.34s/it] 76%|███████▌ | 396/522 [24:26:04<8:02:52, 229.94s/it] {'loss': 0.345, 'grad_norm': 0.17488549649715424, 'learning_rate': 1e-05, 'epoch': 2.26} 76%|███████▌ | 396/522 [24:26:04<8:02:52, 229.94s/it] 76%|███████▌ | 397/522 [24:29:39<7:50:17, 225.74s/it] {'loss': 0.3088, 'grad_norm': 0.19985169172286987, 'learning_rate': 1e-05, 'epoch': 2.27} 76%|███████▌ | 397/522 [24:29:39<7:50:17, 225.74s/it] 76%|███████▌ | 398/522 [24:33:28<7:48:35, 226.73s/it] {'loss': 0.3412, 'grad_norm': 0.21897201240062714, 'learning_rate': 1e-05, 'epoch': 2.28} 76%|███████▌ | 398/522 [24:33:28<7:48:35, 226.73s/it] 76%|███████▋ | 399/522 [24:37:06<7:38:57, 223.88s/it] {'loss': 0.3165, 'grad_norm': 0.20647142827510834, 'learning_rate': 1e-05, 'epoch': 2.28} 76%|███████▋ | 399/522 [24:37:06<7:38:57, 223.88s/it] 77%|███████▋ | 400/522 [24:40:38<7:28:21, 220.50s/it] {'loss': 0.353, 'grad_norm': 0.19401617348194122, 'learning_rate': 1e-05, 'epoch': 2.29} 77%|███████▋ | 400/522 [24:40:38<7:28:21, 220.50s/it] 77%|███████▋ | 401/522 [24:44:37<7:35:53, 226.07s/it] {'loss': 0.3432, 'grad_norm': 0.20690138638019562, 'learning_rate': 1e-05, 'epoch': 2.29} 77%|███████▋ | 401/522 [24:44:37<7:35:53, 226.07s/it] 77%|███████▋ | 402/522 [24:48:06<7:21:25, 220.71s/it] {'loss': 0.3368, 'grad_norm': 0.19214214384555817, 'learning_rate': 1e-05, 'epoch': 2.3} 77%|███████▋ | 402/522 [24:48:06<7:21:25, 220.71s/it] 77%|███████▋ | 403/522 [24:51:36<7:11:41, 217.66s/it] {'loss': 0.3221, 'grad_norm': 0.19301293790340424, 'learning_rate': 1e-05, 'epoch': 2.3} 77%|███████▋ | 403/522 [24:51:36<7:11:41, 217.66s/it] 77%|███████▋ | 404/522 [24:55:53<7:30:56, 229.29s/it] {'loss': 0.3707, 'grad_norm': 0.19430281221866608, 'learning_rate': 1e-05, 'epoch': 2.31} 77%|███████▋ | 404/522 [24:55:53<7:30:56, 229.29s/it] 78%|███████▊ | 405/522 [24:59:01<7:03:01, 216.94s/it] {'loss': 0.3122, 'grad_norm': 0.18634715676307678, 'learning_rate': 1e-05, 'epoch': 2.32} 78%|███████▊ | 405/522 [24:59:01<7:03:01, 216.94s/it] 78%|███████▊ | 406/522 [25:02:51<7:07:18, 221.02s/it] {'loss': 0.3195, 'grad_norm': 0.19843697547912598, 'learning_rate': 1e-05, 'epoch': 2.32} 78%|███████▊ | 406/522 [25:02:51<7:07:18, 221.02s/it] 78%|███████▊ | 407/522 [25:06:28<7:01:01, 219.66s/it] {'loss': 0.3217, 'grad_norm': 0.20077399909496307, 'learning_rate': 1e-05, 'epoch': 2.33} 78%|███████▊ | 407/522 [25:06:28<7:01:01, 219.66s/it] 78%|███████▊ | 408/522 [25:09:46<6:44:54, 213.11s/it] {'loss': 0.3171, 'grad_norm': 0.19979357719421387, 'learning_rate': 1e-05, 'epoch': 2.33} 78%|███████▊ | 408/522 [25:09:46<6:44:54, 213.11s/it] 78%|███████▊ | 409/522 [25:13:23<6:43:51, 214.44s/it] {'loss': 0.3063, 'grad_norm': 0.1913745254278183, 'learning_rate': 1e-05, 'epoch': 2.34} 78%|███████▊ | 409/522 [25:13:23<6:43:51, 214.44s/it] 79%|███████▊ | 410/522 [25:16:37<6:29:00, 208.40s/it] {'loss': 0.3045, 'grad_norm': 0.20011870563030243, 'learning_rate': 1e-05, 'epoch': 2.34} 79%|███████▊ | 410/522 [25:16:37<6:29:00, 208.40s/it] 79%|███████▊ | 411/522 [25:20:19<6:32:40, 212.26s/it] {'loss': 0.3253, 'grad_norm': 0.19648033380508423, 'learning_rate': 1e-05, 'epoch': 2.35} 79%|███████▊ | 411/522 [25:20:19<6:32:40, 212.26s/it] 79%|███████▉ | 412/522 [25:23:51<6:29:02, 212.21s/it] {'loss': 0.3222, 'grad_norm': 0.19994479417800903, 'learning_rate': 1e-05, 'epoch': 2.36} 79%|███████▉ | 412/522 [25:23:51<6:29:02, 212.21s/it] 79%|███████▉ | 413/522 [25:27:19<6:23:06, 210.88s/it] {'loss': 0.3199, 'grad_norm': 0.19936294853687286, 'learning_rate': 1e-05, 'epoch': 2.36} 79%|███████▉ | 413/522 [25:27:19<6:23:06, 210.88s/it] 79%|███████▉ | 414/522 [25:30:54<6:21:48, 212.11s/it] {'loss': 0.3148, 'grad_norm': 0.1923866868019104, 'learning_rate': 1e-05, 'epoch': 2.37} 79%|███████▉ | 414/522 [25:30:54<6:21:48, 212.11s/it] 80%|███████▉ | 415/522 [25:34:56<6:34:16, 221.09s/it] {'loss': 0.3431, 'grad_norm': 0.21005482971668243, 'learning_rate': 1e-05, 'epoch': 2.37} 80%|███████▉ | 415/522 [25:34:56<6:34:16, 221.09s/it] 80%|███████▉ | 416/522 [25:38:53<6:39:02, 225.87s/it] {'loss': 0.3546, 'grad_norm': 0.23980742692947388, 'learning_rate': 1e-05, 'epoch': 2.38} 80%|███████▉ | 416/522 [25:38:53<6:39:02, 225.87s/it] 80%|███████▉ | 417/522 [25:42:31<6:31:19, 223.62s/it] {'loss': 0.3229, 'grad_norm': 0.2002897709608078, 'learning_rate': 1e-05, 'epoch': 2.38} 80%|███████▉ | 417/522 [25:42:31<6:31:19, 223.62s/it] 80%|████████ | 418/522 [25:46:18<6:29:13, 224.55s/it] {'loss': 0.3427, 'grad_norm': 0.24188187718391418, 'learning_rate': 1e-05, 'epoch': 2.39} 80%|████████ | 418/522 [25:46:18<6:29:13, 224.55s/it] 80%|████████ | 419/522 [25:49:51<6:19:50, 221.27s/it] {'loss': 0.3186, 'grad_norm': 0.18756000697612762, 'learning_rate': 1e-05, 'epoch': 2.4} 80%|████████ | 419/522 [25:49:51<6:19:50, 221.27s/it] 80%|████████ | 420/522 [25:54:00<6:30:09, 229.50s/it] {'loss': 0.3617, 'grad_norm': 0.1947186142206192, 'learning_rate': 1e-05, 'epoch': 2.4} 80%|████████ | 420/522 [25:54:00<6:30:09, 229.50s/it] 81%|████████ | 421/522 [25:57:44<6:23:22, 227.75s/it] {'loss': 0.3291, 'grad_norm': 0.18078337609767914, 'learning_rate': 1e-05, 'epoch': 2.41} 81%|████████ | 421/522 [25:57:44<6:23:22, 227.75s/it] 81%|████████ | 422/522 [26:01:21<6:14:20, 224.61s/it] {'loss': 0.3109, 'grad_norm': 0.19292724132537842, 'learning_rate': 1e-05, 'epoch': 2.41} 81%|████████ | 422/522 [26:01:21<6:14:20, 224.61s/it] 81%|████████ | 423/522 [26:05:04<6:09:53, 224.18s/it] {'loss': 0.3252, 'grad_norm': 0.18810859322547913, 'learning_rate': 1e-05, 'epoch': 2.42} 81%|████████ | 423/522 [26:05:04<6:09:53, 224.18s/it] 81%|████████ | 424/522 [26:08:58<6:11:08, 227.23s/it] {'loss': 0.3453, 'grad_norm': 0.2121863216161728, 'learning_rate': 1e-05, 'epoch': 2.43} 81%|████████ | 424/522 [26:08:58<6:11:08, 227.23s/it] 81%|████████▏ | 425/522 [26:12:56<6:12:11, 230.22s/it] {'loss': 0.3162, 'grad_norm': 0.1939612329006195, 'learning_rate': 1e-05, 'epoch': 2.43} 81%|████████▏ | 425/522 [26:12:56<6:12:11, 230.22s/it] 82%|████████▏ | 426/522 [26:16:31<6:01:10, 225.74s/it] {'loss': 0.3155, 'grad_norm': 0.1975681036710739, 'learning_rate': 1e-05, 'epoch': 2.44} 82%|████████▏ | 426/522 [26:16:31<6:01:10, 225.74s/it] 82%|████████▏ | 427/522 [26:20:18<5:57:58, 226.09s/it] {'loss': 0.32, 'grad_norm': 0.205978125333786, 'learning_rate': 1e-05, 'epoch': 2.44} 82%|████████▏ | 427/522 [26:20:18<5:57:58, 226.09s/it] 82%|████████▏ | 428/522 [26:24:31<6:07:00, 234.26s/it] {'loss': 0.3454, 'grad_norm': 0.22776463627815247, 'learning_rate': 1e-05, 'epoch': 2.45} 82%|████████▏ | 428/522 [26:24:31<6:07:00, 234.26s/it] 82%|████████▏ | 429/522 [26:28:33<6:06:38, 236.54s/it] {'loss': 0.349, 'grad_norm': 0.18255238234996796, 'learning_rate': 1e-05, 'epoch': 2.45} 82%|████████▏ | 429/522 [26:28:33<6:06:38, 236.54s/it] 82%|████████▏ | 430/522 [26:32:02<5:50:10, 228.37s/it] {'loss': 0.3157, 'grad_norm': 0.20836684107780457, 'learning_rate': 1e-05, 'epoch': 2.46} 82%|████████▏ | 430/522 [26:32:02<5:50:10, 228.37s/it] 83%|████████▎ | 431/522 [26:36:06<5:53:18, 232.95s/it] {'loss': 0.3397, 'grad_norm': 0.19470524787902832, 'learning_rate': 1e-05, 'epoch': 2.47} 83%|████████▎ | 431/522 [26:36:06<5:53:18, 232.95s/it] 83%|████████▎ | 432/522 [26:39:43<5:42:02, 228.03s/it] {'loss': 0.3267, 'grad_norm': 0.19728140532970428, 'learning_rate': 1e-05, 'epoch': 2.47} 83%|████████▎ | 432/522 [26:39:43<5:42:02, 228.03s/it] 83%|████████▎ | 433/522 [26:43:45<5:44:30, 232.26s/it] {'loss': 0.3462, 'grad_norm': 0.2073633074760437, 'learning_rate': 1e-05, 'epoch': 2.48} 83%|████████▎ | 433/522 [26:43:45<5:44:30, 232.26s/it] 83%|████████▎ | 434/522 [26:47:16<5:31:20, 225.91s/it] {'loss': 0.326, 'grad_norm': 0.1839035600423813, 'learning_rate': 1e-05, 'epoch': 2.48} 83%|████████▎ | 434/522 [26:47:16<5:31:20, 225.91s/it] 83%|████████▎ | 435/522 [26:51:21<5:36:11, 231.85s/it] {'loss': 0.3397, 'grad_norm': 0.2321394383907318, 'learning_rate': 1e-05, 'epoch': 2.49} 83%|████████▎ | 435/522 [26:51:21<5:36:11, 231.85s/it] 84%|████████▎ | 436/522 [26:54:41<5:18:30, 222.22s/it] {'loss': 0.3268, 'grad_norm': 0.20299150049686432, 'learning_rate': 1e-05, 'epoch': 2.49} 84%|████████▎ | 436/522 [26:54:41<5:18:30, 222.22s/it] 84%|████████▎ | 437/522 [26:58:27<5:16:32, 223.44s/it] {'loss': 0.3498, 'grad_norm': 0.2300529032945633, 'learning_rate': 1e-05, 'epoch': 2.5} 84%|████████▎ | 437/522 [26:58:27<5:16:32, 223.44s/it] 84%|████████▍ | 438/522 [27:02:27<5:19:43, 228.38s/it] {'loss': 0.3133, 'grad_norm': 0.1825723648071289, 'learning_rate': 1e-05, 'epoch': 2.51} 84%|████████▍ | 438/522 [27:02:27<5:19:43, 228.38s/it] 84%|████████▍ | 439/522 [27:06:37<5:24:52, 234.85s/it] {'loss': 0.3277, 'grad_norm': 0.2131003886461258, 'learning_rate': 1e-05, 'epoch': 2.51} 84%|████████▍ | 439/522 [27:06:37<5:24:52, 234.85s/it] 84%|████████▍ | 440/522 [27:10:35<5:22:15, 235.80s/it] {'loss': 0.3355, 'grad_norm': 0.21404753625392914, 'learning_rate': 1e-05, 'epoch': 2.52} 84%|████████▍ | 440/522 [27:10:35<5:22:15, 235.80s/it] 84%|████████▍ | 441/522 [27:14:44<5:23:24, 239.57s/it] {'loss': 0.3503, 'grad_norm': 0.17014595866203308, 'learning_rate': 1e-05, 'epoch': 2.52} 84%|████████▍ | 441/522 [27:14:44<5:23:24, 239.57s/it] 85%|████████▍ | 442/522 [27:18:32<5:14:52, 236.15s/it] {'loss': 0.343, 'grad_norm': 0.22130757570266724, 'learning_rate': 1e-05, 'epoch': 2.53} 85%|████████▍ | 442/522 [27:18:32<5:14:52, 236.15s/it] 85%|████████▍ | 443/522 [27:21:49<4:55:24, 224.36s/it] {'loss': 0.3201, 'grad_norm': 0.22886283695697784, 'learning_rate': 1e-05, 'epoch': 2.53} 85%|████████▍ | 443/522 [27:21:49<4:55:24, 224.36s/it] 85%|████████▌ | 444/522 [27:25:31<4:51:02, 223.88s/it] {'loss': 0.3123, 'grad_norm': 0.21518419682979584, 'learning_rate': 1e-05, 'epoch': 2.54} 85%|████████▌ | 444/522 [27:25:32<4:51:02, 223.88s/it] 85%|████████▌ | 445/522 [27:29:07<4:44:05, 221.37s/it] {'loss': 0.3271, 'grad_norm': 0.1829151213169098, 'learning_rate': 1e-05, 'epoch': 2.55} 85%|████████▌ | 445/522 [27:29:07<4:44:05, 221.37s/it] 85%|████████▌ | 446/522 [27:32:40<4:37:19, 218.94s/it] {'loss': 0.3223, 'grad_norm': 0.19354581832885742, 'learning_rate': 1e-05, 'epoch': 2.55} 85%|████████▌ | 446/522 [27:32:40<4:37:19, 218.94s/it] 86%|████████▌ | 447/522 [27:36:41<4:41:47, 225.43s/it] {'loss': 0.3331, 'grad_norm': 0.19424208998680115, 'learning_rate': 1e-05, 'epoch': 2.56} 86%|████████▌ | 447/522 [27:36:41<4:41:47, 225.43s/it] 86%|████████▌ | 448/522 [27:40:27<4:38:22, 225.70s/it] {'loss': 0.3299, 'grad_norm': 0.18997381627559662, 'learning_rate': 1e-05, 'epoch': 2.56} 86%|████████▌ | 448/522 [27:40:27<4:38:22, 225.70s/it] 86%|████████▌ | 449/522 [27:44:16<4:35:36, 226.53s/it] {'loss': 0.3366, 'grad_norm': 0.18682202696800232, 'learning_rate': 1e-05, 'epoch': 2.57} 86%|████████▌ | 449/522 [27:44:16<4:35:36, 226.53s/it] 86%|████████▌ | 450/522 [27:47:41<4:24:22, 220.31s/it] {'loss': 0.2999, 'grad_norm': 0.18609148263931274, 'learning_rate': 1e-05, 'epoch': 2.57} 86%|████████▌ | 450/522 [27:47:41<4:24:22, 220.31s/it] 86%|████████▋ | 451/522 [27:51:27<4:22:27, 221.79s/it] {'loss': 0.3253, 'grad_norm': 0.2137542963027954, 'learning_rate': 1e-05, 'epoch': 2.58} 86%|████████▋ | 451/522 [27:51:27<4:22:27, 221.79s/it] 87%|████████▋ | 452/522 [27:55:01<4:16:04, 219.50s/it] {'loss': 0.3067, 'grad_norm': 0.2160153090953827, 'learning_rate': 1e-05, 'epoch': 2.59} 87%|████████▋ | 452/522 [27:55:01<4:16:04, 219.50s/it] 87%|████████▋ | 453/522 [27:58:44<4:13:37, 220.55s/it] {'loss': 0.3152, 'grad_norm': 0.17392562329769135, 'learning_rate': 1e-05, 'epoch': 2.59} 87%|████████▋ | 453/522 [27:58:44<4:13:37, 220.55s/it] 87%|████████▋ | 454/522 [28:02:46<4:17:18, 227.04s/it] {'loss': 0.337, 'grad_norm': 0.1994914412498474, 'learning_rate': 1e-05, 'epoch': 2.6} 87%|████████▋ | 454/522 [28:02:46<4:17:18, 227.04s/it] 87%|████████▋ | 455/522 [28:06:31<4:12:45, 226.36s/it] {'loss': 0.333, 'grad_norm': 0.21025247871875763, 'learning_rate': 1e-05, 'epoch': 2.6} 87%|████████▋ | 455/522 [28:06:31<4:12:45, 226.36s/it] 87%|████████▋ | 456/522 [28:10:29<4:13:00, 230.00s/it] {'loss': 0.3454, 'grad_norm': 0.2912832200527191, 'learning_rate': 1e-05, 'epoch': 2.61} 87%|████████▋ | 456/522 [28:10:29<4:13:00, 230.00s/it] 88%|████████▊ | 457/522 [28:14:12<4:06:44, 227.75s/it] {'loss': 0.343, 'grad_norm': 0.2113860845565796, 'learning_rate': 1e-05, 'epoch': 2.61} 88%|████████▊ | 457/522 [28:14:12<4:06:44, 227.75s/it] 88%|████████▊ | 458/522 [28:18:05<4:04:38, 229.35s/it] {'loss': 0.3321, 'grad_norm': 0.19359906017780304, 'learning_rate': 1e-05, 'epoch': 2.62} 88%|████████▊ | 458/522 [28:18:05<4:04:38, 229.35s/it] 88%|████████▊ | 459/522 [28:22:06<4:04:22, 232.73s/it] {'loss': 0.3122, 'grad_norm': 0.2071603536605835, 'learning_rate': 1e-05, 'epoch': 2.63} 88%|████████▊ | 459/522 [28:22:06<4:04:22, 232.73s/it] 88%|████████▊ | 460/522 [28:25:54<3:59:05, 231.38s/it] {'loss': 0.3132, 'grad_norm': 0.20303678512573242, 'learning_rate': 1e-05, 'epoch': 2.63} 88%|████████▊ | 460/522 [28:25:54<3:59:05, 231.38s/it] 88%|████████▊ | 461/522 [28:29:49<3:56:20, 232.47s/it] {'loss': 0.362, 'grad_norm': 0.19759643077850342, 'learning_rate': 1e-05, 'epoch': 2.64} 88%|████████▊ | 461/522 [28:29:49<3:56:20, 232.47s/it] 89%|████████▊ | 462/522 [28:33:37<3:51:10, 231.17s/it] {'loss': 0.3433, 'grad_norm': 0.1893080323934555, 'learning_rate': 1e-05, 'epoch': 2.64} 89%|████████▊ | 462/522 [28:33:37<3:51:10, 231.17s/it] 89%|████████▊ | 463/522 [28:37:23<3:45:44, 229.56s/it] {'loss': 0.3227, 'grad_norm': 0.19113117456436157, 'learning_rate': 1e-05, 'epoch': 2.65} 89%|████████▊ | 463/522 [28:37:23<3:45:44, 229.56s/it] 89%|████████▉ | 464/522 [28:40:46<3:34:19, 221.72s/it] {'loss': 0.3289, 'grad_norm': 0.20868529379367828, 'learning_rate': 1e-05, 'epoch': 2.65} 89%|████████▉ | 464/522 [28:40:46<3:34:19, 221.72s/it] 89%|████████▉ | 465/522 [28:43:59<3:22:27, 213.12s/it] {'loss': 0.3319, 'grad_norm': 0.19884617626667023, 'learning_rate': 1e-05, 'epoch': 2.66} 89%|████████▉ | 465/522 [28:43:59<3:22:27, 213.12s/it] 89%|████████▉ | 466/522 [28:48:02<3:27:09, 221.95s/it] {'loss': 0.3526, 'grad_norm': 0.18575598299503326, 'learning_rate': 1e-05, 'epoch': 2.67} 89%|████████▉ | 466/522 [28:48:02<3:27:09, 221.95s/it] 89%|████████▉ | 467/522 [28:51:20<3:16:51, 214.76s/it] {'loss': 0.3233, 'grad_norm': 0.1963566690683365, 'learning_rate': 1e-05, 'epoch': 2.67} 89%|████████▉ | 467/522 [28:51:20<3:16:51, 214.76s/it] 90%|████████▉ | 468/522 [28:55:06<3:16:26, 218.27s/it] {'loss': 0.3433, 'grad_norm': 0.2085961401462555, 'learning_rate': 1e-05, 'epoch': 2.68} 90%|████████▉ | 468/522 [28:55:06<3:16:26, 218.27s/it] 90%|████████▉ | 469/522 [28:58:41<3:12:00, 217.37s/it] {'loss': 0.324, 'grad_norm': 0.18208985030651093, 'learning_rate': 1e-05, 'epoch': 2.68} 90%|████████▉ | 469/522 [28:58:41<3:12:00, 217.37s/it] 90%|█████████ | 470/522 [29:02:33<3:12:02, 221.58s/it] {'loss': 0.344, 'grad_norm': 0.1865570843219757, 'learning_rate': 1e-05, 'epoch': 2.69} 90%|█████████ | 470/522 [29:02:33<3:12:02, 221.58s/it] 90%|█████████ | 471/522 [29:05:53<3:02:53, 215.16s/it] {'loss': 0.3249, 'grad_norm': 0.20776090025901794, 'learning_rate': 1e-05, 'epoch': 2.7} 90%|█████████ | 471/522 [29:05:53<3:02:53, 215.16s/it] 90%|█████████ | 472/522 [29:09:18<2:56:52, 212.24s/it] {'loss': 0.3274, 'grad_norm': 0.18766598403453827, 'learning_rate': 1e-05, 'epoch': 2.7} 90%|█████████ | 472/522 [29:09:18<2:56:52, 212.24s/it] 91%|█████████ | 473/522 [29:13:15<2:59:17, 219.55s/it] {'loss': 0.3497, 'grad_norm': 0.2031916230916977, 'learning_rate': 1e-05, 'epoch': 2.71} 91%|█████████ | 473/522 [29:13:15<2:59:17, 219.55s/it] 91%|█████████ | 474/522 [29:17:02<2:57:31, 221.91s/it] {'loss': 0.3356, 'grad_norm': 0.18549303710460663, 'learning_rate': 1e-05, 'epoch': 2.71} 91%|█████████ | 474/522 [29:17:02<2:57:31, 221.91s/it] 91%|█████████ | 475/522 [29:21:08<2:59:27, 229.09s/it] {'loss': 0.3486, 'grad_norm': 0.22060562670230865, 'learning_rate': 1e-05, 'epoch': 2.72} 91%|█████████ | 475/522 [29:21:08<2:59:27, 229.09s/it] 91%|█████████ | 476/522 [29:24:37<2:50:54, 222.93s/it] {'loss': 0.3498, 'grad_norm': 0.19661520421504974, 'learning_rate': 1e-05, 'epoch': 2.72} 91%|█████████ | 476/522 [29:24:37<2:50:54, 222.93s/it] 91%|█████████▏| 477/522 [29:28:11<2:45:06, 220.14s/it] {'loss': 0.3333, 'grad_norm': 0.18935753405094147, 'learning_rate': 1e-05, 'epoch': 2.73} 91%|█████████▏| 477/522 [29:28:11<2:45:06, 220.14s/it] 92%|█████████▏| 478/522 [29:31:31<2:37:03, 214.16s/it] {'loss': 0.3186, 'grad_norm': 0.20274382829666138, 'learning_rate': 1e-05, 'epoch': 2.74} 92%|█████████▏| 478/522 [29:31:31<2:37:03, 214.16s/it] 92%|█████████▏| 479/522 [29:34:58<2:32:01, 212.14s/it] {'loss': 0.3281, 'grad_norm': 0.19557617604732513, 'learning_rate': 1e-05, 'epoch': 2.74} 92%|█████████▏| 479/522 [29:34:58<2:32:01, 212.14s/it] 92%|█████████▏| 480/522 [29:38:08<2:23:53, 205.57s/it] {'loss': 0.2961, 'grad_norm': 0.2069191038608551, 'learning_rate': 1e-05, 'epoch': 2.75} 92%|█████████▏| 480/522 [29:38:08<2:23:53, 205.57s/it] 92%|█████████▏| 481/522 [29:41:53<2:24:26, 211.37s/it] {'loss': 0.3442, 'grad_norm': 0.17858579754829407, 'learning_rate': 1e-05, 'epoch': 2.75} 92%|█████████▏| 481/522 [29:41:53<2:24:26, 211.37s/it] 92%|█████████▏| 482/522 [29:45:49<2:25:47, 218.69s/it] {'loss': 0.3418, 'grad_norm': 0.2025424838066101, 'learning_rate': 1e-05, 'epoch': 2.76} 92%|█████████▏| 482/522 [29:45:49<2:25:47, 218.69s/it] 93%|█████████▎| 483/522 [29:50:00<2:28:22, 228.26s/it] {'loss': 0.3272, 'grad_norm': 0.18787382543087006, 'learning_rate': 1e-05, 'epoch': 2.76} 93%|█████████▎| 483/522 [29:50:00<2:28:22, 228.26s/it] 93%|█████████▎| 484/522 [29:54:15<2:29:45, 236.45s/it] {'loss': 0.3404, 'grad_norm': 0.18009011447429657, 'learning_rate': 1e-05, 'epoch': 2.77} 93%|█████████▎| 484/522 [29:54:15<2:29:45, 236.45s/it] 93%|█████████▎| 485/522 [29:57:56<2:22:58, 231.85s/it] {'loss': 0.3289, 'grad_norm': 0.19508713483810425, 'learning_rate': 1e-05, 'epoch': 2.78} 93%|█████████▎| 485/522 [29:57:56<2:22:58, 231.85s/it] 93%|█████████▎| 486/522 [30:01:57<2:20:39, 234.42s/it] {'loss': 0.3563, 'grad_norm': 0.18371868133544922, 'learning_rate': 1e-05, 'epoch': 2.78} 93%|█████████▎| 486/522 [30:01:57<2:20:39, 234.42s/it] 93%|█████████▎| 487/522 [30:05:34<2:13:42, 229.21s/it] {'loss': 0.3326, 'grad_norm': 0.2004774808883667, 'learning_rate': 1e-05, 'epoch': 2.79} 93%|█████████▎| 487/522 [30:05:34<2:13:42, 229.21s/it] 93%|█████████▎| 488/522 [30:09:19<2:09:07, 227.87s/it] {'loss': 0.3394, 'grad_norm': 0.173689067363739, 'learning_rate': 1e-05, 'epoch': 2.79} 93%|█████████▎| 488/522 [30:09:19<2:09:07, 227.87s/it] 94%|█████████▎| 489/522 [30:13:36<2:10:16, 236.86s/it] {'loss': 0.3545, 'grad_norm': 0.18115942180156708, 'learning_rate': 1e-05, 'epoch': 2.8} 94%|█████████▎| 489/522 [30:13:36<2:10:16, 236.86s/it] 94%|█████████▍| 490/522 [30:17:23<2:04:40, 233.78s/it] {'loss': 0.3114, 'grad_norm': 0.19188688695430756, 'learning_rate': 1e-05, 'epoch': 2.8} 94%|█████████▍| 490/522 [30:17:23<2:04:40, 233.78s/it] 94%|█████████▍| 491/522 [30:21:12<2:00:03, 232.37s/it] {'loss': 0.3215, 'grad_norm': 0.18451005220413208, 'learning_rate': 1e-05, 'epoch': 2.81} 94%|█████████▍| 491/522 [30:21:12<2:00:03, 232.37s/it] 94%|█████████▍| 492/522 [30:24:49<1:53:50, 227.67s/it] {'loss': 0.3519, 'grad_norm': 0.19277305901050568, 'learning_rate': 1e-05, 'epoch': 2.82} 94%|█████████▍| 492/522 [30:24:49<1:53:50, 227.67s/it] 94%|█████████▍| 493/522 [30:28:58<1:53:13, 234.25s/it] {'loss': 0.3549, 'grad_norm': 0.2019367516040802, 'learning_rate': 1e-05, 'epoch': 2.82} 94%|█████████▍| 493/522 [30:28:58<1:53:13, 234.25s/it] 95%|█████████▍| 494/522 [30:32:27<1:45:47, 226.69s/it] {'loss': 0.3453, 'grad_norm': 0.22473189234733582, 'learning_rate': 1e-05, 'epoch': 2.83} 95%|█████████▍| 494/522 [30:32:27<1:45:47, 226.69s/it] 95%|█████████▍| 495/522 [30:36:11<1:41:32, 225.65s/it] {'loss': 0.3443, 'grad_norm': 0.20738038420677185, 'learning_rate': 1e-05, 'epoch': 2.83} 95%|█████████▍| 495/522 [30:36:11<1:41:32, 225.65s/it] 95%|█████████▌| 496/522 [30:39:46<1:36:29, 222.66s/it] {'loss': 0.3099, 'grad_norm': 0.19278432428836823, 'learning_rate': 1e-05, 'epoch': 2.84} 95%|█████████▌| 496/522 [30:39:46<1:36:29, 222.66s/it] 95%|█████████▌| 497/522 [30:44:14<1:38:27, 236.31s/it] {'loss': 0.3505, 'grad_norm': 0.19492597877979279, 'learning_rate': 1e-05, 'epoch': 2.84} 95%|█████████▌| 497/522 [30:44:14<1:38:27, 236.31s/it] 95%|█████████▌| 498/522 [30:47:51<1:32:09, 230.41s/it] {'loss': 0.3287, 'grad_norm': 0.20543166995048523, 'learning_rate': 1e-05, 'epoch': 2.85} 95%|█████████▌| 498/522 [30:47:51<1:32:09, 230.41s/it] 96%|█████████▌| 499/522 [30:51:16<1:25:23, 222.75s/it] {'loss': 0.3329, 'grad_norm': 0.19126810133457184, 'learning_rate': 1e-05, 'epoch': 2.86} 96%|█████████▌| 499/522 [30:51:16<1:25:23, 222.75s/it] 96%|█████████▌| 500/522 [30:55:09<1:22:46, 225.76s/it] {'loss': 0.3378, 'grad_norm': 0.17765697836875916, 'learning_rate': 1e-05, 'epoch': 2.86} 96%|█████████▌| 500/522 [30:55:09<1:22:46, 225.76s/it] 96%|█████████▌| 501/522 [30:59:20<1:21:41, 233.41s/it] {'loss': 0.3416, 'grad_norm': 0.19233906269073486, 'learning_rate': 1e-05, 'epoch': 2.87} 96%|█████████▌| 501/522 [30:59:20<1:21:41, 233.41s/it] 96%|█████████▌| 502/522 [31:03:07<1:17:11, 231.58s/it] {'loss': 0.318, 'grad_norm': 0.18257667124271393, 'learning_rate': 1e-05, 'epoch': 2.87} 96%|█████████▌| 502/522 [31:03:07<1:17:11, 231.58s/it] 96%|█████████▋| 503/522 [31:06:49<1:12:23, 228.60s/it] {'loss': 0.3526, 'grad_norm': 0.1960505247116089, 'learning_rate': 1e-05, 'epoch': 2.88} 96%|█████████▋| 503/522 [31:06:49<1:12:23, 228.60s/it] 97%|█████████▋| 504/522 [31:10:23<1:07:17, 224.33s/it] {'loss': 0.3211, 'grad_norm': 0.1909596025943756, 'learning_rate': 1e-05, 'epoch': 2.88} 97%|█████████▋| 504/522 [31:10:23<1:07:17, 224.33s/it] 97%|█████████▋| 505/522 [31:13:41<1:01:15, 216.22s/it] {'loss': 0.3152, 'grad_norm': 0.19874423742294312, 'learning_rate': 1e-05, 'epoch': 2.89} 97%|█████████▋| 505/522 [31:13:41<1:01:15, 216.22s/it] 97%|█████████▋| 506/522 [31:17:06<56:47, 212.94s/it] {'loss': 0.3179, 'grad_norm': 0.20546576380729675, 'learning_rate': 1e-05, 'epoch': 2.9} 97%|█████████▋| 506/522 [31:17:06<56:47, 212.94s/it] 97%|█████████▋| 507/522 [31:21:27<56:49, 227.33s/it] {'loss': 0.348, 'grad_norm': 0.18216243386268616, 'learning_rate': 1e-05, 'epoch': 2.9} 97%|█████████▋| 507/522 [31:21:27<56:49, 227.33s/it] 97%|█████████▋| 508/522 [31:25:15<53:04, 227.46s/it] {'loss': 0.3376, 'grad_norm': 0.1734856367111206, 'learning_rate': 1e-05, 'epoch': 2.91} 97%|█████████▋| 508/522 [31:25:15<53:04, 227.46s/it] 98%|█████████▊| 509/522 [31:29:10<49:48, 229.87s/it] {'loss': 0.3471, 'grad_norm': 0.20031586289405823, 'learning_rate': 1e-05, 'epoch': 2.91} 98%|█████████▊| 509/522 [31:29:10<49:48, 229.87s/it] 98%|█████████▊| 510/522 [31:32:30<44:10, 220.85s/it] {'loss': 0.3165, 'grad_norm': 0.19381840527057648, 'learning_rate': 1e-05, 'epoch': 2.92} 98%|█████████▊| 510/522 [31:32:30<44:10, 220.85s/it] 98%|█████████▊| 511/522 [31:35:50<39:20, 214.63s/it] {'loss': 0.345, 'grad_norm': 0.2109679877758026, 'learning_rate': 1e-05, 'epoch': 2.92} 98%|█████████▊| 511/522 [31:35:50<39:20, 214.63s/it] 98%|█████████▊| 512/522 [31:40:12<38:09, 228.95s/it] {'loss': 0.3383, 'grad_norm': 0.19906644523143768, 'learning_rate': 1e-05, 'epoch': 2.93} 98%|█████████▊| 512/522 [31:40:12<38:09, 228.95s/it] 98%|█████████▊| 513/522 [31:44:05<34:30, 230.00s/it] {'loss': 0.3281, 'grad_norm': 0.1887241154909134, 'learning_rate': 1e-05, 'epoch': 2.94} 98%|█████████▊| 513/522 [31:44:05<34:30, 230.00s/it] 98%|█████████▊| 514/522 [31:47:47<30:21, 227.74s/it] {'loss': 0.3172, 'grad_norm': 0.1919076293706894, 'learning_rate': 1e-05, 'epoch': 2.94} 98%|█████████▊| 514/522 [31:47:47<30:21, 227.74s/it] 99%|█████████▊| 515/522 [31:51:35<26:33, 227.63s/it] {'loss': 0.3116, 'grad_norm': 0.1859419047832489, 'learning_rate': 1e-05, 'epoch': 2.95} 99%|█████████▊| 515/522 [31:51:35<26:33, 227.63s/it] 99%|█████████▉| 516/522 [31:55:26<22:51, 228.62s/it] {'loss': 0.3512, 'grad_norm': 0.19794148206710815, 'learning_rate': 1e-05, 'epoch': 2.95} 99%|█████████▉| 516/522 [31:55:26<22:51, 228.62s/it] 99%|█████████▉| 517/522 [31:58:41<18:12, 218.56s/it] {'loss': 0.2952, 'grad_norm': 0.20668524503707886, 'learning_rate': 1e-05, 'epoch': 2.96} 99%|█████████▉| 517/522 [31:58:41<18:12, 218.56s/it] 99%|█████████▉| 518/522 [32:02:19<14:33, 218.42s/it] {'loss': 0.3352, 'grad_norm': 0.1838640421628952, 'learning_rate': 1e-05, 'epoch': 2.97} 99%|█████████▉| 518/522 [32:02:19<14:33, 218.42s/it] 99%|█████████▉| 519/522 [32:06:31<11:25, 228.49s/it] {'loss': 0.3497, 'grad_norm': 0.18087327480316162, 'learning_rate': 1e-05, 'epoch': 2.97} 99%|█████████▉| 519/522 [32:06:31<11:25, 228.49s/it] 100%|█████████▉| 520/522 [32:10:12<07:32, 226.22s/it] {'loss': 0.3116, 'grad_norm': 0.19188976287841797, 'learning_rate': 1e-05, 'epoch': 2.98} 100%|█████████▉| 520/522 [32:10:12<07:32, 226.22s/it] 100%|█████████▉| 521/522 [32:13:53<03:44, 224.65s/it] {'loss': 0.3178, 'grad_norm': 0.17835943400859833, 'learning_rate': 1e-05, 'epoch': 2.98} 100%|█████████▉| 521/522 [32:13:53<03:44, 224.65s/it] 100%|██████████| 522/522 [32:17:43<00:00, 226.49s/it] {'loss': 0.3277, 'grad_norm': 0.21530166268348694, 'learning_rate': 1e-05, 'epoch': 2.99} 100%|██████████| 522/522 [32:17:43<00:00, 226.49s/it] {'train_runtime': 116434.4903, 'train_samples_per_second': 0.431, 'train_steps_per_second': 0.004, 'train_loss': 0.371870142004499, 'epoch': 2.99} 100%|██████████| 522/522 [32:20:33<00:00, 226.49s/it]Training finished. Saving final model... Training finished. Saving final model... Training finished. Saving final model... 100%|██████████| 522/522 [32:20:33<00:00, 223.05s/it] Training finished. Saving final model... Model saved to ./qwen3-32b-stratos-finetuned-final Model saved to ./qwen3-32b-stratos-finetuned-final Model saved to ./qwen3-32b-stratos-finetuned-final Model saved to ./qwen3-32b-stratos-finetuned-final wandb: wandb: 🚀 View run Qwen3-32B_Bespoke-Stratos-17k_finetune at: https://wandb.ai/team-promptia/Model_Training/runs/2dbthh6k wandb: Find logs at: wandb/run-20250804_083304-2dbthh6k/logs