File size: 246,893 Bytes
cefa210 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 |
2021-07-26 00:12:24.148625: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
[00:12:25] - WARNING - __main__ - Process rank: -1, device: cpu, n_gpu: 0distributed training: False, 16-bits training: False
[00:12:25] - INFO - __main__ - Training/evaluation parameters TrainingArguments(
_n_gpu=0,
adafactor=False,
adam_beta1=0.9,
adam_beta2=0.98,
adam_epsilon=1e-06,
dataloader_drop_last=False,
dataloader_num_workers=0,
dataloader_pin_memory=True,
ddp_find_unused_parameters=None,
debug=[],
deepspeed=None,
disable_tqdm=False,
do_eval=False,
do_predict=False,
do_train=False,
eval_accumulation_steps=None,
eval_steps=1000,
evaluation_strategy=IntervalStrategy.NO,
fp16=False,
fp16_backend=auto,
fp16_full_eval=False,
fp16_opt_level=O1,
gradient_accumulation_steps=1,
greater_is_better=None,
group_by_length=False,
ignore_data_skip=False,
label_names=None,
label_smoothing_factor=0.0,
learning_rate=0.0006,
length_column_name=length,
load_best_model_at_end=False,
local_rank=-1,
log_level=-1,
log_level_replica=-1,
log_on_each_node=True,
logging_dir=./outputs/runs/Jul26_00-12-25_tablespoon,
logging_first_step=False,
logging_steps=500,
logging_strategy=IntervalStrategy.STEPS,
lr_scheduler_type=SchedulerType.LINEAR,
max_grad_norm=1.0,
max_steps=-1,
metric_for_best_model=None,
mp_parameters=,
no_cuda=False,
num_train_epochs=3.0,
output_dir=./outputs,
overwrite_output_dir=True,
past_index=-1,
per_device_eval_batch_size=48,
per_device_train_batch_size=48,
prediction_loss_only=False,
push_to_hub=False,
push_to_hub_model_id=outputs,
push_to_hub_organization=None,
push_to_hub_token=None,
remove_unused_columns=True,
report_to=['tensorboard', 'wandb'],
resume_from_checkpoint=None,
run_name=./outputs,
save_on_each_node=False,
save_steps=1000,
save_strategy=IntervalStrategy.STEPS,
save_total_limit=5,
seed=42,
sharded_ddp=[],
skip_memory_metrics=True,
tpu_metrics_debug=False,
tpu_num_cores=None,
use_legacy_prediction_loop=False,
warmup_ratio=0.0,
warmup_steps=500,
weight_decay=0.01,
)
[00:12:26] - WARNING - __main__ - Unable to load local dataset with perplexity sampling support. Using huggingface.co/datasets/bertin-project/mc4-es-sampled: BuilderConfig Mc4EsSampledConfig(name='stepwise', version='0.0.0', data_dir=None, data_files={}, description=None) doesn't have a 'boundaries' key.
[00:12:27] - INFO - absl - Starting the local TPU driver.
[00:12:27] - INFO - absl - Unable to initialize backend 'tpu_driver': Not found: Unable to find driver in registry given worker: local://
[00:12:27] - INFO - absl - Unable to initialize backend 'gpu': Not found: Could not find registered platform with name: "cuda". Available platform names are: TPU Interpreter Host
wandb: Currently logged in as: versae (use `wandb login --relogin` to force relogin)
wandb: wandb version 0.11.0 is available! To upgrade, please run:
wandb: $ pip install wandb --upgrade
2021-07-26 00:12:34.440423: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
wandb: Tracking run with wandb version 0.10.33
wandb: Syncing run amber-galaxy-46
wandb: View project at https://wandb.ai/wandb/hf-flax-bertin-roberta-es
wandb: View run at https://wandb.ai/wandb/hf-flax-bertin-roberta-es/runs/17u6inbn
wandb: Run data is saved locally in /var/hf/experiment-base-exp-512seq-stepwise/wandb/run-20210726_001233-17u6inbn
wandb: Run `wandb offline` to turn off syncing.
2021-07-26 00:12:35.575266: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory
2021-07-26 00:12:35.575304: W tensorflow/stream_executor/cuda/cuda_driver.cc:326] failed call to cuInit: UNKNOWN ERROR (303)
[00:12:36] - INFO - filelock - Lock 139656499698272 acquired on /home/versae/.cache/huggingface/transformers/27b7e968d2908b27f8c1df265c2dc08aef61be0f25bdc735df4df552829968fd.04a8293889c44bb7f31a5ee6212b8aa0b690121444e9c7ce1616fbe2a461ebba.lock
Downloading: 0%| | 0.00/250M [00:00<?, ?B/s]
Downloading: 0%| | 34.8k/250M [00:00<15:57, 261kB/s]
Downloading: 0%| | 191k/250M [00:00<04:43, 879kB/s]
Downloading: 0%|▎ | 836k/250M [00:00<01:30, 2.76MB/s]
Downloading: 1%|█ | 2.72M/250M [00:00<00:30, 8.18MB/s]
Downloading: 2%|██▎ | 6.08M/250M [00:00<00:14, 16.3MB/s]
Downloading: 4%|███▋ | 9.49M/250M [00:00<00:10, 21.9MB/s]
Downloading: 6%|█████▎ | 13.9M/250M [00:00<00:08, 28.5MB/s]
Downloading: 7%|██████▋ | 17.4M/250M [00:00<00:07, 30.3MB/s]
Downloading: 9%|████████▍ | 21.8M/250M [00:01<00:07, 32.2MB/s]
Downloading: 11%|██████████▍ | 27.1M/250M [00:01<00:06, 36.9MB/s]
Downloading: 12%|███████████▊ | 30.8M/250M [00:01<00:05, 36.6MB/s]
Downloading: 14%|█████████████▍ | 34.9M/250M [00:01<00:06, 35.5MB/s]
Downloading: 16%|███████████████▍ | 40.2M/250M [00:01<00:05, 39.2MB/s]
Downloading: 18%|████████████████▉ | 44.1M/250M [00:01<00:05, 38.4MB/s]
Downloading: 19%|██████████████████▍ | 48.0M/250M [00:01<00:05, 36.8MB/s]
Downloading: 21%|████████████████████▍ | 53.2M/250M [00:01<00:05, 37.3MB/s]
Downloading: 23%|██████████████████████▍ | 58.3M/250M [00:01<00:04, 39.6MB/s]
Downloading: 25%|███████████████████████▉ | 62.3M/250M [00:02<00:04, 38.9MB/s]
Downloading: 27%|█████████████████████████▍ | 66.2M/250M [00:02<00:04, 37.1MB/s]
Downloading: 29%|███████████████████████████▍ | 71.3M/250M [00:02<00:04, 39.5MB/s]
Downloading: 30%|████████████████████████████▉ | 75.2M/250M [00:02<00:04, 38.7MB/s]
Downloading: 32%|██████████████████████████████▍ | 79.1M/250M [00:02<00:04, 36.8MB/s]
Downloading: 34%|████████████████████████████████▎ | 84.1M/250M [00:02<00:04, 39.2MB/s]
Downloading: 35%|█████████████████████████████████▊ | 88.1M/250M [00:02<00:04, 38.2MB/s]
Downloading: 37%|███████████████████████████████████▎ | 91.9M/250M [00:02<00:04, 36.7MB/s]
Downloading: 39%|█████████████████████████████████████▎ | 97.0M/250M [00:02<00:03, 39.3MB/s]
Downloading: 40%|███████████████████████████████████████▏ | 101M/250M [00:03<00:03, 38.6MB/s]
Downloading: 42%|████████████████████████████████████████▋ | 105M/250M [00:03<00:03, 36.7MB/s]
Downloading: 44%|██████████████████████████████████████████▋ | 110M/250M [00:03<00:03, 39.2MB/s]
Downloading: 46%|████████████████████████████████████████████▏ | 114M/250M [00:03<00:03, 38.2MB/s]
Downloading: 47%|█████████████████████████████████████████████▋ | 118M/250M [00:03<00:03, 36.7MB/s]
Downloading: 49%|███████████████████████████████████████████████▋ | 123M/250M [00:03<00:03, 39.2MB/s]
Downloading: 51%|█████████████████████████████████████████████████▏ | 127M/250M [00:03<00:03, 38.5MB/s]
Downloading: 52%|██████████████████████████████████████████████████▋ | 131M/250M [00:03<00:03, 36.5MB/s]
Downloading: 54%|████████████████████████████████████████████████████▋ | 136M/250M [00:03<00:02, 40.1MB/s]
Downloading: 56%|██████████████████████████████████████████████████████▎ | 140M/250M [00:04<00:02, 38.3MB/s]
Downloading: 58%|███████████████████████████████████████████████████████▊ | 144M/250M [00:04<00:02, 36.4MB/s]
Downloading: 60%|█████████████████████████████████████████████████████████▋ | 149M/250M [00:04<00:02, 40.1MB/s]
Downloading: 61%|███████████████████████████████████████████████████████████▎ | 153M/250M [00:04<00:02, 38.5MB/s]
Downloading: 63%|████████████████████████████████████████████████████████████▊ | 157M/250M [00:04<00:02, 36.3MB/s]
Downloading: 65%|██████████████████████████████████████████████████████████████▊ | 162M/250M [00:04<00:02, 39.6MB/s]
Downloading: 66%|████████████████████████████████████████████████████████████████▎ | 166M/250M [00:04<00:02, 38.3MB/s]
Downloading: 68%|█████████████████████████████████████████████████████████████████▊ | 169M/250M [00:04<00:02, 37.1MB/s]
Downloading: 70%|███████████████████████████████████████████████████████████████████▋ | 174M/250M [00:04<00:01, 39.8MB/s]
Downloading: 71%|█████████████████████████████████████████████████████████████████████▏ | 178M/250M [00:05<00:01, 37.6MB/s]
Downloading: 73%|██████████████████████████████████████████████████████████████████████▊ | 182M/250M [00:05<00:01, 37.2MB/s]
Downloading: 75%|████████████████████████████████████████████████████████████████████████▋ | 187M/250M [00:05<00:01, 39.7MB/s]
Downloading: 77%|██████████████████████████████████████████████████████████████████████████▏ | 191M/250M [00:05<00:01, 37.5MB/s]
Downloading: 78%|███████████████████████████████████████████████████████████████████████████▊ | 195M/250M [00:05<00:01, 37.3MB/s]
Downloading: 80%|█████████████████████████████████████████████████████████████████████████████▌ | 200M/250M [00:05<00:01, 39.6MB/s]
Downloading: 82%|███████████████████████████████████████████████████████████████████████████████▏ | 204M/250M [00:05<00:01, 37.4MB/s]
Downloading: 83%|████████████████████████████████████████████████████████████████████████████████▊ | 208M/250M [00:05<00:01, 37.6MB/s]
Downloading: 85%|██████████████████████████████████████████████████████████████████████████████████▌ | 213M/250M [00:05<00:00, 39.5MB/s]
Downloading: 87%|████████████████████████████████████████████████████████████████████████████████████ | 217M/250M [00:06<00:00, 37.0MB/s]
Downloading: 88%|█████████████████████████████████████████████████████████████████████████████████████▊ | 221M/250M [00:06<00:00, 39.0MB/s]
Downloading: 90%|███████████████████████████████████████████████████████████████████████████████████████▎ | 225M/250M [00:06<00:00, 38.2MB/s]
Downloading: 92%|████████████████████████████████████████████████████████████████████████████████████████▊ | 229M/250M [00:06<00:00, 38.3MB/s]
Downloading: 93%|██████████████████████████████████████████████████████████████████████████████████████████▎ | 233M/250M [00:06<00:00, 38.2MB/s]
Downloading: 95%|███████████████████████████████████████████████████████████████████████████████████████████▊ | 237M/250M [00:06<00:00, 38.1MB/s]
Downloading: 96%|█████████████████████████████████████████████████████████████████████████████████████████████▎ | 240M/250M [00:06<00:00, 38.0MB/s]
Downloading: 98%|██████████████████████████████████████████████████████████████████████████████████████████████▊ | 244M/250M [00:06<00:00, 38.1MB/s]
Downloading: 99%|████████████████████████████████████████████████████████████████████████████████████████████████▎| 248M/250M [00:06<00:00, 37.7MB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████| 250M/250M [00:06<00:00, 35.8MB/s]
[00:12:43] - INFO - filelock - Lock 139656499698272 released on /home/versae/.cache/huggingface/transformers/27b7e968d2908b27f8c1df265c2dc08aef61be0f25bdc735df4df552829968fd.04a8293889c44bb7f31a5ee6212b8aa0b690121444e9c7ce1616fbe2a461ebba.lock
/var/hf/venv/lib/python3.8/site-packages/jax/lib/xla_bridge.py:386: UserWarning: jax.host_count has been renamed to jax.process_count. This alias will eventually be removed; please update your code.
warnings.warn(
/var/hf/venv/lib/python3.8/site-packages/jax/lib/xla_bridge.py:373: UserWarning: jax.host_id has been renamed to jax.process_index. This alias will eventually be removed; please update your code.
warnings.warn(
Training...: 0%| | 0/50000 [00:00<?, ?it/s]
Training...: 0%| | 1/50000 [01:22<1152:39:44, 82.99s/it]
Training...: 0%| | 2/50000 [01:23<482:00:39, 34.71s/it]
Training...: 0%| | 3/50000 [01:25<269:38:30, 19.42s/it]
Training...: 0%| | 4/50000 [01:27<174:59:36, 12.60s/it]
Training...: 0%| | 5/50000 [01:28<117:17:01, 8.45s/it]
Training...: 0%| | 6/50000 [01:29<82:01:18, 5.91s/it]
Training...: 0%| | 7/50000 [01:30<60:18:15, 4.34s/it]
Training...: 0%| | 8/50000 [01:31<46:53:50, 3.38s/it]
Training...: 0%| | 9/50000 [01:32<37:18:25, 2.69s/it]
Training...: 0%| | 10/50000 [01:33<29:35:01, 2.13s/it]
Training...: 0%| | 11/50000 [01:34<24:37:38, 1.77s/it]
Training...: 0%| | 12/50000 [01:36<22:29:46, 1.62s/it]
Training...: 0%| | 13/50000 [01:37<20:14:30, 1.46s/it]
Training...: 0%| | 14/50000 [01:38<18:32:36, 1.34s/it]
Training...: 0%| | 15/50000 [01:39<17:45:07, 1.28s/it]
Training...: 0%| | 16/50000 [01:40<16:52:24, 1.22s/it]
Training...: 0%| | 17/50000 [01:41<16:31:15, 1.19s/it]
Training...: 0%| | 18/50000 [01:43<19:53:20, 1.43s/it]
Training...: 0%| | 19/50000 [01:44<18:15:02, 1.31s/it]
Training...: 0%| | 20/50000 [01:45<17:00:04, 1.22s/it]
Training...: 0%| | 21/50000 [01:46<15:59:27, 1.15s/it]
Training...: 0%| | 22/50000 [01:47<15:53:29, 1.14s/it]
Training...: 0%| | 23/50000 [01:48<16:19:21, 1.18s/it]
Training...: 0%| | 24/50000 [01:50<15:59:27, 1.15s/it]
Training...: 0%| | 25/50000 [01:51<16:39:30, 1.20s/it]
Training...: 0%| | 26/50000 [01:52<16:31:45, 1.19s/it]
Training...: 0%| | 27/50000 [01:55<22:25:52, 1.62s/it]
Training...: 0%| | 28/50000 [01:56<20:36:29, 1.48s/it]
Training...: 0%| | 29/50000 [01:57<19:48:19, 1.43s/it]
Training...: 0%| | 30/50000 [01:58<18:56:37, 1.36s/it]
Training...: 0%| | 31/50000 [02:00<18:20:12, 1.32s/it]
Training...: 0%| | 32/50000 [02:02<23:37:18, 1.70s/it]
Training...: 0%| | 33/50000 [02:03<21:01:50, 1.52s/it]
Training...: 0%| | 34/50000 [02:04<20:04:16, 1.45s/it]
Training...: 0%| | 35/50000 [02:06<18:26:34, 1.33s/it]
Training...: 0%| | 36/50000 [02:07<18:02:05, 1.30s/it]
Training...: 0%| | 37/50000 [02:08<16:59:33, 1.22s/it]
Training...: 0%| | 38/50000 [02:09<16:54:38, 1.22s/it]
Training...: 0%| | 39/50000 [02:10<15:33:14, 1.12s/it]
Training...: 0%| | 40/50000 [02:11<15:28:06, 1.11s/it]
Training...: 0%| | 41/50000 [02:12<15:26:57, 1.11s/it]
Training...: 0%| | 42/50000 [02:13<14:59:15, 1.08s/it]
Training...: 0%| | 43/50000 [02:14<15:49:09, 1.14s/it]
Training...: 0%| | 44/50000 [02:15<15:20:48, 1.11s/it]
Training...: 0%| | 45/50000 [02:17<15:11:11, 1.09s/it]
Training...: 0%| | 46/50000 [02:18<17:14:10, 1.24s/it]
Training...: 0%| | 47/50000 [02:19<17:07:39, 1.23s/it]
Training...: 0%| | 48/50000 [02:20<15:53:51, 1.15s/it]
Training...: 0%| | 49/50000 [02:21<14:53:29, 1.07s/it]
Training...: 0%| | 50/50000 [02:22<15:51:44, 1.14s/it]
Training...: 0%| | 51/50000 [02:24<15:29:58, 1.12s/it]
Training...: 0%| | 52/50000 [02:25<15:23:56, 1.11s/it]
Training...: 0%| | 53/50000 [02:26<14:44:29, 1.06s/it]
Training...: 0%| | 54/50000 [02:27<14:44:32, 1.06s/it]
Training...: 0%| | 55/50000 [02:28<14:43:49, 1.06s/it]
Training...: 0%| | 56/50000 [02:29<14:31:46, 1.05s/it]
Training...: 0%| | 57/50000 [02:30<14:59:31, 1.08s/it]
Training...: 0%| | 58/50000 [02:31<14:13:25, 1.03s/it]
Training...: 0%| | 59/50000 [02:32<14:27:24, 1.04s/it]
Training...: 0%| | 60/50000 [02:33<14:18:34, 1.03s/it]
Training...: 0%| | 61/50000 [02:36<21:21:13, 1.54s/it]
Training...: 0%| | 62/50000 [02:37<19:07:34, 1.38s/it]
Training...: 0%| | 63/50000 [02:38<18:00:30, 1.30s/it]
Training...: 0%| | 64/50000 [02:38<16:00:46, 1.15s/it]
Training...: 0%| | 65/50000 [02:40<15:27:08, 1.11s/it]
Training...: 0%| | 66/50000 [02:41<15:49:50, 1.14s/it]
Training...: 0%|▏ | 67/50000 [02:42<14:46:27, 1.07s/it]
Training...: 0%|▏ | 68/50000 [02:43<15:34:10, 1.12s/it]
Training...: 0%|▏ | 69/50000 [02:44<15:34:02, 1.12s/it]
Training...: 0%|▏ | 70/50000 [02:45<15:07:50, 1.09s/it]
Training...: 0%|▏ | 71/50000 [02:47<19:17:10, 1.39s/it]
Training...: 0%|▏ | 72/50000 [02:48<17:23:50, 1.25s/it]
Training...: 0%|▏ | 73/50000 [02:49<17:19:48, 1.25s/it]
Training...: 0%|▏ | 74/50000 [02:50<16:37:15, 1.20s/it]
Training...: 0%|▏ | 75/50000 [02:51<15:59:48, 1.15s/it]
Training...: 0%|▏ | 76/50000 [02:54<23:35:39, 1.70s/it]
Training...: 0%|▏ | 77/50000 [02:55<20:08:33, 1.45s/it]
Training...: 0%|▏ | 78/50000 [02:56<19:01:41, 1.37s/it]
Training...: 0%|▏ | 79/50000 [02:58<18:15:13, 1.32s/it]
Training...: 0%|▏ | 80/50000 [02:59<17:27:05, 1.26s/it]
Training...: 0%|▏ | 81/50000 [03:00<16:57:29, 1.22s/it]
Training...: 0%|▏ | 82/50000 [03:01<16:44:19, 1.21s/it]
Training...: 0%|▏ | 83/50000 [03:02<14:23:28, 1.04s/it]
Training...: 0%|▏ | 84/50000 [03:03<15:10:06, 1.09s/it]
Training...: 0%|▏ | 85/50000 [03:04<14:35:53, 1.05s/it]
Training...: 0%|▏ | 86/50000 [03:05<14:32:34, 1.05s/it]
Training...: 0%|▏ | 87/50000 [03:06<15:09:57, 1.09s/it]
Training...: 0%|▏ | 88/50000 [03:07<14:30:33, 1.05s/it]
Training...: 0%|▏ | 89/50000 [03:08<15:02:01, 1.08s/it]
Training...: 0%|▏ | 90/50000 [03:09<15:13:12, 1.10s/it]
Training...: 0%|▏ | 91/50000 [03:12<19:49:09, 1.43s/it]
Training...: 0%|▏ | 92/50000 [03:13<19:50:31, 1.43s/it]
Training...: 0%|▏ | 93/50000 [03:14<18:18:45, 1.32s/it]
Training...: 0%|▏ | 94/50000 [03:15<16:44:13, 1.21s/it]
Training...: 0%|▏ | 95/50000 [03:16<16:39:19, 1.20s/it]
Training...: 0%|▏ | 96/50000 [03:17<15:56:33, 1.15s/it]
Training...: 0%|▏ | 97/50000 [03:18<15:51:05, 1.14s/it]
Training...: 0%|▏ | 98/50000 [03:20<16:32:08, 1.19s/it]
Training...: 0%|▏ | 99/50000 [03:21<16:58:34, 1.22s/it]
Training...: 0%|▏ | 100/50000 [03:22<15:56:22, 1.15s/it]
Training...: 0%|▏ | 101/50000 [03:23<16:15:15, 1.17s/it]
Training...: 0%|▏ | 102/50000 [03:24<16:29:47, 1.19s/it]
Training...: 0%|▏ | 103/50000 [03:25<15:44:20, 1.14s/it]
Training...: 0%|▏ | 104/50000 [03:26<15:07:52, 1.09s/it]
Training...: 0%|▏ | 105/50000 [03:28<15:17:21, 1.10s/it]
Training...: 0%|▏ | 106/50000 [03:30<21:22:07, 1.54s/it]
Training...: 0%|▏ | 107/50000 [03:31<18:54:49, 1.36s/it]
Training...: 0%|▏ | 108/50000 [03:32<17:21:08, 1.25s/it]
Training...: 0%|▏ | 109/50000 [03:33<15:32:51, 1.12s/it]
Training...: 0%|▏ | 110/50000 [03:34<16:17:07, 1.18s/it]
Training...: 0%|▏ | 111/50000 [03:35<15:47:40, 1.14s/it]
Training...: 0%|▏ | 112/50000 [03:36<16:20:53, 1.18s/it]
Training...: 0%|▏ | 113/50000 [03:37<15:35:49, 1.13s/it]
Training...: 0%|▏ | 114/50000 [03:39<16:27:00, 1.19s/it]
Training...: 0%|▏ | 115/50000 [03:41<20:43:27, 1.50s/it]
Training...: 0%|▏ | 116/50000 [03:42<19:41:19, 1.42s/it]
Training...: 0%|▏ | 117/50000 [03:43<18:17:58, 1.32s/it]
Training...: 0%|▏ | 118/50000 [03:44<17:14:48, 1.24s/it]
Training...: 0%|▏ | 119/50000 [03:46<16:59:43, 1.23s/it]
Training...: 0%|▏ | 120/50000 [03:47<19:31:23, 1.41s/it]
Training...: 0%|▏ | 121/50000 [03:49<18:12:22, 1.31s/it]
Training...: 0%|▏ | 122/50000 [03:50<17:04:20, 1.23s/it]
Training...: 0%|▏ | 123/50000 [03:51<16:00:24, 1.16s/it]
Training...: 0%|▏ | 124/50000 [03:51<14:49:15, 1.07s/it]
Training...: 0%|▏ | 125/50000 [03:53<15:07:19, 1.09s/it]
Training...: 0%|▏ | 126/50000 [03:54<15:25:25, 1.11s/it]
Training...: 0%|▏ | 127/50000 [03:55<15:28:14, 1.12s/it]
Training...: 0%|▏ | 128/50000 [03:56<15:08:09, 1.09s/it]
Training...: 0%|▏ | 129/50000 [03:57<15:12:28, 1.10s/it]
Training...: 0%|▏ | 130/50000 [03:58<15:11:53, 1.10s/it]
Training...: 0%|▏ | 131/50000 [03:59<15:21:05, 1.11s/it]
Training...: 0%|▏ | 132/50000 [04:00<14:49:27, 1.07s/it]
Training...: 0%|▏ | 133/50000 [04:01<14:55:17, 1.08s/it]
Training...: 0%|▏ | 134/50000 [04:03<17:25:01, 1.26s/it]
Training...: 0%|▎ | 135/50000 [04:04<18:01:54, 1.30s/it]
Training...: 0%|▎ | 136/50000 [04:06<18:14:38, 1.32s/it]
Training...: 0%|▎ | 137/50000 [04:07<17:36:01, 1.27s/it]
Training...: 0%|▎ | 138/50000 [04:08<17:38:43, 1.27s/it]
Training...: 0%|▎ | 139/50000 [04:09<17:31:03, 1.26s/it]
Training...: 0%|▎ | 140/50000 [04:11<16:57:50, 1.22s/it]
Training...: 0%|▎ | 141/50000 [04:12<16:39:52, 1.20s/it]
Training...: 0%|▎ | 142/50000 [04:13<16:14:41, 1.17s/it]
Training...: 0%|▎ | 143/50000 [04:14<15:36:34, 1.13s/it]
Training...: 0%|▎ | 144/50000 [04:15<15:50:33, 1.14s/it]
Training...: 0%|▎ | 145/50000 [04:16<16:15:58, 1.17s/it]
Training...: 0%|▎ | 146/50000 [04:18<16:46:03, 1.21s/it]
Training...: 0%|▎ | 147/50000 [04:19<17:02:47, 1.23s/it]
Training...: 0%|▎ | 148/50000 [04:20<18:12:51, 1.32s/it]
Training...: 0%|▎ | 149/50000 [04:21<16:59:41, 1.23s/it]
Training...: 0%|▎ | 150/50000 [04:22<16:00:32, 1.16s/it]
Training...: 0%|▎ | 151/50000 [04:24<16:21:46, 1.18s/it]
Training...: 0%|▎ | 152/50000 [04:25<16:09:16, 1.17s/it]
Training...: 0%|▎ | 153/50000 [04:26<16:51:48, 1.22s/it]
Training...: 0%|▎ | 154/50000 [04:27<16:02:59, 1.16s/it]
Training...: 0%|▎ | 155/50000 [04:28<14:47:43, 1.07s/it]
Training...: 0%|▎ | 156/50000 [04:29<15:21:39, 1.11s/it]
Training...: 0%|▎ | 157/50000 [04:30<14:54:46, 1.08s/it]
Training...: 0%|▎ | 158/50000 [04:31<15:45:02, 1.14s/it]
Training...: 0%|▎ | 159/50000 [04:34<19:49:11, 1.43s/it]
Training...: 0%|▎ | 160/50000 [04:34<17:37:56, 1.27s/it]
Training...: 0%|▎ | 161/50000 [04:35<16:29:26, 1.19s/it]
Training...: 0%|▎ | 162/50000 [04:37<16:35:26, 1.20s/it]
Training...: 0%|▎ | 163/50000 [04:38<19:04:05, 1.38s/it]
Training...: 0%|▎ | 164/50000 [04:40<18:16:40, 1.32s/it]
Training...: 0%|▎ | 165/50000 [04:41<17:31:40, 1.27s/it]
Training...: 0%|▎ | 166/50000 [04:42<16:58:33, 1.23s/it]
Training...: 0%|▎ | 167/50000 [04:43<16:24:35, 1.19s/it]
Training...: 0%|▎ | 168/50000 [04:44<15:52:12, 1.15s/it]
Training...: 0%|▎ | 169/50000 [04:45<15:29:23, 1.12s/it]
Training...: 0%|▎ | 170/50000 [04:46<15:03:12, 1.09s/it]
Training...: 0%|▎ | 171/50000 [04:47<14:48:43, 1.07s/it]
Training...: 0%|▎ | 172/50000 [04:49<16:13:33, 1.17s/it]
Training...: 0%|▎ | 173/50000 [04:50<16:54:20, 1.22s/it]
Training...: 0%|▎ | 174/50000 [04:51<16:29:59, 1.19s/it]
Training...: 0%|▎ | 175/50000 [04:52<15:52:38, 1.15s/it]
Training...: 0%|▎ | 176/50000 [04:53<15:14:14, 1.10s/it]
Training...: 0%|▎ | 177/50000 [04:54<15:38:22, 1.13s/it]
Training...: 0%|▎ | 178/50000 [04:56<18:47:39, 1.36s/it]
Training...: 0%|▎ | 179/50000 [04:57<16:45:03, 1.21s/it]
Training...: 0%|▎ | 180/50000 [04:58<15:56:34, 1.15s/it]
Training...: 0%|▎ | 181/50000 [04:59<16:42:25, 1.21s/it]
Training...: 0%|▎ | 182/50000 [05:00<16:15:59, 1.18s/it]
Training...: 0%|▎ | 183/50000 [05:01<15:06:21, 1.09s/it]
Training...: 0%|▎ | 184/50000 [05:02<14:50:03, 1.07s/it]
Training...: 0%|▎ | 185/50000 [05:04<15:00:39, 1.08s/it]
Training...: 0%|▎ | 186/50000 [05:05<14:59:10, 1.08s/it]
Training...: 0%|▎ | 187/50000 [05:06<15:11:10, 1.10s/it]
Training...: 0%|▎ | 188/50000 [05:07<14:40:32, 1.06s/it]
Training...: 0%|▎ | 189/50000 [05:08<14:34:21, 1.05s/it]
Training...: 0%|▎ | 190/50000 [05:09<14:49:14, 1.07s/it]
Training...: 0%|▎ | 191/50000 [05:10<15:10:33, 1.10s/it]
Training...: 0%|▎ | 192/50000 [05:11<15:21:35, 1.11s/it]
Training...: 0%|▎ | 193/50000 [05:13<17:47:19, 1.29s/it]
Training...: 0%|▎ | 194/50000 [05:14<17:03:21, 1.23s/it]
Training...: 0%|▎ | 195/50000 [05:15<16:20:58, 1.18s/it]
Training...: 0%|▎ | 196/50000 [05:16<15:51:03, 1.15s/it]
Training...: 0%|▎ | 197/50000 [05:17<16:02:06, 1.16s/it]
Training...: 0%|▎ | 198/50000 [05:18<15:48:59, 1.14s/it]
Training...: 0%|▎ | 199/50000 [05:19<15:30:25, 1.12s/it]
Training...: 0%|▎ | 200/50000 [05:21<15:56:21, 1.15s/it]
Training...: 0%|▎ | 201/50000 [05:22<16:16:22, 1.18s/it]
Training...: 0%|▍ | 202/50000 [05:23<15:50:01, 1.14s/it]
Training...: 0%|▍ | 203/50000 [05:25<19:37:21, 1.42s/it]
Training...: 0%|▍ | 204/50000 [05:26<18:52:59, 1.37s/it]
Training...: 0%|▍ | 205/50000 [05:27<18:08:23, 1.31s/it]
Training...: 0%|▍ | 206/50000 [05:29<17:47:57, 1.29s/it]
Training...: 0%|▍ | 207/50000 [05:31<20:13:45, 1.46s/it]
Training...: 0%|▍ | 208/50000 [05:32<18:38:12, 1.35s/it]
Training...: 0%|▍ | 209/50000 [05:33<17:24:42, 1.26s/it]
Training...: 0%|▍ | 210/50000 [05:34<16:29:42, 1.19s/it]
Training...: 0%|▍ | 211/50000 [05:35<16:40:06, 1.21s/it]
Training...: 0%|▍ | 212/50000 [05:36<15:24:08, 1.11s/it]
Training...: 0%|▍ | 213/50000 [05:37<14:38:49, 1.06s/it]
Training...: 0%|▍ | 214/50000 [05:38<15:03:05, 1.09s/it]
Training...: 0%|▍ | 215/50000 [05:39<15:21:21, 1.11s/it]
Training...: 0%|▍ | 216/50000 [05:40<15:43:43, 1.14s/it]
Training...: 0%|▍ | 217/50000 [05:42<16:48:19, 1.22s/it]
Training...: 0%|▍ | 218/50000 [05:43<15:56:34, 1.15s/it]
Training...: 0%|▍ | 219/50000 [05:44<17:17:30, 1.25s/it]
Training...: 0%|▍ | 220/50000 [05:45<16:48:57, 1.22s/it]
Training...: 0%|▍ | 221/50000 [05:46<16:34:07, 1.20s/it]
Training...: 0%|▍ | 222/50000 [05:48<19:46:35, 1.43s/it]
Training...: 0%|▍ | 223/50000 [05:50<20:25:09, 1.48s/it]
Training...: 0%|▍ | 224/50000 [05:51<19:57:19, 1.44s/it]
Training...: 0%|▍ | 225/50000 [05:53<19:51:44, 1.44s/it]
Training...: 0%|▍ | 226/50000 [05:54<19:01:22, 1.38s/it]
Training...: 0%|▍ | 227/50000 [05:55<17:57:43, 1.30s/it]
Training...: 0%|▍ | 228/50000 [05:56<17:08:04, 1.24s/it]
Training...: 0%|▍ | 229/50000 [05:57<16:47:56, 1.22s/it]
Training...: 0%|▍ | 230/50000 [05:59<16:21:55, 1.18s/it]
Training...: 0%|▍ | 231/50000 [06:00<16:02:21, 1.16s/it]
Training...: 0%|▍ | 232/50000 [06:01<16:16:50, 1.18s/it]
Training...: 0%|▍ | 233/50000 [06:02<16:06:01, 1.16s/it]
Training...: 0%|▍ | 234/50000 [06:03<15:40:19, 1.13s/it]
Training...: 0%|▍ | 235/50000 [06:06<21:12:17, 1.53s/it]
Training...: 0%|▍ | 236/50000 [06:07<19:23:20, 1.40s/it]
Training...: 0%|▍ | 237/50000 [06:08<17:57:05, 1.30s/it]
Training...: 0%|▍ | 238/50000 [06:09<17:12:17, 1.24s/it]
Training...: 0%|▍ | 239/50000 [06:11<21:33:43, 1.56s/it]
Training...: 0%|▍ | 240/50000 [06:12<20:43:47, 1.50s/it]
Training...: 0%|▍ | 241/50000 [06:14<20:09:07, 1.46s/it]
Training...: 0%|▍ | 242/50000 [06:15<19:22:16, 1.40s/it]
Training...: 0%|▍ | 243/50000 [06:16<17:24:22, 1.26s/it]
Training...: 0%|▍ | 244/50000 [06:17<17:13:50, 1.25s/it]
Training...: 0%|▍ | 245/50000 [06:19<17:29:53, 1.27s/it]
Training...: 0%|▍ | 246/50000 [06:20<16:38:34, 1.20s/it]
Training...: 0%|▍ | 247/50000 [06:22<19:31:21, 1.41s/it]
Training...: 0%|▍ | 248/50000 [06:23<18:23:07, 1.33s/it]
Training...: 0%|▍ | 249/50000 [06:24<17:54:05, 1.30s/it]
Training...: 0%|▍ | 250/50000 [06:25<16:50:07, 1.22s/it]
Training...: 1%|▍ | 251/50000 [06:26<16:32:26, 1.20s/it]
Training...: 1%|▍ | 252/50000 [06:27<17:17:36, 1.25s/it]
Training...: 1%|▍ | 253/50000 [06:29<19:46:43, 1.43s/it]
Training...: 1%|▍ | 254/50000 [06:30<18:08:04, 1.31s/it]
Training...: 1%|▍ | 255/50000 [06:32<17:52:54, 1.29s/it]
Training...: 1%|▍ | 256/50000 [06:32<15:56:45, 1.15s/it]
Training...: 1%|▍ | 257/50000 [06:34<16:12:18, 1.17s/it]
Training...: 1%|▍ | 258/50000 [06:35<15:57:35, 1.16s/it]
Training...: 1%|▍ | 259/50000 [06:36<15:34:49, 1.13s/it]
Training...: 1%|▍ | 260/50000 [06:37<14:24:07, 1.04s/it]
Training...: 1%|▍ | 261/50000 [06:38<15:07:40, 1.09s/it]
Training...: 1%|▍ | 262/50000 [06:39<15:26:30, 1.12s/it]
Training...: 1%|▍ | 263/50000 [06:40<15:16:48, 1.11s/it]
Training...: 1%|▍ | 264/50000 [06:41<15:24:45, 1.12s/it]
Training...: 1%|▍ | 265/50000 [06:42<15:10:54, 1.10s/it]
Training...: 1%|▍ | 266/50000 [06:43<13:42:28, 1.01it/s]
Training...: 1%|▍ | 267/50000 [06:44<14:28:04, 1.05s/it]
Training...: 1%|▍ | 268/50000 [06:46<17:31:39, 1.27s/it]
Training...: 1%|▌ | 269/50000 [06:48<18:54:38, 1.37s/it]
Training...: 1%|▌ | 270/50000 [06:49<17:16:31, 1.25s/it]
Training...: 1%|▌ | 271/50000 [06:50<17:41:34, 1.28s/it]
Training...: 1%|▌ | 272/50000 [06:51<16:27:24, 1.19s/it]
Training...: 1%|▌ | 273/50000 [06:52<16:00:49, 1.16s/it]
Training...: 1%|▌ | 274/50000 [06:53<17:10:15, 1.24s/it]
Training...: 1%|▌ | 275/50000 [06:55<18:12:06, 1.32s/it]
Training...: 1%|▌ | 276/50000 [06:56<18:04:04, 1.31s/it]
Training...: 1%|▌ | 277/50000 [06:57<17:38:07, 1.28s/it]
Training...: 1%|▌ | 278/50000 [06:59<17:20:14, 1.26s/it]
Training...: 1%|▌ | 279/50000 [07:00<17:08:45, 1.24s/it]
Training...: 1%|▌ | 280/50000 [07:01<16:50:54, 1.22s/it]
Training...: 1%|▌ | 281/50000 [07:02<15:53:46, 1.15s/it]
Training...: 1%|▌ | 282/50000 [07:04<18:08:19, 1.31s/it]
Training...: 1%|▌ | 283/50000 [07:05<17:57:34, 1.30s/it]
Training...: 1%|▌ | 284/50000 [07:06<17:26:12, 1.26s/it]
Training...: 1%|▌ | 285/50000 [07:07<16:33:12, 1.20s/it]
Training...: 1%|▌ | 286/50000 [07:08<15:22:48, 1.11s/it]
Training...: 1%|▌ | 287/50000 [07:09<14:54:50, 1.08s/it]
Training...: 1%|▌ | 288/50000 [07:10<14:57:46, 1.08s/it]
Training...: 1%|▌ | 289/50000 [07:11<15:17:40, 1.11s/it]
Training...: 1%|▌ | 290/50000 [07:13<15:44:00, 1.14s/it]
Training...: 1%|▌ | 291/50000 [07:15<19:23:24, 1.40s/it]
Training...: 1%|▌ | 292/50000 [07:16<17:50:50, 1.29s/it]
Training...: 1%|▌ | 293/50000 [07:17<17:07:51, 1.24s/it]
Training...: 1%|▌ | 294/50000 [07:18<17:13:09, 1.25s/it]
Training...: 1%|▌ | 295/50000 [07:19<16:30:26, 1.20s/it]
Training...: 1%|▌ | 296/50000 [07:20<15:34:17, 1.13s/it]
Training...: 1%|▌ | 297/50000 [07:22<19:00:52, 1.38s/it]
Training...: 1%|▌ | 298/50000 [07:23<18:30:06, 1.34s/it]
Training...: 1%|▌ | 299/50000 [07:24<17:51:46, 1.29s/it]
Training...: 1%|▌ | 300/50000 [07:25<16:40:47, 1.21s/it]
Training...: 1%|▌ | 301/50000 [07:27<16:38:52, 1.21s/it]
Training...: 1%|▌ | 302/50000 [07:28<17:00:32, 1.23s/it]
Training...: 1%|▌ | 303/50000 [07:29<17:02:59, 1.24s/it]
Training...: 1%|▌ | 304/50000 [07:30<16:46:49, 1.22s/it]
Training...: 1%|▌ | 305/50000 [07:31<16:19:35, 1.18s/it]
Training...: 1%|▌ | 306/50000 [07:32<15:13:57, 1.10s/it]
Training...: 1%|▌ | 307/50000 [07:34<15:31:49, 1.13s/it]
Training...: 1%|▌ | 308/50000 [07:35<15:12:07, 1.10s/it]
Training...: 1%|▌ | 309/50000 [07:36<15:33:39, 1.13s/it]
Training...: 1%|▌ | 310/50000 [07:37<15:06:53, 1.10s/it]
Training...: 1%|▌ | 311/50000 [07:38<15:46:08, 1.14s/it]
Training...: 1%|▌ | 312/50000 [07:40<18:56:16, 1.37s/it]
Training...: 1%|▌ | 313/50000 [07:41<18:56:12, 1.37s/it]
Training...: 1%|▌ | 314/50000 [07:43<18:11:37, 1.32s/it]
Training...: 1%|▌ | 315/50000 [07:44<17:26:09, 1.26s/it]
Training...: 1%|▌ | 316/50000 [07:45<17:59:34, 1.30s/it]
Training...: 1%|▌ | 317/50000 [07:46<17:27:18, 1.26s/it]
Training...: 1%|▌ | 318/50000 [07:47<17:18:59, 1.25s/it]
Training...: 1%|▌ | 319/50000 [07:49<18:07:55, 1.31s/it]
Training...: 1%|▌ | 320/50000 [07:50<18:47:51, 1.36s/it]
Training...: 1%|▌ | 321/50000 [07:51<16:54:14, 1.22s/it]
Training...: 1%|▌ | 322/50000 [07:52<16:25:28, 1.19s/it]
Training...: 1%|▌ | 323/50000 [07:54<16:07:24, 1.17s/it]
Training...: 1%|▌ | 324/50000 [07:55<16:13:55, 1.18s/it]
Training...: 1%|▌ | 325/50000 [07:57<19:13:57, 1.39s/it]
Training...: 1%|▌ | 326/50000 [07:58<17:43:21, 1.28s/it]
Training...: 1%|▌ | 327/50000 [07:59<18:22:42, 1.33s/it]
Training...: 1%|▌ | 328/50000 [08:00<18:12:15, 1.32s/it]
Training...: 1%|▌ | 329/50000 [08:01<16:33:26, 1.20s/it]
Training...: 1%|▌ | 330/50000 [08:02<16:21:26, 1.19s/it]
Training...: 1%|▌ | 331/50000 [08:04<16:28:08, 1.19s/it]
Training...: 1%|▌ | 332/50000 [08:05<16:33:51, 1.20s/it]
Training...: 1%|▌ | 333/50000 [08:06<17:32:54, 1.27s/it]
Training...: 1%|▌ | 334/50000 [08:08<17:15:22, 1.25s/it]
Training...: 1%|▌ | 335/50000 [08:10<21:11:37, 1.54s/it]
Training...: 1%|▌ | 336/50000 [08:11<20:07:36, 1.46s/it]
Training...: 1%|▋ | 337/50000 [08:12<18:57:14, 1.37s/it]
Training...: 1%|▋ | 338/50000 [08:13<17:54:31, 1.30s/it]
Training...: 1%|▋ | 339/50000 [08:15<19:32:02, 1.42s/it]
Training...: 1%|▋ | 340/50000 [08:16<18:22:13, 1.33s/it]
Training...: 1%|▋ | 341/50000 [08:17<17:06:50, 1.24s/it]
Training...: 1%|▋ | 342/50000 [08:18<16:22:13, 1.19s/it]
Training...: 1%|▋ | 343/50000 [08:19<15:15:59, 1.11s/it]
Training...: 1%|▋ | 344/50000 [08:20<14:50:02, 1.08s/it]
Training...: 1%|▋ | 345/50000 [08:21<14:57:15, 1.08s/it]
Training...: 1%|▋ | 346/50000 [08:22<15:22:28, 1.11s/it]
Training...: 1%|▋ | 347/50000 [08:24<16:41:50, 1.21s/it]
Training...: 1%|▋ | 348/50000 [08:25<16:17:19, 1.18s/it]
Training...: 1%|▋ | 349/50000 [08:26<15:26:31, 1.12s/it]
Training...: 1%|▋ | 350/50000 [08:27<15:58:55, 1.16s/it]
Training...: 1%|▋ | 351/50000 [08:28<14:14:59, 1.03s/it]
Training...: 1%|▋ | 352/50000 [08:29<14:36:07, 1.06s/it]
Training...: 1%|▋ | 353/50000 [08:30<13:26:05, 1.03it/s]
Training...: 1%|▋ | 354/50000 [08:31<14:25:50, 1.05s/it]
Training...: 1%|▋ | 355/50000 [08:33<16:33:04, 1.20s/it]
Training...: 1%|▋ | 356/50000 [08:34<17:00:30, 1.23s/it]
Training...: 1%|▋ | 357/50000 [08:35<16:46:39, 1.22s/it]
Training...: 1%|▋ | 358/50000 [08:36<16:29:12, 1.20s/it]
Training...: 1%|▋ | 359/50000 [08:38<17:02:48, 1.24s/it]
Training...: 1%|▋ | 360/50000 [08:39<16:52:19, 1.22s/it]
Training...: 1%|▋ | 361/50000 [08:40<16:45:21, 1.22s/it]
Training...: 1%|▋ | 362/50000 [08:41<17:25:51, 1.26s/it]
Training...: 1%|▋ | 363/50000 [08:43<17:48:05, 1.29s/it]
Training...: 1%|▋ | 364/50000 [08:44<18:11:04, 1.32s/it]
Training...: 1%|▋ | 365/50000 [08:45<16:50:52, 1.22s/it]
Training...: 1%|▋ | 366/50000 [08:47<17:46:56, 1.29s/it]
Training...: 1%|▋ | 367/50000 [08:48<17:03:14, 1.24s/it]
Training...: 1%|▋ | 368/50000 [08:49<16:10:25, 1.17s/it]
Training...: 1%|▋ | 369/50000 [08:50<18:10:19, 1.32s/it]
Training...: 1%|▋ | 370/50000 [08:52<17:49:00, 1.29s/it]
Training...: 1%|▋ | 371/50000 [08:53<16:43:27, 1.21s/it]
Training...: 1%|▋ | 372/50000 [08:54<16:35:36, 1.20s/it]
Training...: 1%|▋ | 373/50000 [08:55<16:50:00, 1.22s/it]
Training...: 1%|▋ | 374/50000 [08:56<16:06:59, 1.17s/it]
Training...: 1%|▋ | 375/50000 [08:58<18:29:16, 1.34s/it]
Training...: 1%|▋ | 376/50000 [08:59<16:54:33, 1.23s/it]
Training...: 1%|▋ | 377/50000 [09:00<16:15:57, 1.18s/it]
Training...: 1%|▋ | 378/50000 [09:01<16:38:05, 1.21s/it]
Training...: 1%|▋ | 379/50000 [09:03<21:20:33, 1.55s/it]
Training...: 1%|▋ | 380/50000 [09:05<20:16:21, 1.47s/it]
Training...: 1%|▋ | 381/50000 [09:06<18:47:17, 1.36s/it]
Training...: 1%|▋ | 382/50000 [09:07<17:48:03, 1.29s/it]
Training...: 1%|▋ | 383/50000 [09:09<19:04:45, 1.38s/it]
Training...: 1%|▋ | 384/50000 [09:10<18:00:51, 1.31s/it]
Training...: 1%|▋ | 385/50000 [09:11<17:03:19, 1.24s/it]
Training...: 1%|▋ | 386/50000 [09:12<16:53:06, 1.23s/it]
Training...: 1%|▋ | 387/50000 [09:13<16:41:38, 1.21s/it]
Training...: 1%|▋ | 388/50000 [09:14<15:27:08, 1.12s/it]
Training...: 1%|▋ | 389/50000 [09:15<16:39:12, 1.21s/it]
Training...: 1%|▋ | 390/50000 [09:17<16:46:45, 1.22s/it]
Training...: 1%|▋ | 391/50000 [09:18<15:52:22, 1.15s/it]
Training...: 1%|▋ | 392/50000 [09:19<15:43:57, 1.14s/it]
Training...: 1%|▋ | 393/50000 [09:20<15:28:13, 1.12s/it]
Training...: 1%|▋ | 394/50000 [09:21<14:17:29, 1.04s/it]
Training...: 1%|▋ | 395/50000 [09:22<14:32:05, 1.05s/it]
Training...: 1%|▋ | 396/50000 [09:23<14:53:15, 1.08s/it]
Training...: 1%|▋ | 397/50000 [09:24<15:17:01, 1.11s/it]
Training...: 1%|▋ | 398/50000 [09:26<17:48:38, 1.29s/it]
Training...: 1%|▋ | 399/50000 [09:27<17:40:58, 1.28s/it]
Training...: 1%|▋ | 400/50000 [09:28<17:01:25, 1.24s/it]
Training...: 1%|▋ | 401/50000 [09:29<15:26:17, 1.12s/it]
Training...: 1%|▋ | 402/50000 [09:30<15:03:46, 1.09s/it]
Training...: 1%|▋ | 403/50000 [09:31<14:25:30, 1.05s/it]
Training...: 1%|▊ | 404/50000 [09:32<14:52:01, 1.08s/it]
Training...: 1%|▊ | 405/50000 [09:33<14:20:21, 1.04s/it]
Training...: 1%|▊ | 406/50000 [09:34<14:21:17, 1.04s/it]
Training...: 1%|▊ | 407/50000 [09:35<13:38:08, 1.01it/s]
Training...: 1%|▊ | 408/50000 [09:36<14:04:30, 1.02s/it]
Training...: 1%|▊ | 409/50000 [09:37<14:37:32, 1.06s/it]
Training...: 1%|▊ | 410/50000 [09:38<14:29:37, 1.05s/it]
Training...: 1%|▊ | 411/50000 [09:40<15:17:27, 1.11s/it]
Training...: 1%|▊ | 412/50000 [09:41<15:42:41, 1.14s/it]
Training...: 1%|▊ | 413/50000 [09:42<14:43:04, 1.07s/it]
Training...: 1%|▊ | 414/50000 [09:43<16:53:14, 1.23s/it]
Training...: 1%|▊ | 415/50000 [09:45<17:32:09, 1.27s/it]
Training...: 1%|▊ | 416/50000 [09:46<18:11:38, 1.32s/it]
Training...: 1%|▊ | 417/50000 [09:47<17:25:28, 1.27s/it]
Training...: 1%|▊ | 418/50000 [09:49<17:23:35, 1.26s/it]
Training...: 1%|▊ | 419/50000 [09:50<17:27:41, 1.27s/it]
Training...: 1%|▊ | 420/50000 [09:51<17:14:34, 1.25s/it]
Training...: 1%|▊ | 421/50000 [09:52<16:23:05, 1.19s/it]
Training...: 1%|▊ | 422/50000 [09:54<17:15:30, 1.25s/it]
Training...: 1%|▊ | 423/50000 [09:56<21:14:25, 1.54s/it]
Training...: 1%|▊ | 424/50000 [09:57<18:50:55, 1.37s/it]
Training...: 1%|▊ | 425/50000 [09:58<17:38:06, 1.28s/it]
Training...: 1%|▊ | 426/50000 [09:59<17:19:19, 1.26s/it]
Training...: 1%|▊ | 427/50000 [10:02<22:52:56, 1.66s/it]
Training...: 1%|▊ | 428/50000 [10:03<21:45:59, 1.58s/it]
Training...: 1%|▊ | 429/50000 [10:04<20:32:38, 1.49s/it]
Training...: 1%|▊ | 430/50000 [10:05<18:36:34, 1.35s/it]
Training...: 1%|▊ | 431/50000 [10:07<18:22:13, 1.33s/it]
Training...: 1%|▊ | 432/50000 [10:08<17:34:59, 1.28s/it]
Training...: 1%|▊ | 433/50000 [10:09<16:50:12, 1.22s/it]
Training...: 1%|▊ | 434/50000 [10:10<16:31:07, 1.20s/it]
Training...: 1%|▊ | 435/50000 [10:11<16:53:54, 1.23s/it]
Training...: 1%|▊ | 436/50000 [10:13<17:02:12, 1.24s/it]
Training...: 1%|▊ | 437/50000 [10:14<16:07:04, 1.17s/it]
Training...: 1%|▊ | 438/50000 [10:15<16:18:28, 1.18s/it]
Training...: 1%|▊ | 439/50000 [10:16<16:22:13, 1.19s/it]
Training...: 1%|▊ | 440/50000 [10:17<16:10:46, 1.18s/it]
Training...: 1%|▊ | 441/50000 [10:18<15:49:30, 1.15s/it]
Training...: 1%|▊ | 442/50000 [10:20<17:40:48, 1.28s/it]
Training...: 1%|▊ | 443/50000 [10:22<22:14:38, 1.62s/it]
Training...: 1%|▊ | 444/50000 [10:23<20:37:38, 1.50s/it]
Training...: 1%|▊ | 445/50000 [10:25<19:38:04, 1.43s/it]
Training...: 1%|▊ | 446/50000 [10:26<18:07:36, 1.32s/it]
Training...: 1%|▊ | 447/50000 [10:27<17:25:25, 1.27s/it]
Training...: 1%|▊ | 448/50000 [10:28<17:44:46, 1.29s/it]
Training...: 1%|▊ | 449/50000 [10:30<18:02:12, 1.31s/it]
Training...: 1%|▊ | 450/50000 [10:31<17:54:05, 1.30s/it]
Training...: 1%|▊ | 451/50000 [10:32<17:24:55, 1.27s/it]
Training...: 1%|▊ | 452/50000 [10:33<17:45:54, 1.29s/it]
Training...: 1%|▊ | 453/50000 [10:34<16:31:04, 1.20s/it]
Training...: 1%|▊ | 454/50000 [10:36<16:58:22, 1.23s/it]
Training...: 1%|▊ | 455/50000 [10:37<16:36:49, 1.21s/it]
Training...: 1%|▊ | 456/50000 [10:38<16:14:16, 1.18s/it]
Training...: 1%|▊ | 457/50000 [10:40<18:39:45, 1.36s/it]
Training...: 1%|▊ | 458/50000 [10:41<18:53:46, 1.37s/it]
Training...: 1%|▊ | 459/50000 [10:42<17:52:12, 1.30s/it]
Training...: 1%|▊ | 460/50000 [10:43<16:21:05, 1.19s/it]
Training...: 1%|▊ | 461/50000 [10:44<16:44:34, 1.22s/it]
Training...: 1%|▊ | 462/50000 [10:45<16:01:14, 1.16s/it]
Training...: 1%|▊ | 463/50000 [10:47<16:59:22, 1.23s/it]
Training...: 1%|▊ | 464/50000 [10:48<17:47:12, 1.29s/it]
Training...: 1%|▊ | 465/50000 [10:49<17:11:43, 1.25s/it]
Training...: 1%|▊ | 466/50000 [10:51<16:52:53, 1.23s/it]
Training...: 1%|▊ | 467/50000 [10:53<21:01:29, 1.53s/it]
Training...: 1%|▊ | 468/50000 [10:54<18:41:24, 1.36s/it]
Training...: 1%|▊ | 469/50000 [10:55<18:19:12, 1.33s/it]
Training...: 1%|▊ | 470/50000 [10:56<17:40:08, 1.28s/it]
Training...: 1%|▉ | 471/50000 [10:58<19:36:40, 1.43s/it]
Training...: 1%|▉ | 472/50000 [10:59<18:56:38, 1.38s/it]
Training...: 1%|▉ | 473/50000 [11:00<17:55:34, 1.30s/it]
Training...: 1%|▉ | 474/50000 [11:01<16:48:10, 1.22s/it]
Training...: 1%|▉ | 475/50000 [11:03<17:08:35, 1.25s/it]
Training...: 1%|▉ | 476/50000 [11:04<17:24:52, 1.27s/it]
Training...: 1%|▉ | 477/50000 [11:05<16:48:32, 1.22s/it]
Training...: 1%|▉ | 478/50000 [11:06<15:36:47, 1.14s/it]
Training...: 1%|▉ | 479/50000 [11:07<15:51:12, 1.15s/it]
Training...: 1%|▉ | 480/50000 [11:08<15:30:36, 1.13s/it]
Training...: 1%|▉ | 481/50000 [11:10<15:48:36, 1.15s/it]
Training...: 1%|▉ | 482/50000 [11:11<15:51:19, 1.15s/it]
Training...: 1%|▉ | 483/50000 [11:12<15:43:21, 1.14s/it]
Training...: 1%|▉ | 484/50000 [11:13<16:29:00, 1.20s/it]
Training...: 1%|▉ | 485/50000 [11:14<15:19:44, 1.11s/it]
Training...: 1%|▉ | 486/50000 [11:16<17:33:09, 1.28s/it]
Training...: 1%|▉ | 487/50000 [11:17<16:43:10, 1.22s/it]
Training...: 1%|▉ | 488/50000 [11:18<16:41:21, 1.21s/it]
Training...: 1%|▉ | 489/50000 [11:19<17:34:14, 1.28s/it]
Training...: 1%|▉ | 490/50000 [11:21<16:59:55, 1.24s/it]
Training...: 1%|▉ | 491/50000 [11:22<16:50:43, 1.22s/it]
Training...: 1%|▉ | 492/50000 [11:23<16:29:12, 1.20s/it]
Training...: 1%|▉ | 493/50000 [11:24<15:50:22, 1.15s/it]
Training...: 1%|▉ | 494/50000 [11:25<15:55:37, 1.16s/it]
Training...: 1%|▉ | 495/50000 [11:26<16:32:21, 1.20s/it]
Training...: 1%|▉ | 496/50000 [11:28<15:51:42, 1.15s/it]
Training...: 1%|▉ | 497/50000 [11:29<15:37:28, 1.14s/it]
Training...: 1%|▉ | 498/50000 [11:30<15:11:41, 1.11s/it]
Training...: 1%|▉ | 499/50000 [11:31<14:41:36, 1.07s/it]
Training...: 1%|▉ | 500/50000 [11:32<17:54:57, 1.30s/it]
Training...: 1%|▉ | 500/50000 [11:34<17:54:57, 1.30s/it]
Training...: 1%|▉ | 501/50000 [11:35<22:10:06, 1.61s/it]
Training...: 1%|▉ | 502/50000 [11:36<20:48:13, 1.51s/it]
Training...: 1%|▉ | 503/50000 [11:37<19:48:01, 1.44s/it]
Training...: 1%|▉ | 504/50000 [11:39<19:06:26, 1.39s/it]
Training...: 1%|▉ | 505/50000 [11:40<18:05:32, 1.32s/it]
Training...: 1%|▉ | 506/50000 [11:41<17:49:32, 1.30s/it]
Training...: 1%|▉ | 507/50000 [11:42<16:46:52, 1.22s/it]
Training...: 1%|▉ | 508/50000 [11:43<16:45:13, 1.22s/it]
Training...: 1%|▉ | 509/50000 [11:45<16:50:33, 1.23s/it]
Training...: 1%|▉ | 510/50000 [11:47<20:53:42, 1.52s/it]
Training...: 1%|▉ | 511/50000 [11:48<18:34:49, 1.35s/it]
Training...: 1%|▉ | 512/50000 [11:49<18:12:26, 1.32s/it]
Training...: 1%|▉ | 513/50000 [11:50<17:41:41, 1.29s/it]
Training...: 1%|▉ | 514/50000 [11:51<17:17:43, 1.26s/it]
Training...: 1%|▉ | 515/50000 [11:53<19:10:01, 1.39s/it]
Training...: 1%|▉ | 516/50000 [11:54<18:57:09, 1.38s/it]
Training...: 1%|▉ | 517/50000 [11:56<18:22:54, 1.34s/it]
Training...: 1%|▉ | 518/50000 [11:57<18:23:12, 1.34s/it]
Training...: 1%|▉ | 519/50000 [11:58<17:38:44, 1.28s/it]
Training...: 1%|▉ | 520/50000 [11:59<17:37:28, 1.28s/it]
Training...: 1%|▉ | 521/50000 [12:01<18:11:25, 1.32s/it]
Training...: 1%|▉ | 522/50000 [12:02<17:10:17, 1.25s/it]
Training...: 1%|▉ | 523/50000 [12:03<16:23:31, 1.19s/it]
Training...: 1%|▉ | 524/50000 [12:04<16:03:28, 1.17s/it]
Training...: 1%|▉ | 525/50000 [12:05<15:29:38, 1.13s/it]
Training...: 1%|▉ | 526/50000 [12:06<15:11:31, 1.11s/it]
Training...: 1%|▉ | 527/50000 [12:08<17:01:28, 1.24s/it]
Training...: 1%|▉ | 528/50000 [12:09<16:50:44, 1.23s/it]
Training...: 1%|▉ | 529/50000 [12:11<19:29:32, 1.42s/it]
Training...: 1%|▉ | 530/50000 [12:12<19:04:33, 1.39s/it]
Training...: 1%|▉ | 531/50000 [12:13<18:15:01, 1.33s/it]
Training...: 1%|▉ | 532/50000 [12:14<17:31:58, 1.28s/it]
Training...: 1%|▉ | 533/50000 [12:16<17:24:34, 1.27s/it]
Training...: 1%|▉ | 534/50000 [12:17<16:31:47, 1.20s/it]
Training...: 1%|▉ | 535/50000 [12:18<16:29:49, 1.20s/it]
Training...: 1%|▉ | 536/50000 [12:19<15:47:55, 1.15s/it]
Training...: 1%|▉ | 537/50000 [12:20<16:18:20, 1.19s/it]
Training...: 1%|█ | 538/50000 [12:21<16:32:12, 1.20s/it]
Training...: 1%|█ | 539/50000 [12:23<16:22:19, 1.19s/it]
Training...: 1%|█ | 540/50000 [12:24<16:54:57, 1.23s/it]
Training...: 1%|█ | 541/50000 [12:25<16:51:38, 1.23s/it]
Training...: 1%|█ | 542/50000 [12:26<16:15:48, 1.18s/it]
Training...: 1%|█ | 543/50000 [12:27<15:38:18, 1.14s/it]
Training...: 1%|█ | 544/50000 [12:29<17:33:12, 1.28s/it]
Training...: 1%|█ | 545/50000 [12:30<16:57:44, 1.23s/it]
Training...: 1%|█ | 546/50000 [12:31<16:23:58, 1.19s/it]
Training...: 1%|█ | 547/50000 [12:32<16:19:19, 1.19s/it]
Training...: 1%|█ | 548/50000 [12:33<15:37:54, 1.14s/it]
Training...: 1%|█ | 549/50000 [12:35<16:07:07, 1.17s/it]
Training...: 1%|█ | 550/50000 [12:36<16:19:55, 1.19s/it]
Training...: 1%|█ | 551/50000 [12:37<17:11:18, 1.25s/it]
Training...: 1%|█ | 552/50000 [12:39<17:27:54, 1.27s/it]
Training...: 1%|█ | 553/50000 [12:40<18:18:49, 1.33s/it]
Training...: 1%|█ | 554/50000 [12:42<21:49:10, 1.59s/it]
Training...: 1%|█ | 555/50000 [12:43<19:52:41, 1.45s/it]
Training...: 1%|█ | 556/50000 [12:45<19:32:27, 1.42s/it]
Training...: 1%|█ | 557/50000 [12:46<17:58:32, 1.31s/it]
Training...: 1%|█ | 558/50000 [12:48<20:51:14, 1.52s/it]
Training...: 1%|█ | 559/50000 [12:49<18:30:09, 1.35s/it]
Training...: 1%|█ | 560/50000 [12:50<17:49:59, 1.30s/it]
Training...: 1%|█ | 561/50000 [12:51<17:57:52, 1.31s/it]
Training...: 1%|█ | 562/50000 [12:52<17:11:17, 1.25s/it]
Training...: 1%|█ | 563/50000 [12:54<17:14:15, 1.26s/it]
Training...: 1%|█ | 564/50000 [12:55<16:12:31, 1.18s/it]
Training...: 1%|█ | 565/50000 [12:56<15:49:19, 1.15s/it]
Training...: 1%|█ | 566/50000 [12:57<14:55:52, 1.09s/it]
Training...: 1%|█ | 567/50000 [12:58<15:17:39, 1.11s/it]
Training...: 1%|█ | 568/50000 [12:59<16:23:45, 1.19s/it]
Training...: 1%|█ | 569/50000 [13:01<17:01:39, 1.24s/it]
Training...: 1%|█ | 570/50000 [13:02<17:05:52, 1.25s/it]
Training...: 1%|█ | 571/50000 [13:03<17:21:33, 1.26s/it]
Training...: 1%|█ | 572/50000 [13:04<17:10:07, 1.25s/it]
Training...: 1%|█ | 573/50000 [13:06<20:14:27, 1.47s/it]
Training...: 1%|█ | 574/50000 [13:07<18:34:06, 1.35s/it]
Training...: 1%|█ | 575/50000 [13:09<18:18:39, 1.33s/it]
Training...: 1%|█ | 576/50000 [13:10<17:34:47, 1.28s/it]
Training...: 1%|█ | 577/50000 [13:11<16:48:37, 1.22s/it]
Training...: 1%|█ | 578/50000 [13:12<17:08:40, 1.25s/it]
Training...: 1%|█ | 579/50000 [13:13<17:09:53, 1.25s/it]
Training...: 1%|█ | 580/50000 [13:15<17:32:46, 1.28s/it]
Training...: 1%|█ | 581/50000 [13:16<17:06:38, 1.25s/it]
Training...: 1%|█ | 582/50000 [13:17<17:09:21, 1.25s/it]
Training...: 1%|█ | 583/50000 [13:18<16:53:30, 1.23s/it]
Training...: 1%|█ | 584/50000 [13:20<16:35:49, 1.21s/it]
Training...: 1%|█ | 585/50000 [13:21<16:57:18, 1.24s/it]
Training...: 1%|█ | 586/50000 [13:22<16:13:10, 1.18s/it]
Training...: 1%|█ | 587/50000 [13:24<18:24:30, 1.34s/it]
Training...: 1%|█ | 588/50000 [13:25<17:42:39, 1.29s/it]
Training...: 1%|█ | 589/50000 [13:26<17:20:30, 1.26s/it]
Training...: 1%|█ | 590/50000 [13:27<17:24:52, 1.27s/it]
Training...: 1%|█ | 591/50000 [13:28<17:08:05, 1.25s/it]
Training...: 1%|█ | 592/50000 [13:30<17:04:10, 1.24s/it]
Training...: 1%|█ | 593/50000 [13:31<17:18:31, 1.26s/it]
Training...: 1%|█ | 594/50000 [13:32<17:09:38, 1.25s/it]
Training...: 1%|█ | 595/50000 [13:33<17:04:08, 1.24s/it]
Training...: 1%|█ | 596/50000 [13:35<16:11:13, 1.18s/it]
Training...: 1%|█ | 597/50000 [13:36<16:54:58, 1.23s/it]
Training...: 1%|█ | 598/50000 [13:38<21:15:36, 1.55s/it]
Training...: 1%|█ | 599/50000 [13:39<19:12:09, 1.40s/it]
Training...: 1%|█ | 600/50000 [13:40<17:29:57, 1.28s/it]
Training...: 1%|█ | 601/50000 [13:42<18:55:28, 1.38s/it]
Training...: 1%|█ | 602/50000 [13:43<17:40:20, 1.29s/it]
Training...: 1%|█ | 603/50000 [13:44<17:06:59, 1.25s/it]
Training...: 1%|█ | 604/50000 [13:45<16:47:46, 1.22s/it]
Training...: 1%|█▏ | 605/50000 [13:46<16:50:24, 1.23s/it]
Training...: 1%|█▏ | 606/50000 [13:48<16:31:27, 1.20s/it]
Training...: 1%|█▏ | 607/50000 [13:49<17:01:08, 1.24s/it]
Training...: 1%|█▏ | 608/50000 [13:50<16:45:40, 1.22s/it]
Training...: 1%|█▏ | 609/50000 [13:51<15:07:47, 1.10s/it]
Training...: 1%|█▏ | 610/50000 [13:52<15:53:07, 1.16s/it]
Training...: 1%|█▏ | 611/50000 [13:53<15:40:18, 1.14s/it]
Training...: 1%|█▏ | 612/50000 [13:54<15:17:05, 1.11s/it]
Training...: 1%|█▏ | 613/50000 [13:56<15:36:57, 1.14s/it]
Training...: 1%|█▏ | 614/50000 [13:57<15:49:40, 1.15s/it]
Training...: 1%|█▏ | 615/50000 [13:58<16:10:21, 1.18s/it]
Training...: 1%|█▏ | 616/50000 [14:00<18:20:19, 1.34s/it]
Training...: 1%|█▏ | 617/50000 [14:01<17:59:22, 1.31s/it]
Training...: 1%|█▏ | 618/50000 [14:02<18:00:55, 1.31s/it]
Training...: 1%|█▏ | 619/50000 [14:03<17:30:03, 1.28s/it]
Training...: 1%|█▏ | 620/50000 [14:04<16:21:54, 1.19s/it]
Training...: 1%|█▏ | 621/50000 [14:06<16:12:56, 1.18s/it]
Training...: 1%|█▏ | 622/50000 [14:07<16:19:09, 1.19s/it]
Training...: 1%|█▏ | 623/50000 [14:08<16:34:37, 1.21s/it]
Training...: 1%|█▏ | 624/50000 [14:09<16:39:09, 1.21s/it]
Training...: 1%|█▏ | 625/50000 [14:11<16:54:12, 1.23s/it]
Training...: 1%|█▏ | 626/50000 [14:12<17:11:58, 1.25s/it]
Training...: 1%|█▏ | 627/50000 [14:13<16:39:50, 1.22s/it]
Training...: 1%|█▏ | 628/50000 [14:14<16:59:03, 1.24s/it]
Training...: 1%|█▏ | 629/50000 [14:15<16:45:28, 1.22s/it]
Training...: 1%|█▏ | 630/50000 [14:18<20:22:11, 1.49s/it]
Training...: 1%|█▏ | 631/50000 [14:19<19:04:50, 1.39s/it]
Training...: 1%|█▏ | 632/50000 [14:20<18:06:16, 1.32s/it]
Training...: 1%|█▏ | 633/50000 [14:21<17:09:20, 1.25s/it]
Training...: 1%|█▏ | 634/50000 [14:22<16:52:53, 1.23s/it]
Training...: 1%|█▏ | 635/50000 [14:24<17:23:04, 1.27s/it]
Training...: 1%|█▏ | 636/50000 [14:25<17:33:09, 1.28s/it]
Training...: 1%|█▏ | 637/50000 [14:26<17:47:35, 1.30s/it]
Training...: 1%|█▏ | 638/50000 [14:27<17:10:05, 1.25s/it]
Training...: 1%|█▏ | 639/50000 [14:29<17:17:27, 1.26s/it]
Training...: 1%|█▏ | 640/50000 [14:30<17:24:56, 1.27s/it]
Training...: 1%|█▏ | 641/50000 [14:31<17:09:00, 1.25s/it]
Training...: 1%|█▏ | 642/50000 [14:33<21:21:46, 1.56s/it]
Training...: 1%|█▏ | 643/50000 [14:34<19:31:44, 1.42s/it]
Training...: 1%|█▏ | 644/50000 [14:36<19:20:45, 1.41s/it]
Training...: 1%|█▏ | 645/50000 [14:39<26:05:57, 1.90s/it]
Training...: 1%|█▏ | 646/50000 [14:40<22:45:26, 1.66s/it]
Training...: 1%|█▏ | 647/50000 [14:41<20:56:50, 1.53s/it]
Training...: 1%|█▏ | 648/50000 [14:42<19:49:11, 1.45s/it]
Training...: 1%|█▏ | 649/50000 [14:44<19:22:58, 1.41s/it]
Training...: 1%|█▏ | 650/50000 [14:45<18:44:27, 1.37s/it]
Training...: 1%|█▏ | 651/50000 [14:46<18:26:50, 1.35s/it]
Training...: 1%|█▏ | 652/50000 [14:48<17:37:22, 1.29s/it]
Training...: 1%|█▏ | 653/50000 [14:49<17:31:09, 1.28s/it]
Training...: 1%|█▏ | 654/50000 [14:50<17:54:27, 1.31s/it]
Training...: 1%|█▏ | 655/50000 [14:51<16:59:03, 1.24s/it]
Training...: 1%|█▏ | 656/50000 [14:52<16:41:37, 1.22s/it]
Training...: 1%|█▏ | 657/50000 [14:53<15:51:00, 1.16s/it]
Training...: 1%|█▏ | 658/50000 [14:57<27:04:33, 1.98s/it]
Training...: 1%|█▏ | 659/50000 [14:59<24:43:57, 1.80s/it]
Training...: 1%|█▏ | 660/50000 [15:00<21:30:16, 1.57s/it]
Training...: 1%|█▏ | 661/50000 [15:01<20:49:02, 1.52s/it]
Training...: 1%|█▏ | 662/50000 [15:02<19:05:02, 1.39s/it]
Training...: 1%|█▏ | 663/50000 [15:03<18:12:39, 1.33s/it]
Training...: 1%|█▏ | 664/50000 [15:05<17:24:13, 1.27s/it]
Training...: 1%|█▏ | 665/50000 [15:06<16:33:38, 1.21s/it]
Training...: 1%|█▏ | 666/50000 [15:07<16:33:09, 1.21s/it]
Training...: 1%|█▏ | 667/50000 [15:08<15:55:09, 1.16s/it]
Training...: 1%|█▏ | 668/50000 [15:09<16:41:09, 1.22s/it]
Training...: 1%|█▏ | 669/50000 [15:10<16:08:56, 1.18s/it]
Training...: 1%|█▏ | 670/50000 [15:11<16:12:35, 1.18s/it]
Training...: 1%|█▏ | 671/50000 [15:13<16:45:38, 1.22s/it]
Training...: 1%|█▏ | 672/50000 [15:14<17:15:03, 1.26s/it]
Training...: 1%|█▎ | 673/50000 [15:17<24:24:39, 1.78s/it]
Training...: 1%|█▎ | 674/50000 [15:18<21:51:40, 1.60s/it]
Training...: 1%|█▎ | 675/50000 [15:20<20:32:10, 1.50s/it]
Training...: 1%|█▎ | 676/50000 [15:21<19:05:52, 1.39s/it]
Training...: 1%|█▎ | 677/50000 [15:22<19:44:14, 1.44s/it]
Training...: 1%|█▎ | 678/50000 [15:23<18:23:46, 1.34s/it]
Training...: 1%|█▎ | 679/50000 [15:24<16:36:20, 1.21s/it]
Training...: 1%|█▎ | 680/50000 [15:25<16:06:09, 1.18s/it]
Training...: 1%|█▎ | 681/50000 [15:26<15:41:49, 1.15s/it]
Training...: 1%|█▎ | 682/50000 [15:28<15:57:32, 1.16s/it]
Training...: 1%|█▎ | 683/50000 [15:29<15:36:54, 1.14s/it]
Training...: 1%|█▎ | 684/50000 [15:30<16:14:34, 1.19s/it]
Training...: 1%|█▎ | 685/50000 [15:32<17:51:34, 1.30s/it]
Training...: 1%|█▎ | 686/50000 [15:34<21:28:10, 1.57s/it]
Training...: 1%|█▎ | 687/50000 [15:37<26:55:26, 1.97s/it]
Training...: 1%|█▎ | 688/50000 [15:38<23:11:50, 1.69s/it]
Training...: 1%|█▎ | 689/50000 [15:39<20:33:41, 1.50s/it]
Training...: 1%|█▎ | 690/50000 [15:40<18:15:45, 1.33s/it]
Training...: 1%|█▎ | 691/50000 [15:41<18:20:31, 1.34s/it]
Training...: 1%|█▎ | 692/50000 [15:42<18:13:04, 1.33s/it]
Training...: 1%|█▎ | 693/50000 [15:43<16:58:10, 1.24s/it]
Training...: 1%|█▎ | 694/50000 [15:45<16:32:41, 1.21s/it]
Training...: 1%|█▎ | 695/50000 [15:46<16:32:01, 1.21s/it]
Training...: 1%|█▎ | 696/50000 [15:47<16:16:31, 1.19s/it]
Training...: 1%|█▎ | 697/50000 [15:48<16:12:24, 1.18s/it]
Training...: 1%|█▎ | 698/50000 [15:49<16:06:54, 1.18s/it]
Training...: 1%|█▎ | 699/50000 [15:51<16:45:35, 1.22s/it]
Training...: 1%|█▎ | 700/50000 [15:52<16:57:06, 1.24s/it]
Training...: 1%|█▎ | 701/50000 [15:53<17:00:57, 1.24s/it]
Training...: 1%|█▎ | 702/50000 [15:56<24:37:45, 1.80s/it]
Training...: 1%|█▎ | 703/50000 [15:57<22:10:23, 1.62s/it]
Training...: 1%|█▎ | 704/50000 [15:59<20:40:41, 1.51s/it]
Training...: 1%|█▎ | 705/50000 [16:00<19:42:48, 1.44s/it]
Training...: 1%|█▎ | 706/50000 [16:01<18:59:27, 1.39s/it]
Training...: 1%|█▎ | 707/50000 [16:02<17:52:34, 1.31s/it]
Training...: 1%|█▎ | 708/50000 [16:03<17:04:31, 1.25s/it]
Training...: 1%|█▎ | 709/50000 [16:05<17:49:28, 1.30s/it]
Training...: 1%|█▎ | 710/50000 [16:06<17:47:39, 1.30s/it]
Training...: 1%|█▎ | 711/50000 [16:07<16:55:58, 1.24s/it]
Training...: 1%|█▎ | 712/50000 [16:08<16:36:44, 1.21s/it]
Training...: 1%|█▎ | 713/50000 [16:10<16:07:15, 1.18s/it]
Training...: 1%|█▎ | 714/50000 [16:11<16:32:51, 1.21s/it]
Training...: 1%|█▎ | 715/50000 [16:12<16:05:12, 1.18s/it]
Training...: 1%|█▎ | 716/50000 [16:15<22:59:42, 1.68s/it]
Training...: 1%|█▎ | 717/50000 [16:16<19:42:07, 1.44s/it]
Training...: 1%|█▎ | 718/50000 [16:17<17:39:56, 1.29s/it]
Training...: 1%|█▎ | 719/50000 [16:18<16:49:56, 1.23s/it]
Training...: 1%|█▎ | 720/50000 [16:19<16:26:08, 1.20s/it]
Training...: 1%|█▎ | 721/50000 [16:20<16:14:36, 1.19s/it]
Training...: 1%|█▎ | 722/50000 [16:21<16:28:05, 1.20s/it]
Training...: 1%|█▎ | 723/50000 [16:22<15:55:01, 1.16s/it]
Training...: 1%|█▎ | 724/50000 [16:23<16:05:22, 1.18s/it]
Training...: 1%|█▎ | 725/50000 [16:25<16:15:34, 1.19s/it]
Training...: 1%|█▎ | 726/50000 [16:26<16:41:28, 1.22s/it]
Training...: 1%|█▎ | 727/50000 [16:27<16:19:18, 1.19s/it]
Training...: 1%|█▎ | 728/50000 [16:28<16:25:40, 1.20s/it]
Training...: 1%|█▎ | 729/50000 [16:29<15:46:01, 1.15s/it]
Training...: 1%|█▎ | 730/50000 [16:32<20:10:58, 1.47s/it]
Training...: 1%|█▎ | 731/50000 [16:34<24:34:07, 1.80s/it]
Training...: 1%|█▎ | 732/50000 [16:35<22:39:27, 1.66s/it]
Training...: 1%|█▎ | 733/50000 [16:36<19:56:33, 1.46s/it]
Training...: 1%|█▎ | 734/50000 [16:38<19:02:33, 1.39s/it]
Training...: 1%|█▎ | 735/50000 [16:39<17:50:52, 1.30s/it]
Training...: 1%|█▎ | 736/50000 [16:40<17:24:28, 1.27s/it]
Training...: 1%|█▎ | 737/50000 [16:41<16:40:51, 1.22s/it]
Training...: 1%|█▎ | 738/50000 [16:42<16:06:21, 1.18s/it]
Training...: 1%|█▎ | 739/50000 [16:43<15:26:47, 1.13s/it]
Training...: 1%|█▍ | 740/50000 [16:44<15:07:11, 1.10s/it]
Training...: 1%|█▍ | 741/50000 [16:45<14:27:46, 1.06s/it]
Training...: 1%|█▍ | 742/50000 [16:46<14:45:28, 1.08s/it]
Training...: 1%|█▍ | 743/50000 [16:47<15:12:07, 1.11s/it]
Training...: 1%|█▍ | 744/50000 [16:49<17:04:15, 1.25s/it]
Training...: 1%|█▍ | 745/50000 [16:51<18:03:45, 1.32s/it]
Training...: 1%|█▍ | 746/50000 [16:53<23:47:43, 1.74s/it]
Training...: 1%|█▍ | 747/50000 [16:54<21:06:43, 1.54s/it]
Training...: 1%|█▍ | 748/50000 [16:55<18:17:04, 1.34s/it]
Training...: 1%|█▍ | 749/50000 [16:56<17:12:37, 1.26s/it]
Training...: 2%|█▍ | 750/50000 [16:57<16:53:56, 1.24s/it]
Training...: 2%|█▍ | 751/50000 [16:59<16:55:15, 1.24s/it]
Training...: 2%|█▍ | 752/50000 [17:00<16:48:49, 1.23s/it]
Training...: 2%|█▍ | 753/50000 [17:01<17:09:27, 1.25s/it]
Training...: 2%|█▍ | 754/50000 [17:02<16:52:39, 1.23s/it]
Training...: 2%|█▍ | 755/50000 [17:04<16:42:19, 1.22s/it]
Training...: 2%|█▍ | 756/50000 [17:05<16:52:57, 1.23s/it]
Training...: 2%|█▍ | 757/50000 [17:06<16:00:22, 1.17s/it]
Training...: 2%|█▍ | 758/50000 [17:07<15:08:48, 1.11s/it]
Training...: 2%|█▍ | 759/50000 [17:08<14:59:02, 1.10s/it]
Training...: 2%|█▍ | 760/50000 [17:09<16:36:04, 1.21s/it]
Training...: 2%|█▍ | 761/50000 [17:12<23:00:13, 1.68s/it]
Training...: 2%|█▍ | 762/50000 [17:13<20:57:52, 1.53s/it]
Training...: 2%|█▍ | 763/50000 [17:14<19:05:42, 1.40s/it]
Training...: 2%|█▍ | 764/50000 [17:16<18:48:45, 1.38s/it]
Training...: 2%|█▍ | 765/50000 [17:17<17:26:46, 1.28s/it]
Training...: 2%|█▍ | 766/50000 [17:18<18:06:27, 1.32s/it]
Training...: 2%|█▍ | 767/50000 [17:20<17:49:23, 1.30s/it]
Training...: 2%|█▍ | 768/50000 [17:21<17:31:41, 1.28s/it]
Training...: 2%|█▍ | 769/50000 [17:22<16:54:01, 1.24s/it]
Training...: 2%|█▍ | 770/50000 [17:23<16:58:52, 1.24s/it]
Training...: 2%|█▍ | 771/50000 [17:24<16:44:17, 1.22s/it]
Training...: 2%|█▍ | 772/50000 [17:25<16:25:52, 1.20s/it]
Training...: 2%|█▍ | 773/50000 [17:27<16:39:51, 1.22s/it]
Training...: 2%|█▍ | 774/50000 [17:29<20:14:14, 1.48s/it]
Training...: 2%|█▍ | 775/50000 [17:32<25:44:48, 1.88s/it]
Training...: 2%|█▍ | 776/50000 [17:33<23:00:23, 1.68s/it]
Training...: 2%|█▍ | 777/50000 [17:34<20:29:18, 1.50s/it]
Training...: 2%|█▍ | 778/50000 [17:35<19:12:54, 1.41s/it]
Training...: 2%|█▍ | 779/50000 [17:36<17:47:53, 1.30s/it]
Training...: 2%|█▍ | 780/50000 [17:37<16:37:49, 1.22s/it]
Training...: 2%|█▍ | 781/50000 [17:39<17:13:16, 1.26s/it]
Training...: 2%|█▍ | 782/50000 [17:40<16:14:48, 1.19s/it]
Training...: 2%|█▍ | 783/50000 [17:41<16:55:12, 1.24s/it]
Training...: 2%|█▍ | 784/50000 [17:42<17:21:30, 1.27s/it]
Training...: 2%|█▍ | 785/50000 [17:43<16:40:00, 1.22s/it]
Training...: 2%|█▍ | 786/50000 [17:45<17:03:13, 1.25s/it]
Training...: 2%|█▍ | 787/50000 [17:46<17:25:51, 1.28s/it]
Training...: 2%|█▍ | 788/50000 [17:47<17:35:41, 1.29s/it]
Training...: 2%|█▍ | 789/50000 [17:50<23:28:13, 1.72s/it]
Training...: 2%|█▍ | 790/50000 [17:51<20:58:37, 1.53s/it]
Training...: 2%|█▍ | 791/50000 [17:53<20:19:14, 1.49s/it]
Training...: 2%|█▍ | 792/50000 [17:53<17:41:45, 1.29s/it]
Training...: 2%|█▍ | 793/50000 [17:55<18:39:19, 1.36s/it]
Training...: 2%|█▍ | 794/50000 [17:56<17:50:58, 1.31s/it]
Training...: 2%|█▍ | 795/50000 [17:57<17:17:00, 1.26s/it]
Training...: 2%|█▍ | 796/50000 [17:58<16:58:07, 1.24s/it]
Training...: 2%|█▍ | 797/50000 [18:00<17:17:17, 1.26s/it]
Training...: 2%|█▍ | 798/50000 [18:01<16:55:21, 1.24s/it]
Training...: 2%|█▍ | 799/50000 [18:02<17:15:15, 1.26s/it]
Training...: 2%|█▍ | 800/50000 [18:03<17:10:46, 1.26s/it]
Training...: 2%|█▍ | 801/50000 [18:05<17:26:37, 1.28s/it]
Training...: 2%|█▍ | 802/50000 [18:06<17:13:45, 1.26s/it]
Training...: 2%|█▍ | 803/50000 [18:07<17:16:24, 1.26s/it]
Training...: 2%|█▍ | 804/50000 [18:10<23:06:01, 1.69s/it]
Training...: 2%|█▍ | 805/50000 [18:11<22:06:42, 1.62s/it]
Training...: 2%|█▍ | 806/50000 [18:12<19:38:48, 1.44s/it]
Training...: 2%|█▌ | 807/50000 [18:14<18:56:10, 1.39s/it]
Training...: 2%|█▌ | 808/50000 [18:15<18:53:17, 1.38s/it]
Training...: 2%|█▌ | 809/50000 [18:16<18:05:35, 1.32s/it]
Training...: 2%|█▌ | 810/50000 [18:18<18:10:18, 1.33s/it]
Training...: 2%|█▌ | 811/50000 [18:19<17:26:08, 1.28s/it]
Training...: 2%|█▌ | 812/50000 [18:20<18:03:59, 1.32s/it]
Training...: 2%|█▌ | 813/50000 [18:21<16:10:40, 1.18s/it]
Training...: 2%|█▌ | 814/50000 [18:22<14:35:12, 1.07s/it]
Training...: 2%|█▌ | 815/50000 [18:23<15:51:06, 1.16s/it]
Training...: 2%|█▌ | 816/50000 [18:24<13:51:41, 1.01s/it]
Training...: 2%|█▌ | 817/50000 [18:25<14:24:24, 1.05s/it]
Training...: 2%|█▌ | 818/50000 [18:29<25:18:25, 1.85s/it]
Training...: 2%|█▌ | 819/50000 [18:30<22:54:09, 1.68s/it]
Training...: 2%|█▌ | 820/50000 [18:31<19:36:33, 1.44s/it]
Training...: 2%|█▌ | 821/50000 [18:32<18:00:19, 1.32s/it]
Training...: 2%|█▌ | 822/50000 [18:33<16:34:54, 1.21s/it]
Training...: 2%|█▌ | 823/50000 [18:34<16:37:30, 1.22s/it]
Training...: 2%|█▌ | 824/50000 [18:35<16:08:38, 1.18s/it]
Training...: 2%|█▌ | 825/50000 [18:36<15:59:52, 1.17s/it]
Training...: 2%|█▌ | 826/50000 [18:38<16:00:36, 1.17s/it]
Training...: 2%|█▌ | 827/50000 [18:39<16:11:50, 1.19s/it]
Training...: 2%|█▌ | 828/50000 [18:40<16:47:12, 1.23s/it]
Training...: 2%|█▌ | 829/50000 [18:41<16:39:03, 1.22s/it]
Training...: 2%|█▌ | 830/50000 [18:43<17:03:39, 1.25s/it]
Training...: 2%|█▌ | 831/50000 [18:44<17:14:02, 1.26s/it]
Training...: 2%|█▌ | 832/50000 [18:45<17:15:54, 1.26s/it]
Training...: 2%|█▌ | 833/50000 [18:48<22:56:58, 1.68s/it]
Training...: 2%|█▌ | 834/50000 [18:49<20:40:50, 1.51s/it]
Training...: 2%|█▌ | 835/50000 [18:50<19:42:20, 1.44s/it]
Training...: 2%|█▌ | 836/50000 [18:52<19:15:00, 1.41s/it]
Training...: 2%|█▌ | 837/50000 [18:53<18:58:11, 1.39s/it]
Training...: 2%|█▌ | 838/50000 [18:54<18:15:40, 1.34s/it]
Training...: 2%|█▌ | 839/50000 [18:55<17:00:02, 1.24s/it]
Training...: 2%|█▌ | 840/50000 [18:57<17:29:11, 1.28s/it]
Training...: 2%|█▌ | 841/50000 [18:58<17:40:50, 1.29s/it]
Training...: 2%|█▌ | 842/50000 [18:59<17:47:01, 1.30s/it]
Training...: 2%|█▌ | 843/50000 [19:00<17:24:44, 1.28s/it]
Training...: 2%|█▌ | 844/50000 [19:02<17:00:58, 1.25s/it]
Training...: 2%|█▌ | 845/50000 [19:03<16:16:48, 1.19s/it]
Training...: 2%|█▌ | 846/50000 [19:04<16:12:01, 1.19s/it]
Training...: 2%|█▌ | 847/50000 [19:05<15:29:53, 1.14s/it]
Training...: 2%|█▌ | 848/50000 [19:08<21:56:45, 1.61s/it]
Training...: 2%|█▌ | 849/50000 [19:09<19:45:52, 1.45s/it]
Training...: 2%|█▌ | 850/50000 [19:10<18:00:32, 1.32s/it]
Training...: 2%|█▌ | 851/50000 [19:12<21:50:11, 1.60s/it]
Training...: 2%|█▌ | 852/50000 [19:13<19:51:26, 1.45s/it]
Training...: 2%|█▌ | 853/50000 [19:14<17:30:52, 1.28s/it]
Training...: 2%|█▌ | 854/50000 [19:15<17:04:09, 1.25s/it]
Training...: 2%|█▌ | 855/50000 [19:16<17:15:04, 1.26s/it]
Training...: 2%|█▌ | 856/50000 [19:17<16:42:56, 1.22s/it]
Training...: 2%|█▌ | 857/50000 [19:18<15:34:28, 1.14s/it]
Training...: 2%|█▌ | 858/50000 [19:20<15:49:19, 1.16s/it]
Training...: 2%|█▌ | 859/50000 [19:21<15:52:33, 1.16s/it]
Training...: 2%|█▌ | 860/50000 [19:22<16:05:43, 1.18s/it]
Training...: 2%|█▌ | 861/50000 [19:23<16:41:22, 1.22s/it]
Training...: 2%|█▌ | 862/50000 [19:26<20:30:04, 1.50s/it]
Training...: 2%|█▌ | 863/50000 [19:27<18:49:45, 1.38s/it]
Training...: 2%|█▌ | 864/50000 [19:28<18:29:19, 1.35s/it]
Training...: 2%|█▌ | 865/50000 [19:29<17:39:42, 1.29s/it]
Training...: 2%|█▌ | 866/50000 [19:31<20:08:14, 1.48s/it]
Training...: 2%|█▌ | 867/50000 [19:32<18:34:49, 1.36s/it]
Training...: 2%|█▌ | 868/50000 [19:33<17:55:55, 1.31s/it]
Training...: 2%|█▌ | 869/50000 [19:34<16:38:46, 1.22s/it]
Training...: 2%|█▌ | 870/50000 [19:35<16:03:48, 1.18s/it]
Training...: 2%|█▌ | 871/50000 [19:36<15:57:25, 1.17s/it]
Training...: 2%|█▌ | 872/50000 [19:38<15:48:52, 1.16s/it]
Training...: 2%|█▌ | 873/50000 [19:39<14:54:49, 1.09s/it]
Training...: 2%|█▋ | 874/50000 [19:40<15:57:47, 1.17s/it]
Training...: 2%|█▋ | 875/50000 [19:41<16:34:41, 1.21s/it]
Training...: 2%|█▋ | 876/50000 [19:42<16:14:01, 1.19s/it]
Training...: 2%|█▋ | 877/50000 [19:44<16:30:14, 1.21s/it]
Training...: 2%|█▋ | 878/50000 [19:45<16:04:02, 1.18s/it]
Training...: 2%|█▋ | 879/50000 [19:46<16:24:09, 1.20s/it]
Training...: 2%|█▋ | 880/50000 [19:48<17:59:14, 1.32s/it]
Training...: 2%|█▋ | 881/50000 [19:49<17:11:52, 1.26s/it]
Training...: 2%|█▋ | 882/50000 [19:50<16:55:19, 1.24s/it]
Training...: 2%|█▋ | 883/50000 [19:51<17:22:08, 1.27s/it]
Training...: 2%|█▋ | 884/50000 [19:52<16:44:52, 1.23s/it]
Training...: 2%|█▋ | 885/50000 [19:54<17:29:51, 1.28s/it]
Training...: 2%|█▋ | 886/50000 [19:55<16:51:14, 1.24s/it]
Training...: 2%|█▋ | 887/50000 [19:56<17:08:02, 1.26s/it]
Training...: 2%|█▋ | 888/50000 [19:57<16:57:35, 1.24s/it]
Training...: 2%|█▋ | 889/50000 [19:59<16:56:21, 1.24s/it]
Training...: 2%|█▋ | 890/50000 [20:00<16:19:49, 1.20s/it]
Training...: 2%|█▋ | 891/50000 [20:01<17:00:12, 1.25s/it]
Training...: 2%|█▋ | 892/50000 [20:02<17:24:10, 1.28s/it]
Training...: 2%|█▋ | 893/50000 [20:04<19:53:08, 1.46s/it]
Training...: 2%|█▋ | 894/50000 [20:06<19:07:44, 1.40s/it]
Training...: 2%|█▋ | 895/50000 [20:07<18:22:35, 1.35s/it]
Training...: 2%|█▋ | 896/50000 [20:08<18:22:10, 1.35s/it]
Training...: 2%|█▋ | 897/50000 [20:09<17:21:18, 1.27s/it]
Training...: 2%|█▋ | 898/50000 [20:10<17:01:48, 1.25s/it]
Training...: 2%|█▋ | 899/50000 [20:12<17:03:40, 1.25s/it]
Training...: 2%|█▋ | 900/50000 [20:13<16:02:23, 1.18s/it]
Training...: 2%|█▋ | 901/50000 [20:14<17:12:13, 1.26s/it]
Training...: 2%|█▋ | 902/50000 [20:16<17:41:52, 1.30s/it]
Training...: 2%|█▋ | 903/50000 [20:17<17:27:10, 1.28s/it]
Training...: 2%|█▋ | 904/50000 [20:18<17:12:44, 1.26s/it]
Training...: 2%|█▋ | 905/50000 [20:19<16:30:54, 1.21s/it]
Training...: 2%|█▋ | 906/50000 [20:21<20:22:50, 1.49s/it]
Training...: 2%|█▋ | 907/50000 [20:23<19:33:40, 1.43s/it]
Training...: 2%|█▋ | 908/50000 [20:24<20:32:11, 1.51s/it]
Training...: 2%|█▋ | 909/50000 [20:25<19:34:14, 1.44s/it]
Training...: 2%|█▋ | 910/50000 [20:26<17:21:09, 1.27s/it]
Training...: 2%|█▋ | 911/50000 [20:28<17:07:43, 1.26s/it]
Training...: 2%|█▋ | 912/50000 [20:29<17:05:45, 1.25s/it]
Training...: 2%|█▋ | 913/50000 [20:30<17:31:46, 1.29s/it]
Training...: 2%|█▋ | 914/50000 [20:31<17:08:02, 1.26s/it]
Training...: 2%|█▋ | 915/50000 [20:33<16:30:29, 1.21s/it]
Training...: 2%|█▋ | 916/50000 [20:34<16:49:41, 1.23s/it]
Training...: 2%|█▋ | 917/50000 [20:35<16:51:27, 1.24s/it]
Training...: 2%|█▋ | 918/50000 [20:36<16:05:51, 1.18s/it]
Training...: 2%|█▋ | 919/50000 [20:37<16:13:15, 1.19s/it]
Training...: 2%|█▋ | 920/50000 [20:39<17:21:29, 1.27s/it]
Training...: 2%|█▋ | 921/50000 [20:40<16:45:45, 1.23s/it]
Training...: 2%|█▋ | 922/50000 [20:42<18:18:27, 1.34s/it]
Training...: 2%|█▋ | 923/50000 [20:43<18:18:48, 1.34s/it]
Training...: 2%|█▋ | 924/50000 [20:44<18:01:52, 1.32s/it]
Training...: 2%|█▋ | 925/50000 [20:45<16:57:26, 1.24s/it]
Training...: 2%|█▋ | 926/50000 [20:46<15:50:25, 1.16s/it]
Training...: 2%|█▋ | 927/50000 [20:47<15:47:15, 1.16s/it]
Training...: 2%|█▋ | 928/50000 [20:48<15:49:49, 1.16s/it]
Training...: 2%|█▋ | 929/50000 [20:50<15:24:33, 1.13s/it]
Training...: 2%|█▋ | 930/50000 [20:51<15:11:54, 1.12s/it]
Training...: 2%|█▋ | 931/50000 [20:52<15:56:40, 1.17s/it]
Training...: 2%|█▋ | 932/50000 [20:53<15:34:20, 1.14s/it]
Training...: 2%|█▋ | 933/50000 [20:54<16:05:00, 1.18s/it]
Training...: 2%|█▋ | 934/50000 [20:56<16:22:28, 1.20s/it]
Training...: 2%|█▋ | 935/50000 [20:57<15:58:40, 1.17s/it]
Training...: 2%|█▋ | 936/50000 [20:58<18:09:12, 1.33s/it]
Training...: 2%|█▋ | 937/50000 [20:59<16:48:30, 1.23s/it]
Training...: 2%|█▋ | 938/50000 [21:01<17:07:31, 1.26s/it]
Training...: 2%|█▋ | 939/50000 [21:02<16:01:04, 1.18s/it]
Training...: 2%|█▋ | 940/50000 [21:02<14:37:07, 1.07s/it]
Training...: 2%|█▊ | 941/50000 [21:04<15:31:30, 1.14s/it]
Training...: 2%|█▊ | 942/50000 [21:05<16:16:59, 1.19s/it]
Training...: 2%|█▊ | 943/50000 [21:06<16:34:36, 1.22s/it]
Training...: 2%|█▊ | 944/50000 [21:07<16:04:45, 1.18s/it]
Training...: 2%|█▊ | 945/50000 [21:08<15:27:06, 1.13s/it]
Training...: 2%|█▊ | 946/50000 [21:10<15:54:47, 1.17s/it]
Training...: 2%|█▊ | 947/50000 [21:11<15:56:43, 1.17s/it]
Training...: 2%|█▊ | 948/50000 [21:12<16:21:36, 1.20s/it]
Training...: 2%|█▊ | 949/50000 [21:13<16:00:44, 1.18s/it]
Training...: 2%|█▊ | 950/50000 [21:15<19:40:21, 1.44s/it]
Training...: 2%|█▊ | 951/50000 [21:16<17:14:06, 1.27s/it]
Training...: 2%|█▊ | 952/50000 [21:18<19:21:45, 1.42s/it]
Training...: 2%|█▊ | 953/50000 [21:19<18:52:55, 1.39s/it]
Training...: 2%|█▊ | 954/50000 [21:21<18:44:28, 1.38s/it]
Training...: 2%|█▊ | 955/50000 [21:22<18:25:21, 1.35s/it]
Training...: 2%|█▊ | 956/50000 [21:23<17:19:29, 1.27s/it]
Training...: 2%|█▊ | 957/50000 [21:24<16:17:35, 1.20s/it]
Training...: 2%|█▊ | 958/50000 [21:25<15:12:30, 1.12s/it]
Training...: 2%|█▊ | 959/50000 [21:26<15:50:27, 1.16s/it]
Training...: 2%|█▊ | 960/50000 [21:27<16:01:33, 1.18s/it]
Training...: 2%|█▊ | 961/50000 [21:29<15:36:49, 1.15s/it]
Training...: 2%|█▊ | 962/50000 [21:30<15:25:03, 1.13s/it]
Training...: 2%|█▊ | 963/50000 [21:31<15:47:04, 1.16s/it]
Training...: 2%|█▊ | 964/50000 [21:32<16:03:20, 1.18s/it]
Training...: 2%|█▊ | 965/50000 [21:33<16:12:41, 1.19s/it]
Training...: 2%|█▊ | 966/50000 [21:35<16:48:23, 1.23s/it]
Training...: 2%|█▊ | 967/50000 [21:36<19:24:42, 1.43s/it]
Training...: 2%|█▊ | 968/50000 [21:38<18:46:30, 1.38s/it]
Training...: 2%|█▊ | 969/50000 [21:39<18:18:55, 1.34s/it]
Training...: 2%|█▊ | 970/50000 [21:40<17:56:51, 1.32s/it]
Training...: 2%|█▊ | 971/50000 [21:42<18:17:58, 1.34s/it]
Training...: 2%|█▊ | 972/50000 [21:43<18:22:07, 1.35s/it]
Training...: 2%|█▊ | 973/50000 [21:44<18:03:32, 1.33s/it]
Training...: 2%|█▊ | 974/50000 [21:45<16:54:50, 1.24s/it]
Training...: 2%|█▊ | 975/50000 [21:47<17:05:53, 1.26s/it]
Training...: 2%|█▊ | 976/50000 [21:48<15:49:01, 1.16s/it]
Training...: 2%|█▊ | 977/50000 [21:49<16:54:04, 1.24s/it]
Training...: 2%|█▊ | 978/50000 [21:50<15:57:15, 1.17s/it]
Training...: 2%|█▊ | 979/50000 [21:51<15:51:07, 1.16s/it]
Training...: 2%|█▊ | 980/50000 [21:53<16:40:12, 1.22s/it]
Training...: 2%|█▊ | 981/50000 [21:54<19:00:42, 1.40s/it]
Training...: 2%|█▊ | 982/50000 [21:55<17:51:49, 1.31s/it]
Training...: 2%|█▊ | 983/50000 [21:56<16:41:18, 1.23s/it]
Training...: 2%|█▊ | 984/50000 [21:58<16:41:06, 1.23s/it]
Training...: 2%|█▊ | 985/50000 [21:59<17:01:13, 1.25s/it]
Training...: 2%|█▊ | 986/50000 [22:01<18:14:28, 1.34s/it]
Training...: 2%|█▊ | 987/50000 [22:02<18:26:44, 1.35s/it]
Training...: 2%|█▊ | 988/50000 [22:03<17:55:56, 1.32s/it]
Training...: 2%|█▊ | 989/50000 [22:04<17:25:25, 1.28s/it]
Training...: 2%|█▊ | 990/50000 [22:06<17:28:19, 1.28s/it]
Training...: 2%|█▊ | 991/50000 [22:07<16:51:06, 1.24s/it]
Training...: 2%|█▊ | 992/50000 [22:08<16:41:38, 1.23s/it]
Training...: 2%|█▊ | 993/50000 [22:09<16:03:15, 1.18s/it]
Training...: 2%|█▊ | 994/50000 [22:11<20:11:03, 1.48s/it]
Training...: 2%|█▊ | 995/50000 [22:13<21:18:21, 1.57s/it]
Training...: 2%|█▊ | 996/50000 [22:14<19:36:34, 1.44s/it]
Training...: 2%|█▊ | 997/50000 [22:15<18:42:12, 1.37s/it]
Training...: 2%|█▊ | 998/50000 [22:16<17:38:05, 1.30s/it]
Training...: 2%|█▊ | 999/50000 [22:18<17:55:44, 1.32s/it]
Training...: 2%|█▊ | 1000/50000 [22:19<17:30:45, 1.29s/it]
Training...: 2%|█▊ | 1000/50000 [22:21<17:30:45, 1.29s/it]Step... (500 | Loss: 1.8920137882232666, Learning Rate: 0.0006000000284984708)
Step... (1000 | Loss: 1.8785834312438965, Learning Rate: 0.0005939393886364996)
Evaluating ...: 0%| | 0/130 [00:00<?, ?it/s][A
Evaluating ...: 1%|▋ | 1/130 [00:10<21:31, 10.02s/it][A
Evaluating ...: 2%|██▏ | 3/130 [00:10<05:35, 2.64s/it][A
Evaluating ...: 4%|███▋ | 5/130 [00:10<02:44, 1.32s/it][A
Evaluating ...: 5%|█████▏ | 7/130 [00:10<01:36, 1.27it/s][A
Evaluating ...: 7%|██████▋ | 9/130 [00:10<01:01, 1.95it/s][A
Evaluating ...: 8%|████████ | 11/130 [00:10<00:42, 2.82it/s][A
Evaluating ...: 10%|█████████▌ | 13/130 [00:10<00:29, 3.90it/s][A
Evaluating ...: 12%|███████████ | 15/130 [00:10<00:22, 5.18it/s][A
Evaluating ...: 13%|████████████▌ | 17/130 [00:10<00:17, 6.60it/s][A
Evaluating ...: 15%|██████████████ | 19/130 [00:11<00:13, 8.09it/s][A
Evaluating ...: 16%|███████████████▌ | 21/130 [00:11<00:11, 9.60it/s][A
Evaluating ...: 18%|████████████████▉ | 23/130 [00:11<00:09, 10.98it/s][A
Evaluating ...: 19%|██████████████████▍ | 25/130 [00:11<00:08, 12.21it/s][A
Evaluating ...: 21%|███████████████████▉ | 27/130 [00:11<00:07, 13.14it/s][A
Evaluating ...: 22%|█████████████████████▍ | 29/130 [00:11<00:07, 14.03it/s][A
Evaluating ...: 24%|██████████████████████▉ | 31/130 [00:11<00:06, 14.70it/s][A
Evaluating ...: 25%|████████████████████████▎ | 33/130 [00:11<00:06, 15.23it/s][A
Evaluating ...: 27%|█████████████████████████▊ | 35/130 [00:12<00:06, 15.55it/s][A
Evaluating ...: 28%|███████████████████████████▎ | 37/130 [00:12<00:05, 15.69it/s][A
Evaluating ...: 30%|████████████████████████████▊ | 39/130 [00:12<00:05, 15.91it/s][A
Evaluating ...: 32%|██████████████████████████████▎ | 41/130 [00:12<00:05, 15.99it/s][A
Evaluating ...: 33%|███████████████████████████████▊ | 43/130 [00:12<00:05, 16.13it/s][A
Evaluating ...: 35%|█████████████████████████████████▏ | 45/130 [00:12<00:07, 11.92it/s][A
Evaluating ...: 36%|██████████████████████████████████▋ | 47/130 [00:13<00:10, 8.07it/s][A
Evaluating ...: 38%|████████████████████████████████████▏ | 49/130 [00:13<00:12, 6.57it/s][A
Evaluating ...: 38%|████████████████████████████████████▉ | 50/130 [00:13<00:13, 6.11it/s][A
Evaluating ...: 39%|█████████████████████████████████████▋ | 51/130 [00:14<00:13, 5.73it/s][A
Evaluating ...: 40%|██████████████████████████████████████▍ | 52/130 [00:14<00:14, 5.43it/s][A
Evaluating ...: 41%|███████████████████████████████████████▏ | 53/130 [00:14<00:14, 5.20it/s][A
Evaluating ...: 42%|███████████████████████████████████████▉ | 54/130 [00:14<00:15, 5.03it/s][A
Evaluating ...: 42%|████████████████████████████████████████▌ | 55/130 [00:15<00:15, 4.91it/s][A
Evaluating ...: 43%|█████████████████████████████████████████▎ | 56/130 [00:15<00:15, 4.82it/s][A
Evaluating ...: 44%|██████████████████████████████████████████ | 57/130 [00:15<00:15, 4.75it/s][A
Evaluating ...: 45%|██████████████████████████████████████████▊ | 58/130 [00:15<00:15, 4.70it/s][A
Evaluating ...: 45%|███████████████████████████████████████████▌ | 59/130 [00:15<00:15, 4.67it/s][A
Evaluating ...: 46%|████████████████████████████████████████████▎ | 60/130 [00:16<00:15, 4.65it/s][A
Evaluating ...: 47%|█████████████████████████████████████████████ | 61/130 [00:16<00:14, 4.63it/s][A
Evaluating ...: 48%|█████████████████████████████████████████████▊ | 62/130 [00:16<00:14, 4.62it/s][A
Evaluating ...: 48%|██████████████████████████████████████████████▌ | 63/130 [00:16<00:14, 4.62it/s][A
Evaluating ...: 49%|███████████████████████████████████████████████▎ | 64/130 [00:16<00:14, 4.61it/s][A
Evaluating ...: 50%|████████████████████████████████████████████████ | 65/130 [00:17<00:14, 4.60it/s][A
Evaluating ...: 51%|████████████████████████████████████████████████▋ | 66/130 [00:17<00:13, 4.60it/s][A
Evaluating ...: 52%|█████████████████████████████████████████████████▍ | 67/130 [00:17<00:13, 4.60it/s][A
Evaluating ...: 52%|██████████████████████████████████████████████████▏ | 68/130 [00:17<00:13, 4.60it/s][A
Evaluating ...: 53%|██████████████████████████████████████████████████▉ | 69/130 [00:18<00:13, 4.60it/s][A
Evaluating ...: 54%|███████████████████████████████████████████████████▋ | 70/130 [00:18<00:13, 4.60it/s][A
Evaluating ...: 55%|████████████████████████████████████████████████████▍ | 71/130 [00:18<00:12, 4.60it/s][A
Evaluating ...: 55%|█████████████████████████████████████████████████████▏ | 72/130 [00:18<00:12, 4.60it/s][A
Evaluating ...: 56%|█████████████████████████████████████████████████████▉ | 73/130 [00:18<00:12, 4.60it/s][A
Evaluating ...: 57%|██████████████████████████████████████████████████████▋ | 74/130 [00:19<00:12, 4.60it/s][A
Evaluating ...: 58%|███████████████████████████████████████████████████████▍ | 75/130 [00:19<00:11, 4.60it/s][A
Evaluating ...: 58%|████████████████████████████████████████████████████████ | 76/130 [00:19<00:11, 4.60it/s][A
Evaluating ...: 59%|████████████████████████████████████████████████████████▊ | 77/130 [00:19<00:11, 4.59it/s][A
Evaluating ...: 60%|█████████████████████████████████████████████████████████▌ | 78/130 [00:20<00:11, 4.60it/s][A
Evaluating ...: 61%|██████████████████████████████████████████████████████████▎ | 79/130 [00:20<00:11, 4.60it/s][A
Evaluating ...: 62%|███████████████████████████████████████████████████████████ | 80/130 [00:20<00:10, 4.60it/s][A
Evaluating ...: 62%|███████████████████████████████████████████████████████████▊ | 81/130 [00:20<00:10, 4.60it/s][A
Evaluating ...: 63%|████████████████████████████████████████████████████████████▌ | 82/130 [00:20<00:10, 4.60it/s][A
Evaluating ...: 64%|█████████████████████████████████████████████████████████████▎ | 83/130 [00:21<00:10, 4.59it/s][A
Evaluating ...: 65%|██████████████████████████████████████████████████████████████ | 84/130 [00:21<00:10, 4.60it/s][A
Evaluating ...: 65%|██████████████████████████████████████████████████████████████▊ | 85/130 [00:21<00:09, 4.60it/s][A
Evaluating ...: 66%|███████████████████████████████████████████████████████████████▌ | 86/130 [00:21<00:09, 4.59it/s][A
Evaluating ...: 67%|████████████████████████████████████████████████████████████████▏ | 87/130 [00:21<00:09, 4.59it/s][A
Evaluating ...: 68%|████████████████████████████████████████████████████████████████▉ | 88/130 [00:22<00:09, 4.60it/s][A
Evaluating ...: 68%|█████████████████████████████████████████████████████████████████▋ | 89/130 [00:22<00:08, 4.59it/s][A
Evaluating ...: 69%|██████████████████████████████████████████████████████████████████▍ | 90/130 [00:22<00:08, 4.59it/s][A
Evaluating ...: 70%|███████████████████████████████████████████████████████████████████▏ | 91/130 [00:22<00:08, 4.60it/s][A
Evaluating ...: 71%|███████████████████████████████████████████████████████████████████▉ | 92/130 [00:23<00:08, 4.60it/s][A
Evaluating ...: 72%|████████████████████████████████████████████████████████████████████▋ | 93/130 [00:23<00:08, 4.59it/s][A
Evaluating ...: 72%|█████████████████████████████████████████████████████████████████████▍ | 94/130 [00:23<00:07, 4.60it/s][A
Evaluating ...: 73%|██████████████████████████████████████████████████████████████████████▏ | 95/130 [00:23<00:07, 4.59it/s][A
Evaluating ...: 74%|██████████████████████████████████████████████████████████████████████▉ | 96/130 [00:23<00:07, 4.60it/s][A
Evaluating ...: 75%|███████████████████████████████████████████████████████████████████████▋ | 97/130 [00:24<00:07, 4.60it/s][A
Evaluating ...: 75%|████████████████████████████████████████████████████████████████████████▎ | 98/130 [00:24<00:06, 4.59it/s][A
Evaluating ...: 76%|█████████████████████████████████████████████████████████████████████████ | 99/130 [00:24<00:06, 4.60it/s][A
Evaluating ...: 77%|█████████████████████████████████████████████████████████████████████████ | 100/130 [00:24<00:06, 4.60it/s][A
Evaluating ...: 78%|█████████████████████████████████████████████████████████████████████████▊ | 101/130 [00:25<00:06, 4.60it/s][A
Evaluating ...: 78%|██████████████████████████████████████████████████████████████████████████▌ | 102/130 [00:25<00:06, 4.60it/s][A
Evaluating ...: 79%|███████████████████████████████████████████████████████████████████████████▎ | 103/130 [00:25<00:05, 4.59it/s][A
Evaluating ...: 80%|████████████████████████████████████████████████████████████████████████████ | 104/130 [00:25<00:05, 4.60it/s][A
Evaluating ...: 81%|████████████████████████████████████████████████████████████████████████████▋ | 105/130 [00:25<00:05, 4.59it/s][A
Evaluating ...: 82%|█████████████████████████████████████████████████████████████████████████████▍ | 106/130 [00:26<00:05, 4.59it/s][A
Evaluating ...: 82%|██████████████████████████████████████████████████████████████████████████████▏ | 107/130 [00:26<00:05, 4.60it/s][A
Evaluating ...: 83%|██████████████████████████████████████████████████████████████████████████████▉ | 108/130 [00:26<00:04, 4.60it/s][A
Evaluating ...: 84%|███████████████████████████████████████████████████████████████████████████████▋ | 109/130 [00:26<00:04, 4.60it/s][A
Evaluating ...: 85%|████████████████████████████████████████████████████████████████████████████████▍ | 110/130 [00:26<00:04, 4.60it/s][A
Evaluating ...: 85%|█████████████████████████████████████████████████████████████████████████████████ | 111/130 [00:27<00:04, 4.60it/s][A
Evaluating ...: 86%|█████████████████████████████████████████████████████████████████████████████████▊ | 112/130 [00:27<00:03, 4.59it/s][A
Evaluating ...: 87%|██████████████████████████████████████████████████████████████████████████████████▌ | 113/130 [00:27<00:03, 4.60it/s][A
Evaluating ...: 88%|███████████████████████████████████████████████████████████████████████████████████▎ | 114/130 [00:27<00:03, 4.60it/s][A
Evaluating ...: 88%|████████████████████████████████████████████████████████████████████████████████████ | 115/130 [00:28<00:03, 4.60it/s][A
Evaluating ...: 89%|████████████████████████████████████████████████████████████████████████████████████▊ | 116/130 [00:28<00:03, 4.59it/s][A
Evaluating ...: 90%|█████████████████████████████████████████████████████████████████████████████████████▌ | 117/130 [00:28<00:02, 4.60it/s][A
Evaluating ...: 91%|██████████████████████████████████████████████████████████████████████████████████████▏ | 118/130 [00:28<00:02, 4.60it/s][A
Evaluating ...: 92%|██████████████████████████████████████████████████████████████████████████████████████▉ | 119/130 [00:28<00:02, 4.59it/s][A
Evaluating ...: 92%|███████████████████████████████████████████████████████████████████████████████████████▋ | 120/130 [00:29<00:02, 4.60it/s][A
Evaluating ...: 93%|████████████████████████████████████████████████████████████████████████████████████████▍ | 121/130 [00:29<00:01, 4.60it/s][A
Evaluating ...: 94%|█████████████████████████████████████████████████████████████████████████████████████████▏ | 122/130 [00:29<00:01, 4.59it/s][A
Evaluating ...: 95%|█████████████████████████████████████████████████████████████████████████████████████████▉ | 123/130 [00:29<00:01, 4.60it/s][A
Evaluating ...: 95%|██████████████████████████████████████████████████████████████████████████████████████████▌ | 124/130 [00:30<00:01, 4.59it/s][A
Evaluating ...: 96%|███████████████████████████████████████████████████████████████████████████████████████████▎ | 125/130 [00:30<00:01, 4.60it/s][A
Evaluating ...: 97%|████████████████████████████████████████████████████████████████████████████████████████████ | 126/130 [00:30<00:00, 4.59it/s][A
Evaluating ...: 98%|████████████████████████████████████████████████████████████████████████████████████████████▊ | 127/130 [00:30<00:00, 4.60it/s][A
Evaluating ...: 98%|█████████████████████████████████████████████████████████████████████████████████████████████▌ | 128/130 [00:30<00:00, 4.60it/s][A
Evaluating ...: 99%|██████████████████████████████████████████████████████████████████████████████████████████████▎| 129/130 [00:31<00:00, 4.59it/s][A
Evaluating ...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████| 130/130 [00:31<00:00, 4.59it/s][A
Evaluating ...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████| 130/130 [00:31<00:00, 4.15it/s]
[02:30:54] - INFO - __main__ - Saving checkpoint at 1000 steps
/var/hf/transformers-orig/src/transformers/modeling_flax_pytorch_utils.py:201: UserWarning: The given NumPy array is not writeable, and PyTorch does not support non-writeable tensors. This means you can write to the underlying (supposedly non-writeable) NumPy array using the tensor. You may want to copy the array to protect its data or make it writeable before converting it to a tensor. This type of warning will be suppressed for the rest of this program. (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:180.)
pt_model_dict[flax_key] = torch.from_numpy(flax_tensor)
All Flax model weights were used when initializing RobertaForMaskedLM.
Some weights of RobertaForMaskedLM were not initialized from the Flax model and are newly initialized: ['lm_head.decoder.weight', 'roberta.embeddings.position_ids', 'lm_head.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1001/50000 [23:20<259:30:31, 19.07s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1002/50000 [23:21<186:23:50, 13.70s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1003/50000 [23:22<136:02:17, 10.00s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1004/50000 [23:23<99:35:31, 7.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1005/50000 [23:25<75:05:41, 5.52s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1006/50000 [23:26<58:03:02, 4.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1007/50000 [23:27<45:40:40, 3.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▌ | 1008/50000 [23:28<37:08:34, 2.73s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1009/50000 [23:30<31:45:46, 2.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1010/50000 [23:32<29:47:18, 2.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1011/50000 [23:33<25:32:44, 1.88s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1012/50000 [23:34<22:58:22, 1.69s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1013/50000 [23:35<20:30:14, 1.51s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1014/50000 [23:36<19:16:23, 1.42s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1015/50000 [23:37<18:09:05, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1016/50000 [23:40<21:25:07, 1.57s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1017/50000 [23:41<20:09:13, 1.48s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1018/50000 [23:42<19:05:11, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1019/50000 [23:43<18:27:05, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1020/50000 [23:44<17:39:28, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1021/50000 [23:46<18:17:43, 1.34s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1022/50000 [23:47<17:56:33, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1023/50000 [23:49<18:17:00, 1.34s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1024/50000 [23:51<21:20:24, 1.57s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1025/50000 [23:52<20:40:09, 1.52s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1026/50000 [23:53<19:07:08, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1027/50000 [23:55<19:08:02, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1028/50000 [23:56<19:10:43, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1029/50000 [23:58<19:48:19, 1.46s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1030/50000 [23:59<18:55:44, 1.39s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1031/50000 [24:00<18:36:55, 1.37s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1032/50000 [24:01<16:32:15, 1.22s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1033/50000 [24:02<15:43:47, 1.16s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1034/50000 [24:03<16:13:07, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1035/50000 [24:05<17:27:40, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1036/50000 [24:06<17:13:09, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1037/50000 [24:07<17:13:00, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1038/50000 [24:08<16:22:26, 1.20s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1039/50000 [24:10<19:07:54, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1040/50000 [24:11<17:49:01, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1041/50000 [24:12<17:04:23, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1042/50000 [24:14<17:13:16, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1043/50000 [24:15<17:06:39, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1044/50000 [24:16<15:57:47, 1.17s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1045/50000 [24:17<16:11:17, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1046/50000 [24:18<15:49:52, 1.16s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1047/50000 [24:20<15:54:28, 1.17s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1048/50000 [24:21<16:16:01, 1.20s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1049/50000 [24:22<16:13:51, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1050/50000 [24:23<16:42:55, 1.23s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1051/50000 [24:25<16:49:32, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1052/50000 [24:26<16:49:06, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1053/50000 [24:27<18:21:18, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1054/50000 [24:30<21:57:09, 1.61s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1055/50000 [24:31<19:33:20, 1.44s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1056/50000 [24:33<22:42:56, 1.67s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1057/50000 [24:34<20:48:48, 1.53s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1058/50000 [24:35<19:43:44, 1.45s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1059/50000 [24:37<19:06:02, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1060/50000 [24:38<18:01:17, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1061/50000 [24:39<17:09:32, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1062/50000 [24:40<16:13:42, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1063/50000 [24:41<15:03:21, 1.11s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1064/50000 [24:42<13:41:56, 1.01s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1065/50000 [24:43<13:43:08, 1.01s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1066/50000 [24:44<14:26:05, 1.06s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1067/50000 [24:45<14:42:19, 1.08s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1068/50000 [24:46<14:43:18, 1.08s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1069/50000 [24:47<14:50:09, 1.09s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1070/50000 [24:48<15:22:27, 1.13s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1071/50000 [24:50<15:45:07, 1.16s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1072/50000 [24:53<25:54:55, 1.91s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1073/50000 [24:55<23:43:32, 1.75s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1074/50000 [24:56<20:55:33, 1.54s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1075/50000 [24:57<20:26:25, 1.50s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1076/50000 [24:58<19:02:17, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1077/50000 [24:59<18:07:38, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1078/50000 [25:01<18:46:03, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1079/50000 [25:02<18:02:57, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1080/50000 [25:03<17:59:58, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1081/50000 [25:05<18:22:34, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1082/50000 [25:06<19:00:28, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1083/50000 [25:08<18:45:27, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1084/50000 [25:09<17:36:10, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1085/50000 [25:10<17:43:16, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1086/50000 [25:13<24:19:38, 1.79s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1087/50000 [25:14<22:55:11, 1.69s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1088/50000 [25:16<21:13:32, 1.56s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1089/50000 [25:17<18:58:44, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1090/50000 [25:18<18:08:18, 1.34s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1091/50000 [25:19<18:08:48, 1.34s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1092/50000 [25:21<18:07:59, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1093/50000 [25:22<17:19:15, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1094/50000 [25:24<20:40:13, 1.52s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1095/50000 [25:25<19:51:13, 1.46s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1096/50000 [25:26<18:07:37, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1097/50000 [25:28<18:07:19, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1098/50000 [25:29<17:56:03, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1099/50000 [25:30<16:12:31, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1100/50000 [25:32<21:20:23, 1.57s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1101/50000 [25:33<20:22:12, 1.50s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1102/50000 [25:35<19:29:40, 1.44s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1103/50000 [25:36<17:55:17, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1104/50000 [25:37<18:06:58, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1105/50000 [25:38<17:06:20, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1106/50000 [25:40<17:23:54, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1107/50000 [25:41<16:58:35, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1108/50000 [25:42<17:02:55, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1109/50000 [25:43<16:46:25, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1110/50000 [25:44<16:08:59, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1111/50000 [25:45<15:59:28, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1112/50000 [25:47<15:51:25, 1.17s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1113/50000 [25:48<15:21:59, 1.13s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1114/50000 [25:49<14:49:56, 1.09s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1115/50000 [25:51<19:04:00, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1116/50000 [25:52<18:28:30, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1117/50000 [25:53<18:19:13, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1118/50000 [25:54<17:03:58, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1119/50000 [25:56<17:31:39, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1120/50000 [25:57<17:14:27, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1121/50000 [25:58<16:54:05, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1122/50000 [26:00<17:24:05, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1123/50000 [26:01<18:29:56, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1124/50000 [26:02<17:51:19, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1125/50000 [26:04<17:58:11, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1126/50000 [26:05<17:58:22, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1127/50000 [26:06<16:46:50, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1128/50000 [26:07<17:24:14, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1129/50000 [26:09<19:53:03, 1.46s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1130/50000 [26:10<18:35:03, 1.37s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1131/50000 [26:12<18:17:54, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1132/50000 [26:14<20:20:28, 1.50s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1133/50000 [26:15<18:50:05, 1.39s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1134/50000 [26:16<16:59:45, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1135/50000 [26:17<17:27:32, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1136/50000 [26:18<16:50:37, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1137/50000 [26:19<17:02:37, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1138/50000 [26:21<17:05:39, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1139/50000 [26:22<17:30:45, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1140/50000 [26:23<16:45:44, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1141/50000 [26:24<16:07:36, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1142/50000 [26:25<15:53:56, 1.17s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1143/50000 [26:26<15:29:13, 1.14s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1144/50000 [26:28<15:21:27, 1.13s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1145/50000 [26:30<19:00:41, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1146/50000 [26:31<18:04:51, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1147/50000 [26:32<17:25:23, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1148/50000 [26:34<18:41:21, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1149/50000 [26:35<19:09:41, 1.41s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1150/50000 [26:36<17:50:26, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1151/50000 [26:38<18:03:52, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1152/50000 [26:39<17:07:00, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1153/50000 [26:40<16:57:57, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1154/50000 [26:41<16:57:10, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1155/50000 [26:42<16:33:19, 1.22s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1156/50000 [26:44<18:03:38, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1157/50000 [26:45<17:52:35, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1158/50000 [26:46<17:13:48, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1159/50000 [26:49<24:00:24, 1.77s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1160/50000 [26:50<21:04:09, 1.55s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1161/50000 [26:52<21:28:28, 1.58s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1162/50000 [26:53<20:06:20, 1.48s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1163/50000 [26:54<19:20:50, 1.43s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1164/50000 [26:56<18:18:35, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1165/50000 [26:57<17:32:03, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1166/50000 [26:58<16:36:07, 1.22s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1167/50000 [26:59<16:53:26, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1168/50000 [27:00<16:59:11, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1169/50000 [27:02<17:16:31, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1170/50000 [27:04<21:49:52, 1.61s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1171/50000 [27:05<20:09:35, 1.49s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1172/50000 [27:07<18:57:29, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1173/50000 [27:09<22:47:10, 1.68s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1174/50000 [27:10<20:54:02, 1.54s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1175/50000 [27:11<19:51:35, 1.46s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1176/50000 [27:13<18:58:36, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1177/50000 [27:14<18:20:01, 1.35s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1178/50000 [27:15<17:45:08, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1179/50000 [27:16<17:36:33, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1180/50000 [27:18<17:49:31, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1181/50000 [27:19<18:00:46, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1182/50000 [27:20<17:54:53, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1183/50000 [27:22<17:33:02, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1184/50000 [27:23<16:54:56, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1185/50000 [27:24<16:13:26, 1.20s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1186/50000 [27:25<16:00:11, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1187/50000 [27:26<16:03:24, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1188/50000 [27:29<22:04:00, 1.63s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1189/50000 [27:30<20:27:16, 1.51s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1190/50000 [27:31<18:41:25, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1191/50000 [27:32<17:35:06, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1192/50000 [27:33<17:35:06, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1193/50000 [27:35<18:28:43, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1194/50000 [27:36<18:23:04, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1195/50000 [27:38<18:55:15, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1196/50000 [27:39<17:18:59, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1197/50000 [27:40<17:45:10, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1198/50000 [27:42<17:40:50, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1199/50000 [27:43<17:51:40, 1.32s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1200/50000 [27:44<17:19:39, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1201/50000 [27:45<16:38:37, 1.23s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1202/50000 [27:48<22:21:32, 1.65s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1203/50000 [27:49<21:15:08, 1.57s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1204/50000 [27:50<18:39:53, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1205/50000 [27:51<17:39:55, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1206/50000 [27:52<17:30:00, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1207/50000 [27:54<18:42:41, 1.38s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1208/50000 [27:57<23:05:33, 1.70s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▋ | 1209/50000 [27:58<20:18:55, 1.50s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1210/50000 [27:59<20:02:32, 1.48s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1211/50000 [28:00<18:58:20, 1.40s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1212/50000 [28:01<18:27:08, 1.36s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1213/50000 [28:03<17:10:52, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1214/50000 [28:04<17:18:38, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1215/50000 [28:05<16:55:48, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1216/50000 [28:07<19:17:32, 1.42s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1217/50000 [28:08<19:47:47, 1.46s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1218/50000 [28:09<18:11:39, 1.34s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1219/50000 [28:11<18:04:46, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1220/50000 [28:12<16:08:49, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1221/50000 [28:13<16:11:36, 1.20s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1222/50000 [28:14<16:37:08, 1.23s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1223/50000 [28:16<17:33:55, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1224/50000 [28:17<16:50:02, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1225/50000 [28:18<16:33:00, 1.22s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1226/50000 [28:19<16:22:15, 1.21s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1227/50000 [28:20<16:59:53, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1228/50000 [28:22<17:14:11, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1229/50000 [28:23<17:45:52, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1230/50000 [28:25<19:32:24, 1.44s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1231/50000 [28:26<17:58:14, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1232/50000 [28:27<18:02:26, 1.33s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1233/50000 [28:28<17:10:10, 1.27s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1234/50000 [28:30<16:44:39, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1235/50000 [28:30<15:16:26, 1.13s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1236/50000 [28:32<16:47:09, 1.24s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1237/50000 [28:33<16:20:59, 1.21s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1238/50000 [28:34<16:37:06, 1.23s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1239/50000 [28:36<17:39:08, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1240/50000 [28:37<16:56:03, 1.25s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1241/50000 [28:38<15:59:30, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1242/50000 [28:39<15:28:19, 1.14s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1243/50000 [28:40<14:58:20, 1.11s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1244/50000 [28:41<16:01:37, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1245/50000 [28:43<19:20:24, 1.43s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1246/50000 [28:46<23:28:35, 1.73s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1247/50000 [28:47<21:47:38, 1.61s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1248/50000 [28:49<20:41:03, 1.53s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1249/50000 [28:50<19:57:28, 1.47s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 2%|▊ | 1250/50000 [28:51<18:37:03, 1.37s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1251/50000 [28:52<18:33:34, 1.37s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1252/50000 [28:54<17:41:20, 1.31s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1253/50000 [28:55<17:35:22, 1.30s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1254/50000 [28:56<17:19:14, 1.28s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1255/50000 [28:57<16:09:50, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1256/50000 [28:58<16:25:40, 1.21s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1257/50000 [29:00<16:32:51, 1.22s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1258/50000 [29:01<17:23:58, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1259/50000 [29:05<27:16:31, 2.01s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1260/50000 [29:06<24:04:04, 1.78s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1261/50000 [29:07<21:16:19, 1.57s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1262/50000 [29:08<19:39:06, 1.45s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1263/50000 [29:09<18:35:18, 1.37s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1264/50000 [29:10<17:28:21, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1265/50000 [29:12<17:05:14, 1.26s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1266/50000 [29:13<16:05:13, 1.19s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1267/50000 [29:14<15:57:00, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1268/50000 [29:15<16:02:01, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1269/50000 [29:17<17:26:51, 1.29s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1270/50000 [29:18<16:19:31, 1.21s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1271/50000 [29:19<16:01:05, 1.18s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1272/50000 [29:20<15:37:14, 1.15s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1273/50000 [29:21<15:27:27, 1.14s/it]
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1274/50000 [29:25<27:59:00, 2.07s/it] |