File size: 51,317 Bytes
bc9e9ef
 
 
 
049fb42
 
bc9e9ef
 
 
24b41ff
 
 
bc9e9ef
24b41ff
bc9e9ef
 
 
 
 
 
24b41ff
bc9e9ef
049fb42
bc9e9ef
049fb42
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bc9e9ef
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24b41ff
bc9e9ef
 
 
24b41ff
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
bc9e9ef
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
library_name: transformers
base_model: google/mobilenet_v2_1.0_224
tags:
- image-classification
- vision
- generated_from_trainer
metrics:
- accuracy
- precision
- recall
- f1
model-index:
- name: mobilenetv2-typecoffee-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# mobilenetv2-typecoffee-2

This model is a fine-tuned version of [google/mobilenet_v2_1.0_224](https://huggingface.co/google/mobilenet_v2_1.0_224) on the Master-Rapha7/TypeCoffee_128x128 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3384
- Accuracy: 0.8939
- Precision: 0.8983
- Recall: 0.8949
- F1: 0.8958
- Precision Durariadorio 128x128: 0.9545
- Recall Durariadorio 128x128: 0.875
- F1 Durariadorio 128x128: 0.9130
- Precision Mole 128x128: 0.9858
- Recall Mole 128x128: 0.9653
- F1 Mole 128x128: 0.9754
- Precision Quebrado 128x128: 0.8063
- Recall Quebrado 128x128: 0.8958
- F1 Quebrado 128x128: 0.8487
- Precision Riadorio 128x128: 0.8158
- Recall Riadorio 128x128: 0.8158
- F1 Riadorio 128x128: 0.8158
- Precision Riofechado 128x128: 0.9291
- Recall Riofechado 128x128: 0.9225
- F1 Riofechado 128x128: 0.9258

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Accuracy | Precision | Recall | F1     | Precision Durariadorio 128x128 | Recall Durariadorio 128x128 | F1 Durariadorio 128x128 | Precision Mole 128x128 | Recall Mole 128x128 | F1 Mole 128x128 | Precision Quebrado 128x128 | Recall Quebrado 128x128 | F1 Quebrado 128x128 | Precision Riadorio 128x128 | Recall Riadorio 128x128 | F1 Riadorio 128x128 | Precision Riofechado 128x128 | Recall Riofechado 128x128 | F1 Riofechado 128x128 |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|:---------:|:------:|:------:|:------------------------------:|:---------------------------:|:-----------------------:|:----------------------:|:-------------------:|:---------------:|:--------------------------:|:-----------------------:|:-------------------:|:--------------------------:|:-----------------------:|:-------------------:|:----------------------------:|:-------------------------:|:---------------------:|
| 1.0709        | 1.0   | 364   | 1.2074          | 0.5179   | 0.5840    | 0.5157 | 0.4791 | 0.75                           | 0.25                        | 0.375                   | 0.6444                 | 0.2014              | 0.3069          | 0.5543                     | 0.9931                  | 0.7114              | 0.3970                     | 0.6974                  | 0.5060              | 0.5741                       | 0.4366                    | 0.496                 |
| 0.7944        | 2.0   | 728   | 0.9347          | 0.6364   | 0.6970    | 0.6353 | 0.6462 | 0.7333                         | 0.4583                      | 0.5641                  | 0.7431                 | 0.5625              | 0.6403          | 0.8718                     | 0.7083                  | 0.7816              | 0.4191                     | 0.75                    | 0.5377              | 0.7174                       | 0.6972                    | 0.7071                |
| 0.8081        | 3.0   | 1092  | 1.7043          | 0.3747   | 0.6537    | 0.3782 | 0.3347 | 0.5405                         | 0.4167                      | 0.4706                  | 0.8                    | 0.0833              | 0.1509          | 0.9630                     | 0.1806                  | 0.3041              | 0.6957                     | 0.2105                  | 0.3232              | 0.2694                       | 1.0                       | 0.4245                |
| 0.8024        | 4.0   | 1456  | 1.5073          | 0.5014   | 0.6260    | 0.5063 | 0.4472 | 0.7778                         | 0.1944                      | 0.3111                  | 0.6373                 | 0.4514              | 0.5285          | 0.4613                     | 0.9931                  | 0.6300              | 0.8261                     | 0.125                   | 0.2171              | 0.4275                       | 0.7676                    | 0.5491                |
| 0.9541        | 5.0   | 1820  | 2.2240          | 0.4504   | 0.5819    | 0.4514 | 0.4270 | 0.3275                         | 0.7847                      | 0.4622                  | 0.4975                 | 0.6875              | 0.5773          | 0.9286                     | 0.1806                  | 0.3023              | 0.6364                     | 0.3224                  | 0.4279              | 0.5195                       | 0.2817                    | 0.3653                |
| 0.5358        | 6.0   | 2184  | 0.7352          | 0.7493   | 0.7677    | 0.7499 | 0.7374 | 0.8615                         | 0.3889                      | 0.5359                  | 0.7517                 | 0.7569              | 0.7543          | 0.8442                     | 0.9028                  | 0.8725              | 0.6096                     | 0.75                    | 0.6726              | 0.7714                       | 0.9507                    | 0.8517                |
| 0.4848        | 7.0   | 2548  | 1.4124          | 0.5978   | 0.7078    | 0.5949 | 0.5972 | 0.8108                         | 0.4167                      | 0.5505                  | 0.5612                 | 0.7639              | 0.6471          | 0.8165                     | 0.6181                  | 0.7036              | 0.4207                     | 0.8026                  | 0.5520              | 0.9298                       | 0.3732                    | 0.5327                |
| 0.6271        | 8.0   | 2912  | 1.1025          | 0.6433   | 0.7142    | 0.6495 | 0.6022 | 0.8143                         | 0.3958                      | 0.5327                  | 0.6078                 | 0.8611              | 0.7126          | 0.7421                     | 0.8194                  | 0.7789              | 0.8667                     | 0.1711                  | 0.2857              | 0.5399                       | 1.0                       | 0.7012                |
| 0.4748        | 9.0   | 3276  | 1.0572          | 0.6694   | 0.7185    | 0.6700 | 0.6822 | 0.8319                         | 0.6528                      | 0.7315                  | 0.6493                 | 0.6042              | 0.6259          | 0.7987                     | 0.8819                  | 0.8383              | 0.4062                     | 0.5987                  | 0.4840              | 0.9062                       | 0.6127                    | 0.7311                |
| 0.4721        | 10.0  | 3640  | 2.0767          | 0.5854   | 0.7156    | 0.5921 | 0.5216 | 0.5939                         | 0.8125                      | 0.6862                  | 0.5519                 | 0.9236              | 0.6909          | 0.9123                     | 0.3611                  | 0.5174              | 1.0                        | 0.0395                  | 0.0759              | 0.52                         | 0.8239                    | 0.6376                |
| 0.3891        | 11.0  | 4004  | 0.8680          | 0.7493   | 0.8243    | 0.7488 | 0.7505 | 0.8083                         | 0.6736                      | 0.7348                  | 1.0                    | 0.4028              | 0.5743          | 0.8693                     | 0.9236                  | 0.8956              | 0.4885                     | 0.8355                  | 0.6165              | 0.9556                       | 0.9085                    | 0.9314                |
| 0.4385        | 12.0  | 4368  | 0.5012          | 0.8320   | 0.8392    | 0.8343 | 0.8301 | 0.7821                         | 0.8472                      | 0.8133                  | 0.9302                 | 0.8333              | 0.8791          | 0.7692                     | 0.9722                  | 0.8589              | 0.8571                     | 0.6316                  | 0.7273              | 0.8571                       | 0.8873                    | 0.8720                |
| 0.5092        | 13.0  | 4732  | 0.8346          | 0.7782   | 0.8347    | 0.7790 | 0.7706 | 0.9667                         | 0.4028                      | 0.5686                  | 0.9160                 | 0.8333              | 0.8727          | 0.8658                     | 0.8958                  | 0.8805              | 0.8593                     | 0.7632                  | 0.8084              | 0.5657                       | 1.0                       | 0.7226                |
| 0.3634        | 14.0  | 5096  | 1.3165          | 0.6446   | 0.7551    | 0.6448 | 0.6445 | 0.7348                         | 0.6736                      | 0.7029                  | 0.4410                 | 0.9861              | 0.6094          | 0.9815                     | 0.3681                  | 0.5354              | 0.7881                     | 0.6118                  | 0.6889              | 0.83                         | 0.5845                    | 0.6860                |
| 0.4783        | 15.0  | 5460  | 1.6690          | 0.5565   | 0.7117    | 0.5523 | 0.5504 | 0.7286                         | 0.3542                      | 0.4766                  | 0.6891                 | 0.5694              | 0.6236          | 0.7868                     | 0.7431                  | 0.7643              | 0.3542                     | 0.8553                  | 0.5010              | 1.0                          | 0.2394                    | 0.3864                |
| 0.3286        | 16.0  | 5824  | 0.8830          | 0.7369   | 0.7873    | 0.7387 | 0.7307 | 0.8258                         | 0.7569                      | 0.7899                  | 0.825                  | 0.9167              | 0.8684          | 0.5517                     | 1.0                     | 0.7111              | 0.8681                     | 0.5197                  | 0.6502              | 0.8659                       | 0.5                       | 0.6339                |
| 0.441         | 17.0  | 6188  | 1.1930          | 0.6694   | 0.7584    | 0.6686 | 0.6672 | 0.9344                         | 0.3958                      | 0.5561                  | 0.9570                 | 0.6181              | 0.7511          | 0.5187                     | 0.9653                  | 0.6748              | 0.5781                     | 0.7303                  | 0.6453              | 0.8036                       | 0.6338                    | 0.7087                |
| 0.4224        | 18.0  | 6552  | 0.5639          | 0.8278   | 0.8410    | 0.8293 | 0.8258 | 0.9320                         | 0.6667                      | 0.7773                  | 0.8274                 | 0.9653              | 0.8910          | 0.7553                     | 0.9861                  | 0.8554              | 0.7465                     | 0.6974                  | 0.7211              | 0.944                        | 0.8310                    | 0.8839                |
| 0.3715        | 19.0  | 6916  | 0.9846          | 0.7025   | 0.7610    | 0.7047 | 0.7044 | 0.8632                         | 0.5694                      | 0.6862                  | 0.9307                 | 0.6528              | 0.7673          | 0.5182                     | 0.9861                  | 0.6794              | 0.7207                     | 0.5263                  | 0.6084              | 0.7724                       | 0.7887                    | 0.7805                |
| 0.4228        | 20.0  | 7280  | 0.9673          | 0.7452   | 0.7956    | 0.7449 | 0.7434 | 0.9125                         | 0.5069                      | 0.6518                  | 0.9583                 | 0.6389              | 0.7667          | 0.8382                     | 0.7917                  | 0.8143              | 0.5841                     | 0.8224                  | 0.6831              | 0.685                        | 0.9648                    | 0.8012                |
| 0.3596        | 21.0  | 7644  | 0.7574          | 0.7796   | 0.8143    | 0.7803 | 0.7759 | 0.8585                         | 0.6319                      | 0.728                   | 0.9884                 | 0.5903              | 0.7391          | 0.8221                     | 0.9306                  | 0.8730              | 0.7647                     | 0.7697                  | 0.7672              | 0.6376                       | 0.9789                    | 0.7722                |
| 0.3422        | 22.0  | 8008  | 2.4545          | 0.4931   | 0.7341    | 0.4988 | 0.4481 | 0.4324                         | 0.7778                      | 0.5558                  | 0.975                  | 0.2708              | 0.4239          | 0.9259                     | 0.3472                  | 0.5051              | 0.9412                     | 0.1053                  | 0.1893              | 0.3961                       | 0.9930                    | 0.5663                |
| 0.4047        | 23.0  | 8372  | 0.8565          | 0.7645   | 0.8034    | 0.7642 | 0.7735 | 0.6859                         | 0.7431                      | 0.7133                  | 0.9118                 | 0.8611              | 0.8857          | 0.8615                     | 0.7778                  | 0.8175              | 0.5577                     | 0.7632                  | 0.6444              | 1.0                          | 0.6761                    | 0.8067                |
| 0.3281        | 24.0  | 8736  | 1.9366          | 0.5923   | 0.7187    | 0.5887 | 0.5898 | 0.7324                         | 0.3611                      | 0.4837                  | 0.7226                 | 0.6875              | 0.7046          | 0.7794                     | 0.7361                  | 0.7571              | 0.3810                     | 0.8421                  | 0.5246              | 0.9783                       | 0.3169                    | 0.4787                |
| 0.4524        | 25.0  | 9100  | 1.9752          | 0.6460   | 0.7253    | 0.6464 | 0.6129 | 1.0                            | 0.1667                      | 0.2857                  | 0.775                  | 0.6458              | 0.7045          | 0.6667                     | 0.8472                  | 0.7462              | 0.6623                     | 0.6711                  | 0.6667              | 0.5224                       | 0.9014                    | 0.6615                |
| 0.2905        | 26.0  | 9464  | 0.9349          | 0.7645   | 0.7864    | 0.7653 | 0.7682 | 0.7872                         | 0.7708                      | 0.7789                  | 0.8738                 | 0.625               | 0.7287          | 0.8571                     | 0.75                    | 0.8                 | 0.5657                     | 0.7368                  | 0.64                | 0.8481                       | 0.9437                    | 0.8933                |
| 0.3872        | 27.0  | 9828  | 1.3411          | 0.6915   | 0.7712    | 0.6931 | 0.6904 | 0.6748                         | 0.7639                      | 0.7166                  | 0.9538                 | 0.4306              | 0.5933          | 0.9065                     | 0.6736                  | 0.7729              | 0.8174                     | 0.6184                  | 0.7041              | 0.5036                       | 0.9789                    | 0.6651                |
| 0.2387        | 28.0  | 10192 | 1.0073          | 0.7672   | 0.8063    | 0.7670 | 0.7638 | 0.9167                         | 0.6111                      | 0.7333                  | 0.8609                 | 0.9028              | 0.8814          | 0.6372                     | 1.0                     | 0.7784              | 0.6848                     | 0.7434                  | 0.7129              | 0.9318                       | 0.5775                    | 0.7130                |
| 0.2321        | 29.0  | 10556 | 0.6733          | 0.8085   | 0.8290    | 0.8107 | 0.8001 | 0.9615                         | 0.5208                      | 0.6757                  | 0.6961                 | 0.9861              | 0.8161          | 0.8526                     | 0.9236                  | 0.8867              | 0.7615                     | 0.6513                  | 0.7021              | 0.8734                       | 0.9718                    | 0.92                  |
| 0.2687        | 30.0  | 10920 | 1.1098          | 0.7603   | 0.8017    | 0.7601 | 0.7616 | 0.8198                         | 0.6319                      | 0.7137                  | 0.9765                 | 0.5764              | 0.7249          | 0.7037                     | 0.9236                  | 0.7988              | 0.5913                     | 0.8092                  | 0.6833              | 0.9173                       | 0.8592                    | 0.8873                |
| 0.2047        | 31.0  | 11284 | 0.5737          | 0.8333   | 0.8484    | 0.8353 | 0.8309 | 0.7382                         | 0.9792                      | 0.8418                  | 0.9545                 | 0.875               | 0.9130          | 0.8509                     | 0.6736                  | 0.7519              | 0.9211                     | 0.6908                  | 0.7895              | 0.7771                       | 0.9577                    | 0.8580                |
| 0.3821        | 32.0  | 11648 | 0.6089          | 0.7741   | 0.8123    | 0.7745 | 0.7798 | 0.9438                         | 0.5833                      | 0.7210                  | 0.7578                 | 0.8472              | 0.8             | 0.8862                     | 0.7569                  | 0.8165              | 0.5519                     | 0.7697                  | 0.6429              | 0.9220                       | 0.9155                    | 0.9187                |
| 0.3214        | 33.0  | 12012 | 1.1225          | 0.7879   | 0.8225    | 0.7884 | 0.7823 | 0.8433                         | 0.7847                      | 0.8129                  | 1.0                    | 0.4722              | 0.6415          | 0.8118                     | 0.9583                  | 0.8790              | 0.6041                     | 0.7829                  | 0.6819              | 0.8535                       | 0.9437                    | 0.8963                |
| 0.3972        | 34.0  | 12376 | 0.4285          | 0.8815   | 0.8951    | 0.8855 | 0.8747 | 0.7877                         | 0.9792                      | 0.8731                  | 0.8812                 | 0.9792              | 0.9276          | 0.8494                     | 0.9792                  | 0.9097              | 0.9647                     | 0.5395                  | 0.6920              | 0.9926                       | 0.9507                    | 0.9712                |
| 0.1635        | 35.0  | 12740 | 0.9206          | 0.7686   | 0.8260    | 0.7678 | 0.7673 | 0.975                          | 0.5417                      | 0.6964                  | 0.9556                 | 0.8958              | 0.9247          | 0.9011                     | 0.5694                  | 0.6979              | 0.5726                     | 0.8816                  | 0.6943              | 0.7258                       | 0.9507                    | 0.8232                |
| 0.2116        | 36.0  | 13104 | 2.1126          | 0.5868   | 0.6752    | 0.5881 | 0.5671 | 0.8667                         | 0.4514                      | 0.5936                  | 0.5756                 | 0.8194              | 0.6762          | 0.8333                     | 0.2431                  | 0.3763              | 0.6457                     | 0.5395                  | 0.5878              | 0.4549                       | 0.8873                    | 0.6014                |
| 0.2941        | 37.0  | 13468 | 0.8622          | 0.7741   | 0.8090    | 0.7754 | 0.7795 | 0.9145                         | 0.7431                      | 0.8199                  | 0.5939                 | 0.9444              | 0.7292          | 0.8870                     | 0.7083                  | 0.7876              | 0.7214                     | 0.6645                  | 0.6918              | 0.928                        | 0.8169                    | 0.8689                |
| 0.1385        | 38.0  | 13832 | 1.1555          | 0.7837   | 0.8127    | 0.7849 | 0.7840 | 0.9495                         | 0.6528                      | 0.7737                  | 0.9167                 | 0.6875              | 0.7857          | 0.8435                     | 0.8611                  | 0.8522              | 0.6727                     | 0.7303                  | 0.7003              | 0.6812                       | 0.9930                    | 0.8080                |
| 0.1781        | 39.0  | 14196 | 0.5697          | 0.8182   | 0.8548    | 0.8182 | 0.8208 | 0.9524                         | 0.5556                      | 0.7018                  | 0.9084                 | 0.8264              | 0.8655          | 0.8639                     | 0.8819                  | 0.8729              | 0.5909                     | 0.8553                  | 0.6989              | 0.9583                       | 0.9718                    | 0.9650                |
| 0.2708        | 40.0  | 14560 | 0.3549          | 0.8871   | 0.8911    | 0.8885 | 0.8879 | 0.8397                         | 0.9097                      | 0.8733                  | 0.9478                 | 0.8819              | 0.9137          | 0.8424                     | 0.9653                  | 0.8997              | 0.8406                     | 0.7632                  | 0.8                 | 0.9850                       | 0.9225                    | 0.9527                |
| 0.2474        | 41.0  | 14924 | 1.4169          | 0.6997   | 0.7712    | 0.6990 | 0.7026 | 0.8723                         | 0.5694                      | 0.6891                  | 0.9451                 | 0.5972              | 0.7319          | 0.8842                     | 0.5833                  | 0.7029              | 0.5274                     | 0.8224                  | 0.6427              | 0.6268                       | 0.9225                    | 0.7464                |
| 0.3544        | 42.0  | 15288 | 1.5741          | 0.7094   | 0.7636    | 0.7140 | 0.6947 | 0.7890                         | 0.5972                      | 0.6798                  | 0.8803                 | 0.7153              | 0.7893          | 0.6278                     | 0.9722                  | 0.7629              | 0.9138                     | 0.3487                  | 0.5048              | 0.6073                       | 0.9366                    | 0.7368                |
| 0.3016        | 43.0  | 15652 | 3.1537          | 0.4931   | 0.7287    | 0.4873 | 0.4791 | 0.6304                         | 0.2014                      | 0.3053                  | 0.7710                 | 0.7014              | 0.7345          | 0.9298                     | 0.3681                  | 0.5274              | 0.3124                     | 0.9474                  | 0.4698              | 1.0                          | 0.2183                    | 0.3584                |
| 0.2507        | 44.0  | 16016 | 0.7001          | 0.8072   | 0.8686    | 0.8066 | 0.8156 | 1.0                            | 0.5486                      | 0.7085                  | 0.9338                 | 0.8819              | 0.9071          | 0.8824                     | 0.8333                  | 0.8571              | 0.5425                     | 0.8816                  | 0.6717              | 0.9844                       | 0.8873                    | 0.9333                |
| 0.3607        | 45.0  | 16380 | 0.9100          | 0.8017   | 0.8393    | 0.8043 | 0.7983 | 0.9540                         | 0.5764                      | 0.7186                  | 0.6111                 | 0.9931              | 0.7566          | 0.8701                     | 0.9306                  | 0.8993              | 0.8571                     | 0.5921                  | 0.7004              | 0.9041                       | 0.9296                    | 0.9167                |
| 0.2023        | 46.0  | 16744 | 1.1856          | 0.7121   | 0.7901    | 0.7086 | 0.6832 | 0.8101                         | 0.8889                      | 0.8477                  | 0.9924                 | 0.9028              | 0.9455          | 0.6062                     | 0.6736                  | 0.6382              | 0.5418                     | 0.8947                  | 0.6749              | 1.0                          | 0.1831                    | 0.3095                |
| 0.2303        | 47.0  | 17108 | 0.5505          | 0.8388   | 0.8703    | 0.8387 | 0.8466 | 0.9573                         | 0.7778                      | 0.8582                  | 0.9328                 | 0.8681              | 0.8993          | 0.8852                     | 0.75                    | 0.8120              | 0.6129                     | 0.875                   | 0.7209              | 0.9632                       | 0.9225                    | 0.9424                |
| 0.2238        | 48.0  | 17472 | 1.6496          | 0.5950   | 0.7650    | 0.5905 | 0.6007 | 0.7207                         | 0.5556                      | 0.6275                  | 0.8889                 | 0.6111              | 0.7243          | 0.8431                     | 0.5972                  | 0.6992              | 0.3723                     | 0.9211                  | 0.5303              | 1.0                          | 0.2676                    | 0.4222                |
| 0.2632        | 49.0  | 17836 | 1.6022          | 0.7507   | 0.8091    | 0.7501 | 0.7150 | 1.0                            | 0.1806                      | 0.3059                  | 0.8072                 | 0.9306              | 0.8645          | 0.7667                     | 0.9583                  | 0.8519              | 0.5753                     | 0.8289                  | 0.6792              | 0.8963                       | 0.8521                    | 0.8736                |
| 0.1897        | 50.0  | 18200 | 1.0318          | 0.7824   | 0.8140    | 0.7825 | 0.7778 | 0.9375                         | 0.5208                      | 0.6696                  | 0.7416                 | 0.9167              | 0.8199          | 0.75                       | 0.9792                  | 0.8494              | 0.6686                     | 0.7566                  | 0.7099              | 0.9722                       | 0.7394                    | 0.84                  |
| 0.3303        | 51.0  | 18564 | 0.7386          | 0.7865   | 0.8104    | 0.7865 | 0.7834 | 0.8582                         | 0.8403                      | 0.8491                  | 0.8046                 | 0.9722              | 0.8805          | 0.7625                     | 0.8472                  | 0.8026              | 0.6395                     | 0.7237                  | 0.6790              | 0.9873                       | 0.5493                    | 0.7059                |
| 0.3398        | 52.0  | 18928 | 0.5642          | 0.8154   | 0.8351    | 0.8157 | 0.8154 | 0.8881                         | 0.8264                      | 0.8561                  | 0.9580                 | 0.7917              | 0.8669          | 0.8785                     | 0.6528                  | 0.7490              | 0.7456                     | 0.8289                  | 0.7850              | 0.7056                       | 0.9789                    | 0.8201                |
| 0.3094        | 53.0  | 19292 | 0.9977          | 0.7562   | 0.8091    | 0.7556 | 0.7492 | 0.7530                         | 0.8681                      | 0.8065                  | 1.0                    | 0.4097              | 0.5813          | 0.8644                     | 0.7083                  | 0.7786              | 0.5702                     | 0.8553                  | 0.6842              | 0.8581                       | 0.9366                    | 0.8956                |
| 0.3199        | 54.0  | 19656 | 0.3904          | 0.8595   | 0.8734    | 0.8600 | 0.8621 | 0.9433                         | 0.9236                      | 0.9333                  | 1.0                    | 0.8264              | 0.9049          | 0.8537                     | 0.7292                  | 0.7865              | 0.6957                     | 0.8421                  | 0.7619              | 0.8742                       | 0.9789                    | 0.9236                |
| 0.539         | 55.0  | 20020 | 0.3384          | 0.8939   | 0.8983    | 0.8949 | 0.8958 | 0.9545                         | 0.875                       | 0.9130                  | 0.9858                 | 0.9653              | 0.9754          | 0.8063                     | 0.8958                  | 0.8487              | 0.8158                     | 0.8158                  | 0.8158              | 0.9291                       | 0.9225                    | 0.9258                |
| 0.1798        | 56.0  | 20384 | 0.5997          | 0.8017   | 0.8244    | 0.8024 | 0.8031 | 0.9077                         | 0.8194                      | 0.8613                  | 0.9706                 | 0.6875              | 0.8049          | 0.8359                     | 0.7431                  | 0.7868              | 0.68                       | 0.7829                  | 0.7278              | 0.7277                       | 0.9789                    | 0.8348                |
| 0.2783        | 57.0  | 20748 | 0.7346          | 0.8567   | 0.8622    | 0.8609 | 0.8497 | 0.7624                         | 0.9583                      | 0.8492                  | 0.9184                 | 0.9375              | 0.9278          | 0.8313                     | 0.9236                  | 0.875               | 0.8667                     | 0.5132                  | 0.6446              | 0.9324                       | 0.9718                    | 0.9517                |
| 0.2132        | 58.0  | 21112 | 1.3325          | 0.7645   | 0.8246    | 0.7652 | 0.7498 | 0.9717                         | 0.7153                      | 0.824                   | 0.715                  | 0.9931              | 0.8314          | 0.9636                     | 0.3681                  | 0.5327              | 0.8647                     | 0.7566                  | 0.8070              | 0.6078                       | 0.9930                    | 0.7540                |
| 0.1655        | 59.0  | 21476 | 2.4867          | 0.7011   | 0.7585    | 0.7015 | 0.6968 | 0.7857                         | 0.6875                      | 0.7333                  | 0.9833                 | 0.4097              | 0.5784          | 0.8527                     | 0.7639                  | 0.8059              | 0.5556                     | 0.7237                  | 0.6286              | 0.6150                       | 0.9225                    | 0.7380                |
| 0.3627        | 60.0  | 21840 | 1.6926          | 0.7011   | 0.7439    | 0.6996 | 0.6998 | 0.6892                         | 0.7083                      | 0.6986                  | 0.7188                 | 0.7986              | 0.7566          | 0.8485                     | 0.7778                  | 0.8116              | 0.5367                     | 0.7697                  | 0.6324              | 0.9265                       | 0.4437                    | 0.6                   |
| 0.2631        | 61.0  | 22204 | 1.3416          | 0.7094   | 0.7883    | 0.7087 | 0.7048 | 0.925                          | 0.5139                      | 0.6607                  | 0.9855                 | 0.4722              | 0.6385          | 0.8254                     | 0.7222                  | 0.7704              | 0.5246                     | 0.8421                  | 0.6465              | 0.6812                       | 0.9930                    | 0.8080                |
| 0.2012        | 62.0  | 22568 | 0.6623          | 0.8457   | 0.8531    | 0.8475 | 0.8449 | 0.7797                         | 0.9583                      | 0.8598                  | 0.9658                 | 0.7847              | 0.8659          | 0.8540                     | 0.8125                  | 0.8327              | 0.8258                     | 0.7171                  | 0.7676              | 0.8405                       | 0.9648                    | 0.8984                |
| 0.2564        | 63.0  | 22932 | 1.3535          | 0.7204   | 0.7862    | 0.7195 | 0.7135 | 0.8529                         | 0.8056                      | 0.8286                  | 0.9841                 | 0.4306              | 0.5990          | 0.8602                     | 0.5556                  | 0.6751              | 0.5485                     | 0.8553                  | 0.6684              | 0.6853                       | 0.9507                    | 0.7965                |
| 0.1741        | 64.0  | 23296 | 0.5313          | 0.8485   | 0.8566    | 0.8511 | 0.8473 | 0.8980                         | 0.9167                      | 0.9072                  | 0.8393                 | 0.9792              | 0.9038          | 0.7371                     | 0.8958                  | 0.8088              | 0.8087                     | 0.6118                  | 0.6966              | 1.0                          | 0.8521                    | 0.9202                |
| 0.3129        | 65.0  | 23660 | 1.4864          | 0.6488   | 0.7434    | 0.6484 | 0.6380 | 0.9                            | 0.25                        | 0.3913                  | 0.5612                 | 0.9236              | 0.6982          | 0.8058                     | 0.7778                  | 0.7915              | 0.4615                     | 0.6711                  | 0.5469              | 0.9888                       | 0.6197                    | 0.7619                |
| 0.2494        | 66.0  | 24024 | 1.5495          | 0.7287   | 0.8151    | 0.7278 | 0.7267 | 0.9143                         | 0.4444                      | 0.5981                  | 1.0                    | 0.4931              | 0.6605          | 0.8333                     | 0.9028                  | 0.8667              | 0.4797                     | 0.8553                  | 0.6147              | 0.8481                       | 0.9437                    | 0.8933                |
| 0.2422        | 67.0  | 24388 | 1.2390          | 0.7686   | 0.7879    | 0.7718 | 0.7642 | 0.8129                         | 0.7847                      | 0.7986                  | 0.8235                 | 0.6806              | 0.7452          | 0.6355                     | 0.8958                  | 0.7435              | 0.8710                     | 0.5329                  | 0.6612              | 0.7965                       | 0.9648                    | 0.8726                |
| 0.1332        | 68.0  | 24752 | 1.7990          | 0.7410   | 0.8158    | 0.7404 | 0.7342 | 1.0                            | 0.3333                      | 0.5                     | 0.8235                 | 0.7778              | 0.8             | 0.7829                     | 0.9514                  | 0.8589              | 0.5061                     | 0.8224                  | 0.6266              | 0.9667                       | 0.8169                    | 0.8855                |
| 0.2093        | 69.0  | 25116 | 0.5063          | 0.8540   | 0.8663    | 0.8569 | 0.8529 | 0.7222                         | 0.9931                      | 0.8363                  | 0.9444                 | 0.9444              | 0.9444          | 0.8456                     | 0.875                   | 0.8601              | 0.8273                     | 0.5987                  | 0.6947              | 0.992                        | 0.8732                    | 0.9288                |
| 0.3587        | 70.0  | 25480 | 0.9657          | 0.7879   | 0.8288    | 0.7878 | 0.7808 | 1.0                            | 0.4583                      | 0.6286                  | 0.8836                 | 0.8958              | 0.8897          | 0.8618                     | 0.7361                  | 0.7940              | 0.6143                     | 0.8487                  | 0.7127              | 0.7845                       | 1.0                       | 0.8793                |
| 0.2032        | 71.0  | 25844 | 0.9718          | 0.7590   | 0.8034    | 0.7588 | 0.7572 | 0.9091                         | 0.625                       | 0.7407                  | 0.9884                 | 0.5903              | 0.7391          | 0.8                        | 0.75                    | 0.7742              | 0.63                       | 0.8289                  | 0.7159              | 0.6893                       | 1.0                       | 0.8161                |
| 0.2602        | 72.0  | 26208 | 1.3336          | 0.7052   | 0.7281    | 0.7065 | 0.7031 | 0.8242                         | 0.5208                      | 0.6383                  | 0.5919                 | 0.9167              | 0.7193          | 0.7721                     | 0.7292                  | 0.75                | 0.6525                     | 0.6053                  | 0.6280              | 0.8                          | 0.7606                    | 0.7798                |
| 0.2728        | 73.0  | 26572 | 0.7606          | 0.8058   | 0.8219    | 0.8061 | 0.8084 | 0.8248                         | 0.7847                      | 0.8043                  | 0.9434                 | 0.6944              | 0.8             | 0.7945                     | 0.8056                  | 0.8                 | 0.6543                     | 0.8092                  | 0.7235              | 0.8926                       | 0.9366                    | 0.9141                |
| 0.1652        | 74.0  | 26936 | 0.8673          | 0.7906   | 0.8111    | 0.7909 | 0.7869 | 0.9224                         | 0.7431                      | 0.8231                  | 0.8926                 | 0.9236              | 0.9078          | 0.8556                     | 0.5347                  | 0.6581              | 0.6816                     | 0.8026                  | 0.7372              | 0.7031                       | 0.9507                    | 0.8084                |
| 0.2047        | 75.0  | 27300 | 1.5109          | 0.7218   | 0.7986    | 0.7243 | 0.7181 | 1.0                            | 0.4653                      | 0.6351                  | 0.9912                 | 0.7847              | 0.8760          | 0.5743                     | 0.9931                  | 0.7277              | 0.8163                     | 0.5263                  | 0.64                | 0.6111                       | 0.8521                    | 0.7118                |
| 0.1685        | 76.0  | 27664 | 0.9601          | 0.8030   | 0.8222    | 0.8043 | 0.8044 | 0.8846                         | 0.7986                      | 0.8394                  | 0.9596                 | 0.6597              | 0.7819          | 0.6757                     | 0.8681                  | 0.7599              | 0.7070                     | 0.7303                  | 0.7184              | 0.8839                       | 0.9648                    | 0.9226                |
| 0.2161        | 77.0  | 28028 | 0.8242          | 0.7686   | 0.8093    | 0.7676 | 0.7768 | 0.8195                         | 0.7569                      | 0.7870                  | 0.9380                 | 0.8403              | 0.8864          | 0.8165                     | 0.6181                  | 0.7036              | 0.5485                     | 0.8553                  | 0.6684              | 0.9237                       | 0.7676                    | 0.8385                |
| 0.1214        | 78.0  | 28392 | 1.5758          | 0.7066   | 0.7803    | 0.7059 | 0.7097 | 0.7946                         | 0.6181                      | 0.6953                  | 1.0                    | 0.4792              | 0.6479          | 0.5917                     | 0.8958                  | 0.7127              | 0.5509                     | 0.7829                  | 0.6467              | 0.9640                       | 0.7535                    | 0.8458                |
| 0.1458        | 79.0  | 28756 | 1.7201          | 0.6667   | 0.8239    | 0.6641 | 0.6700 | 0.9756                         | 0.2778                      | 0.4324                  | 0.9615                 | 0.6944              | 0.8065          | 0.7857                     | 0.9167                  | 0.8462              | 0.3964                     | 0.8684                  | 0.5443              | 1.0                          | 0.5634                    | 0.7207                |
| 0.3304        | 80.0  | 29120 | 1.1946          | 0.7824   | 0.8309    | 0.7823 | 0.7837 | 0.9524                         | 0.5556                      | 0.7018                  | 0.9798                 | 0.6736              | 0.7984          | 0.8378                     | 0.8611                  | 0.8493              | 0.5714                     | 0.8421                  | 0.6809              | 0.8129                       | 0.9789                    | 0.8882                |
| 0.1858        | 81.0  | 29484 | 2.7812          | 0.6460   | 0.7563    | 0.6460 | 0.6443 | 0.9062                         | 0.4028                      | 0.5577                  | 0.9205                 | 0.5625              | 0.6983          | 0.9070                     | 0.5417                  | 0.6783              | 0.5635                     | 0.7303                  | 0.6361              | 0.4845                       | 0.9930                    | 0.6513                |
| 0.1235        | 82.0  | 29848 | 1.0269          | 0.7865   | 0.8142    | 0.7862 | 0.7930 | 0.8571                         | 0.7083                      | 0.7757                  | 0.8333                 | 0.8681              | 0.8503          | 0.8346                     | 0.7361                  | 0.7823              | 0.5877                     | 0.8158                  | 0.6832              | 0.9580                       | 0.8028                    | 0.8736                |
| 0.134         | 83.0  | 30212 | 1.6236          | 0.6818   | 0.8405    | 0.6797 | 0.7026 | 0.975                          | 0.5417                      | 0.6964                  | 1.0                    | 0.4514              | 0.6220          | 0.8692                     | 0.6458                  | 0.7410              | 0.3983                     | 0.9145                  | 0.5549              | 0.96                         | 0.8451                    | 0.8989                |
| 0.2552        | 84.0  | 30576 | 1.6298          | 0.7548   | 0.7811    | 0.7574 | 0.7412 | 0.9841                         | 0.4306                      | 0.5990                  | 0.6875                 | 0.8403              | 0.7562          | 0.8354                     | 0.9514                  | 0.8896              | 0.6617                     | 0.5789                  | 0.6175              | 0.7368                       | 0.9859                    | 0.8434                |
| 0.1101        | 85.0  | 30940 | 1.9185          | 0.6956   | 0.8079    | 0.6932 | 0.7031 | 0.9375                         | 0.4167                      | 0.5769                  | 0.8519                 | 0.7986              | 0.8244          | 0.8414                     | 0.8472                  | 0.8443              | 0.4342                     | 0.8684                  | 0.5789              | 0.9744                       | 0.5352                    | 0.6909                |
| 0.1947        | 86.0  | 31304 | 1.8975          | 0.7355   | 0.7956    | 0.7393 | 0.7341 | 0.8607                         | 0.7292                      | 0.7895                  | 0.8151                 | 0.8264              | 0.8207          | 0.8033                     | 0.6806                  | 0.7368              | 0.9589                     | 0.4605                  | 0.6222              | 0.5399                       | 1.0                       | 0.7012                |
| 0.1428        | 87.0  | 31668 | 0.6888          | 0.7796   | 0.8120    | 0.7798 | 0.7845 | 0.7901                         | 0.8889                      | 0.8366                  | 0.9380                 | 0.8403              | 0.8864          | 0.8105                     | 0.5347                  | 0.6444              | 0.5535                     | 0.7829                  | 0.6485              | 0.968                        | 0.8521                    | 0.9064                |
| 0.2229        | 88.0  | 32032 | 2.4581          | 0.5744   | 0.8051    | 0.5697 | 0.5661 | 0.9762                         | 0.2847                      | 0.4409                  | 0.8284                 | 0.7708              | 0.7986          | 0.8860                     | 0.7014                  | 0.7829              | 0.3350                     | 0.9013                  | 0.4884              | 1.0                          | 0.1901                    | 0.3195                |
| 0.1858        | 89.0  | 32396 | 2.8383          | 0.6804   | 0.7342    | 0.6809 | 0.6517 | 1.0                            | 0.2153                      | 0.3543                  | 0.6294                 | 0.7431              | 0.6815          | 0.7468                     | 0.8194                  | 0.7815              | 0.5889                     | 0.6974                  | 0.6386              | 0.7059                       | 0.9296                    | 0.8024                |
| 0.1742        | 90.0  | 32760 | 1.0500          | 0.7879   | 0.8373    | 0.7878 | 0.7895 | 0.9759                         | 0.5625                      | 0.7137                  | 0.9804                 | 0.6944              | 0.8130          | 0.8662                     | 0.8542                  | 0.8601              | 0.5818                     | 0.8421                  | 0.6882              | 0.7821                       | 0.9859                    | 0.8723                |
| 0.2212        | 91.0  | 33124 | 0.9733          | 0.7906   | 0.8096    | 0.7951 | 0.7814 | 0.6823                         | 0.9097                      | 0.7798                  | 0.7240                 | 0.9653              | 0.8274          | 0.8582                     | 0.7986                  | 0.8273              | 0.8289                     | 0.4145                  | 0.5526              | 0.9545                       | 0.8873                    | 0.9197                |
| 0.276         | 92.0  | 33488 | 1.9019          | 0.7507   | 0.7940    | 0.7512 | 0.7318 | 1.0                            | 0.3194                      | 0.4842                  | 0.8671                 | 0.8611              | 0.8641          | 0.7020                     | 0.9653                  | 0.8129              | 0.6257                     | 0.7368                  | 0.6767              | 0.775                        | 0.8732                    | 0.8212                |
| 0.2309        | 93.0  | 33852 | 2.3563          | 0.6309   | 0.7691    | 0.6332 | 0.6273 | 0.7966                         | 0.6528                      | 0.7176                  | 0.9167                 | 0.7639              | 0.8333          | 0.8974                     | 0.2431                  | 0.3825              | 0.8387                     | 0.5132                  | 0.6367              | 0.3961                       | 0.9930                    | 0.5663                |
| 0.2288        | 94.0  | 34216 | 1.2082          | 0.7397   | 0.7988    | 0.7402 | 0.7399 | 0.6168                         | 0.9167                      | 0.7374                  | 1.0                    | 0.4514              | 0.6220          | 0.8028                     | 0.7917                  | 0.7972              | 0.5829                     | 0.7171                  | 0.6431              | 0.9915                       | 0.8239                    | 0.9                   |
| 0.2247        | 95.0  | 34580 | 1.0517          | 0.7686   | 0.7968    | 0.7701 | 0.7677 | 0.8830                         | 0.5764                      | 0.6975                  | 0.6745                 | 0.9931              | 0.8034          | 0.8038                     | 0.8819                  | 0.8411              | 0.6316                     | 0.6316                  | 0.6316              | 0.9909                       | 0.7676                    | 0.8651                |
| 0.1909        | 96.0  | 34944 | 3.2917          | 0.5744   | 0.7583    | 0.5718 | 0.5322 | 0.8404                         | 0.5486                      | 0.6639                  | 0.9818                 | 0.375               | 0.5427          | 1.0                        | 0.1042                  | 0.1887              | 0.4331                     | 0.8947                  | 0.5837              | 0.5363                       | 0.9366                    | 0.6821                |
| 0.2927        | 97.0  | 35308 | 4.0534          | 0.6129   | 0.7066    | 0.6129 | 0.5919 | 0.9091                         | 0.2083                      | 0.3390                  | 0.8545                 | 0.6528              | 0.7402          | 0.7476                     | 0.5347                  | 0.6235              | 0.5271                     | 0.7039                  | 0.6028              | 0.4946                       | 0.9648                    | 0.6539                |
| 0.1792        | 98.0  | 35672 | 1.4354          | 0.7176   | 0.7802    | 0.7177 | 0.7066 | 0.9808                         | 0.3542                      | 0.5204                  | 0.6558                 | 0.9792              | 0.7855          | 0.7349                     | 0.8472                  | 0.7871              | 0.5684                     | 0.7105                  | 0.6316              | 0.9612                       | 0.6972                    | 0.8082                |
| 0.2467        | 99.0  | 36036 | 1.2316          | 0.7493   | 0.7880    | 0.7493 | 0.7279 | 0.7829                         | 0.9514                      | 0.8589                  | 0.8424                 | 0.9653              | 0.8997          | 0.6294                     | 0.8611                  | 0.7273              | 0.6853                     | 0.6447                  | 0.6644              | 1.0                          | 0.3239                    | 0.4894                |
| 0.2984        | 100.0 | 36400 | 2.6716          | 0.6708   | 0.8169    | 0.6696 | 0.6597 | 1.0                            | 0.2569                      | 0.4088                  | 0.9839                 | 0.4236              | 0.5922          | 0.8633                     | 0.8333                  | 0.8481              | 0.4050                     | 0.8553                  | 0.5497              | 0.8323                       | 0.9789                    | 0.8997                |


### Framework versions

- Transformers 4.48.3
- Pytorch 2.5.1+cu124
- Datasets 3.3.2
- Tokenizers 0.21.0