Final model for experiment Icelandic
Browse files- README.md +55 -55
- model.safetensors +1 -1
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
---
|
2 |
library_name: transformers
|
3 |
tags:
|
4 |
-
-
|
5 |
- generated_from_trainer
|
6 |
model-index:
|
7 |
- name: childes-segmentation-800k-2-gpt2_lm-model
|
@@ -15,50 +15,50 @@ should probably proofread and complete it, then remove this comment. -->
|
|
15 |
|
16 |
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
-
- Loss: 2.
|
19 |
-
- Model Preparation Time: 0.
|
20 |
-
- Perplexity:
|
21 |
-
- Bpc: 3.
|
22 |
-
- Spike Seg Type Fscore Entropy: 0.
|
23 |
-
- Spike Seg Boundary Fscore Entropy: 0.
|
24 |
-
- Absolute Seg Type Fscore Entropy: 0.
|
25 |
-
- Absolute Seg Boundary Fscore Entropy: 0.
|
26 |
-
- Spike Seg Type Fscore Increase in entropy: 0.
|
27 |
-
- Spike Seg Boundary Fscore Increase in entropy: 0.
|
28 |
-
- Absolute Seg Type Fscore Increase in entropy: 0.
|
29 |
-
- Absolute Seg Boundary Fscore Increase in entropy: 0.
|
30 |
-
- Spike Seg Type Fscore Loss: 0.
|
31 |
-
- Spike Seg Boundary Fscore Loss: 0.
|
32 |
-
- Absolute Seg Type Fscore Loss: 0.
|
33 |
-
- Absolute Seg Boundary Fscore Loss: 0.
|
34 |
-
- Spike Seg Type Fscore Increase in loss: 0.
|
35 |
-
- Spike Seg Boundary Fscore Increase in loss: 0.
|
36 |
-
- Absolute Seg Type Fscore Increase in loss: 0.
|
37 |
-
- Absolute Seg Boundary Fscore Increase in loss: 0.
|
38 |
-
- Spike Seg Type Fscore Rank: 0.
|
39 |
-
- Spike Seg Boundary Fscore Rank: 0.
|
40 |
-
- Absolute Seg Type Fscore Rank: 0.
|
41 |
-
- Absolute Seg Boundary Fscore Rank: 0.
|
42 |
-
- Spike Seg Type Fscore Increase in rank: 0.
|
43 |
-
- Spike Seg Boundary Fscore Increase in rank: 0.
|
44 |
-
- Absolute Seg Type Fscore Increase in rank: 0.
|
45 |
-
- Absolute Seg Boundary Fscore Increase in rank: 0.
|
46 |
-
- Spike Seg Type Fscore Boundary prediction: 0.
|
47 |
-
- Spike Seg Boundary Fscore Boundary prediction: 0.
|
48 |
-
- Absolute Seg Type Fscore Boundary prediction: 0.
|
49 |
-
- Absolute Seg Boundary Fscore Boundary prediction: 0.
|
50 |
-
- Spike Seg Type Fscore Increase in boundary prediction: 0.
|
51 |
-
- Spike Seg Boundary Fscore Increase in boundary prediction: 0.
|
52 |
-
- Absolute Seg Type Fscore Increase in boundary prediction: 0.
|
53 |
-
- Absolute Seg Boundary Fscore Increase in boundary prediction: 0.
|
54 |
-
- Spike Seg Type Fscore Majority vote cutoff: 0.
|
55 |
-
- Spike Seg Type Fscore Majority vote spike: 0.
|
56 |
-
- Absolute Seg Type Fscore Majority vote cutoff: 0.
|
57 |
-
- Absolute Seg Type Fscore Majority vote spike: 0.
|
58 |
-
- Spike Seg Boundary Fscore Majority vote cutoff: 0.
|
59 |
-
- Spike Seg Boundary Fscore Majority vote spike: 0.
|
60 |
-
- Absolute Seg Boundary Fscore Majority vote cutoff: 0.
|
61 |
-
- Absolute Seg Boundary Fscore Majority vote spike: 0.
|
62 |
|
63 |
## Model description
|
64 |
|
@@ -90,16 +90,16 @@ The following hyperparameters were used during training:
|
|
90 |
|
91 |
| Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike |
|
92 |
|:-------------:|:---------:|:------:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:|
|
93 |
-
| 1.
|
94 |
-
| 1.
|
95 |
-
| 1.
|
96 |
-
| 1.
|
97 |
-
| 1.
|
98 |
-
| 1.
|
99 |
-
| 1.
|
100 |
-
| 1.
|
101 |
-
|
|
102 |
-
|
|
103 |
|
104 |
|
105 |
### Framework versions
|
|
|
1 |
---
|
2 |
library_name: transformers
|
3 |
tags:
|
4 |
+
- Icelandic
|
5 |
- generated_from_trainer
|
6 |
model-index:
|
7 |
- name: childes-segmentation-800k-2-gpt2_lm-model
|
|
|
15 |
|
16 |
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
|
17 |
It achieves the following results on the evaluation set:
|
18 |
+
- Loss: 2.2460
|
19 |
+
- Model Preparation Time: 0.001
|
20 |
+
- Perplexity: 9.4500
|
21 |
+
- Bpc: 3.2403
|
22 |
+
- Spike Seg Type Fscore Entropy: 0.2303
|
23 |
+
- Spike Seg Boundary Fscore Entropy: 0.5593
|
24 |
+
- Absolute Seg Type Fscore Entropy: 0.2397
|
25 |
+
- Absolute Seg Boundary Fscore Entropy: 0.5432
|
26 |
+
- Spike Seg Type Fscore Increase in entropy: 0.2424
|
27 |
+
- Spike Seg Boundary Fscore Increase in entropy: 0.5871
|
28 |
+
- Absolute Seg Type Fscore Increase in entropy: 0.3028
|
29 |
+
- Absolute Seg Boundary Fscore Increase in entropy: 0.6192
|
30 |
+
- Spike Seg Type Fscore Loss: 0.2182
|
31 |
+
- Spike Seg Boundary Fscore Loss: 0.5346
|
32 |
+
- Absolute Seg Type Fscore Loss: 0.2164
|
33 |
+
- Absolute Seg Boundary Fscore Loss: 0.5303
|
34 |
+
- Spike Seg Type Fscore Increase in loss: 0.2506
|
35 |
+
- Spike Seg Boundary Fscore Increase in loss: 0.5872
|
36 |
+
- Absolute Seg Type Fscore Increase in loss: 0.2840
|
37 |
+
- Absolute Seg Boundary Fscore Increase in loss: 0.6214
|
38 |
+
- Spike Seg Type Fscore Rank: 0.2748
|
39 |
+
- Spike Seg Boundary Fscore Rank: 0.5650
|
40 |
+
- Absolute Seg Type Fscore Rank: 0.2565
|
41 |
+
- Absolute Seg Boundary Fscore Rank: 0.5475
|
42 |
+
- Spike Seg Type Fscore Increase in rank: 0.3064
|
43 |
+
- Spike Seg Boundary Fscore Increase in rank: 0.6272
|
44 |
+
- Absolute Seg Type Fscore Increase in rank: 0.3508
|
45 |
+
- Absolute Seg Boundary Fscore Increase in rank: 0.6405
|
46 |
+
- Spike Seg Type Fscore Boundary prediction: 0.3026
|
47 |
+
- Spike Seg Boundary Fscore Boundary prediction: 0.6885
|
48 |
+
- Absolute Seg Type Fscore Boundary prediction: 0.3387
|
49 |
+
- Absolute Seg Boundary Fscore Boundary prediction: 0.6690
|
50 |
+
- Spike Seg Type Fscore Increase in boundary prediction: 0.2865
|
51 |
+
- Spike Seg Boundary Fscore Increase in boundary prediction: 0.6711
|
52 |
+
- Absolute Seg Type Fscore Increase in boundary prediction: 0.3390
|
53 |
+
- Absolute Seg Boundary Fscore Increase in boundary prediction: 0.6869
|
54 |
+
- Spike Seg Type Fscore Majority vote cutoff: 0.3724
|
55 |
+
- Spike Seg Type Fscore Majority vote spike: 0.2526
|
56 |
+
- Absolute Seg Type Fscore Majority vote cutoff: 0.3758
|
57 |
+
- Absolute Seg Type Fscore Majority vote spike: 0.3480
|
58 |
+
- Spike Seg Boundary Fscore Majority vote cutoff: 0.7024
|
59 |
+
- Spike Seg Boundary Fscore Majority vote spike: 0.6156
|
60 |
+
- Absolute Seg Boundary Fscore Majority vote cutoff: 0.6946
|
61 |
+
- Absolute Seg Boundary Fscore Majority vote spike: 0.6919
|
62 |
|
63 |
## Model description
|
64 |
|
|
|
90 |
|
91 |
| Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike |
|
92 |
|:-------------:|:---------:|:------:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:|
|
93 |
+
| 1.6175 | 444.4444 | 20000 | 1.7489 | 0.001 | 5.7482 | 2.5231 | 0.2642 | 0.5919 | 0.2665 | 0.5212 | 0.2701 | 0.6304 | 0.3317 | 0.6752 | 0.2459 | 0.5798 | 0.2255 | 0.5519 | 0.2756 | 0.6264 | 0.3518 | 0.6567 | 0.2887 | 0.5745 | 0.2524 | 0.5439 | 0.3089 | 0.6256 | 0.3719 | 0.6428 | 0.3112 | 0.7031 | 0.3370 | 0.6692 | 0.2817 | 0.6834 | 0.3256 | 0.6855 | 0.3687 | 0.2712 | 0.4040 | 0.3713 | 0.7265 | 0.6378 | 0.6990 | 0.7175 |
|
94 |
+
| 1.3535 | 888.8889 | 40000 | 1.8331 | 0.001 | 6.2535 | 2.6447 | 0.2568 | 0.6068 | 0.2685 | 0.5635 | 0.2546 | 0.6167 | 0.3321 | 0.6636 | 0.2374 | 0.5647 | 0.2188 | 0.5477 | 0.2687 | 0.6184 | 0.3092 | 0.6511 | 0.2917 | 0.5771 | 0.2692 | 0.5477 | 0.3131 | 0.6284 | 0.3652 | 0.6418 | 0.3154 | 0.7086 | 0.2492 | 0.6778 | 0.2914 | 0.6866 | 0.2307 | 0.6973 | 0.3841 | 0.2615 | 0.3394 | 0.3690 | 0.7287 | 0.6365 | 0.7182 | 0.7170 |
|
95 |
+
| 1.2416 | 1333.3333 | 60000 | 1.9317 | 0.001 | 6.9010 | 2.7868 | 0.2597 | 0.5973 | 0.2527 | 0.5656 | 0.2615 | 0.6216 | 0.3329 | 0.6541 | 0.2222 | 0.5536 | 0.2141 | 0.5407 | 0.2630 | 0.6107 | 0.3004 | 0.6387 | 0.2718 | 0.5679 | 0.2517 | 0.5417 | 0.3100 | 0.6270 | 0.3521 | 0.6378 | 0.3130 | 0.7020 | 0.3357 | 0.6839 | 0.2865 | 0.6845 | 0.3476 | 0.7014 | 0.3781 | 0.2598 | 0.3827 | 0.3757 | 0.7260 | 0.6315 | 0.7076 | 0.7102 |
|
96 |
+
| 1.1496 | 1777.7778 | 80000 | 2.0242 | 0.001 | 7.5700 | 2.9203 | 0.2538 | 0.5928 | 0.2672 | 0.5639 | 0.2558 | 0.6147 | 0.3395 | 0.6619 | 0.2188 | 0.5458 | 0.2236 | 0.5461 | 0.2595 | 0.6061 | 0.3043 | 0.6382 | 0.2788 | 0.5691 | 0.2566 | 0.5498 | 0.3118 | 0.6361 | 0.3734 | 0.6360 | 0.3065 | 0.7090 | 0.3638 | 0.6799 | 0.2927 | 0.6883 | 0.2263 | 0.7091 | 0.3803 | 0.2582 | 0.3775 | 0.3722 | 0.7319 | 0.6326 | 0.7140 | 0.7135 |
|
97 |
+
| 1.0977 | 2222.2222 | 100000 | 2.0854 | 0.001 | 8.0482 | 3.0087 | 0.2400 | 0.5819 | 0.2511 | 0.5599 | 0.2444 | 0.6038 | 0.3223 | 0.6430 | 0.2132 | 0.5394 | 0.2151 | 0.5225 | 0.2579 | 0.5947 | 0.2917 | 0.6321 | 0.2708 | 0.5629 | 0.2540 | 0.5499 | 0.3128 | 0.6301 | 0.3585 | 0.6439 | 0.3066 | 0.6939 | 0.3616 | 0.6823 | 0.2861 | 0.6798 | 0.3569 | 0.6958 | 0.3720 | 0.2593 | 0.3859 | 0.3467 | 0.7174 | 0.6245 | 0.7012 | 0.6982 |
|
98 |
+
| 1.0641 | 2666.6667 | 120000 | 2.1344 | 0.001 | 8.4523 | 3.0793 | 0.2390 | 0.5745 | 0.2466 | 0.5600 | 0.2452 | 0.6036 | 0.3256 | 0.6425 | 0.2195 | 0.5380 | 0.2149 | 0.5416 | 0.2536 | 0.5915 | 0.3000 | 0.6261 | 0.2710 | 0.5637 | 0.2416 | 0.5487 | 0.3226 | 0.6284 | 0.3565 | 0.6416 | 0.3004 | 0.6989 | 0.3601 | 0.6745 | 0.2835 | 0.6803 | 0.3514 | 0.6981 | 0.3692 | 0.2592 | 0.3760 | 0.3486 | 0.7128 | 0.6212 | 0.6914 | 0.7015 |
|
99 |
+
| 1.0362 | 3111.1111 | 140000 | 2.1768 | 0.001 | 8.8182 | 3.1405 | 0.2350 | 0.5715 | 0.2417 | 0.5501 | 0.2420 | 0.5949 | 0.3085 | 0.6333 | 0.2163 | 0.5406 | 0.2176 | 0.5210 | 0.2509 | 0.5914 | 0.2868 | 0.6270 | 0.2794 | 0.5673 | 0.2535 | 0.5519 | 0.3070 | 0.6262 | 0.3482 | 0.6410 | 0.2950 | 0.6880 | 0.3238 | 0.6671 | 0.2837 | 0.6728 | 0.3423 | 0.6846 | 0.3639 | 0.2543 | 0.3627 | 0.3487 | 0.7100 | 0.6206 | 0.6951 | 0.6993 |
|
100 |
+
| 1.015 | 3555.5556 | 160000 | 2.2030 | 0.001 | 9.0517 | 3.1782 | 0.2322 | 0.5592 | 0.2485 | 0.5378 | 0.2412 | 0.5873 | 0.3023 | 0.6260 | 0.2133 | 0.5368 | 0.2127 | 0.5354 | 0.2474 | 0.5899 | 0.2989 | 0.6116 | 0.2769 | 0.5650 | 0.2562 | 0.5469 | 0.3076 | 0.6250 | 0.3541 | 0.6272 | 0.3050 | 0.6899 | 0.2633 | 0.6749 | 0.2817 | 0.6715 | 0.2196 | 0.6851 | 0.3431 | 0.2515 | 0.3319 | 0.3523 | 0.7134 | 0.6164 | 0.6674 | 0.6961 |
|
101 |
+
| 0.9954 | 4000.0 | 180000 | 2.2326 | 0.001 | 9.3245 | 3.2210 | 0.2309 | 0.5631 | 0.2355 | 0.5352 | 0.2431 | 0.5881 | 0.3056 | 0.6252 | 0.2163 | 0.5366 | 0.2154 | 0.5347 | 0.2517 | 0.5891 | 0.2916 | 0.6247 | 0.2736 | 0.5629 | 0.2584 | 0.5451 | 0.3047 | 0.6260 | 0.3487 | 0.6354 | 0.3005 | 0.6886 | 0.3468 | 0.6719 | 0.2850 | 0.6693 | 0.3431 | 0.6886 | 0.3645 | 0.2563 | 0.3672 | 0.3460 | 0.7049 | 0.6166 | 0.6977 | 0.6912 |
|
102 |
+
| 0.9805 | 4444.4444 | 200000 | 2.2460 | 0.001 | 9.4500 | 3.2403 | 0.2303 | 0.5593 | 0.2397 | 0.5432 | 0.2424 | 0.5871 | 0.3028 | 0.6192 | 0.2182 | 0.5346 | 0.2164 | 0.5303 | 0.2506 | 0.5872 | 0.2840 | 0.6214 | 0.2748 | 0.5650 | 0.2565 | 0.5475 | 0.3064 | 0.6272 | 0.3508 | 0.6405 | 0.3026 | 0.6885 | 0.3387 | 0.6690 | 0.2865 | 0.6711 | 0.3390 | 0.6869 | 0.3724 | 0.2526 | 0.3758 | 0.3480 | 0.7024 | 0.6156 | 0.6946 | 0.6919 |
|
103 |
|
104 |
|
105 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3339176
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b6a0488737d3f092402865e17a2ce51fad7215a632f4531e99824326af470646
|
3 |
size 3339176
|