Hugging Face's logo

avinot
/
distilbert-lolchamps

Fill-Mask
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
avinot commited on
Commit
adddc58
•
1 Parent(s): 2fa88e7

End of training

Browse files
Files changed (10) hide show
  1. README.md +10 -10
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. runs/Oct09_23-51-07_DESKTOP-5E8P2FU/events.out.tfevents.1728510674.DESKTOP-5E8P2FU +3 -0
  5. runs/Oct09_23-51-07_DESKTOP-5E8P2FU/events.out.tfevents.1728510821.DESKTOP-5E8P2FU +3 -0
  6. runs/Oct10_17-57-05_DESKTOP-5E8P2FU/events.out.tfevents.1728575829.DESKTOP-5E8P2FU +3 -0
  7. runs/Oct10_17-57-05_DESKTOP-5E8P2FU/events.out.tfevents.1728575964.DESKTOP-5E8P2FU +3 -0
  8. runs/Oct10_18-06-16_DESKTOP-5E8P2FU/events.out.tfevents.1728576380.DESKTOP-5E8P2FU +3 -0
  9. tokenizer_config.json +1 -1
  10. training_args.bin +2 -2
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: distilbert-base-uncased
6
  model-index:
7
  - name: distilbert-lolchamps
8
  results: []
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # distilbert-lolchamps
15
 
16
- This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on a [LoL-Champions-Corpus](https://huggingface.co/datasets/avinot/LoL-Champions-Corpus) dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.0446
19
 
20
  ## Model description
21
 
@@ -46,14 +46,14 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 2.7422 | 1.0 | 49 | 2.3202 |
50
- | 2.3298 | 2.0 | 98 | 2.1095 |
51
- | 2.1925 | 3.0 | 147 | 2.0556 |
52
 
53
 
54
  ### Framework versions
55
 
56
- - Transformers 4.40.0
57
- - Pytorch 2.2.1+cu121
58
- - Datasets 2.19.0
59
- - Tokenizers 0.19.1
 
1
  ---
2
  license: apache-2.0
3
+ base_model: distilbert-base-uncased
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: distilbert-lolchamps
8
  results: []
 
13
 
14
  # distilbert-lolchamps
15
 
16
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.1303
19
 
20
  ## Model description
21
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 2.7459 | 1.0 | 76 | 2.3509 |
50
+ | 2.3368 | 2.0 | 152 | 2.1723 |
51
+ | 2.2484 | 3.0 | 228 | 2.1303 |
52
 
53
 
54
  ### Framework versions
55
 
56
+ - Transformers 4.39.3
57
+ - Pytorch 2.3.0+cu121
58
+ - Datasets 2.20.0
59
+ - Tokenizers 0.15.2
config.json CHANGED
@@ -19,6 +19,6 @@
19
  "sinusoidal_pos_embds": false,
20
  "tie_weights_": true,
21
  "torch_dtype": "float32",
22
- "transformers_version": "4.40.0",
23
  "vocab_size": 30522
24
  }
 
19
  "sinusoidal_pos_embds": false,
20
  "tie_weights_": true,
21
  "torch_dtype": "float32",
22
+ "transformers_version": "4.39.3",
23
  "vocab_size": 30522
24
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75e95fb1b32c08bef662208574456bf449886e0d4846186fe769e4a417ffcd60
3
  size 267954768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:127175149b441f86ce349130a0eef7abc07806675debca8eb4e09f8f1bc6643b
3
  size 267954768
runs/Oct09_23-51-07_DESKTOP-5E8P2FU/events.out.tfevents.1728510674.DESKTOP-5E8P2FU ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6604d320570939c23b04fc8c230c3d713ff0cbf6652caa375f83b630f568f06c
3
+ size 6442
runs/Oct09_23-51-07_DESKTOP-5E8P2FU/events.out.tfevents.1728510821.DESKTOP-5E8P2FU ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22363e70aa33831aa21fa408691759a49267905853c8d689fc5627d829d896ea
3
+ size 311
runs/Oct10_17-57-05_DESKTOP-5E8P2FU/events.out.tfevents.1728575829.DESKTOP-5E8P2FU ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5aff4e3702869727bac6db42a471af0de83b528dc3eb8ec737c14fc9076066c
3
+ size 6442
runs/Oct10_17-57-05_DESKTOP-5E8P2FU/events.out.tfevents.1728575964.DESKTOP-5E8P2FU ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a87447b5cbee6eb0c4399c35db5d74a9130433fe059f0f618635cdfb83b5bab0
3
+ size 311
runs/Oct10_18-06-16_DESKTOP-5E8P2FU/events.out.tfevents.1728576380.DESKTOP-5E8P2FU ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d17775b7a3a880861aac498c8e13297d3a25f1d22f2afa96ee54eabd5a69d74d
3
+ size 6442
tokenizer_config.json CHANGED
@@ -45,7 +45,7 @@
45
  "cls_token": "[CLS]",
46
  "do_lower_case": true,
47
  "mask_token": "[MASK]",
48
- "model_max_length": 1000000000000000019884624838656,
49
  "pad_token": "[PAD]",
50
  "sep_token": "[SEP]",
51
  "strip_accents": null,
 
45
  "cls_token": "[CLS]",
46
  "do_lower_case": true,
47
  "mask_token": "[MASK]",
48
+ "model_max_length": 512,
49
  "pad_token": "[PAD]",
50
  "sep_token": "[SEP]",
51
  "strip_accents": null,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:efeeb70214685ef581b3ab8d21aaaeb6d7d84ce4eef1110beb86350b6dd86737
3
- size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40eb43bd06c61f58a3a30f740d6cf7636629e4f0869b634c41afd023da2ba68c
3
+ size 4984