nlpresearcher commited on
Commit
b623b8f
·
verified ·
1 Parent(s): afc8b63

sil-ai/madlad400-finetuned-engNASB-swhONEN

Browse files
Files changed (3) hide show
  1. README.md +9 -9
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -16,8 +16,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [jbochi/madlad400-3b-mt](https://huggingface.co/jbochi/madlad400-3b-mt) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 7.6123
20
- - Chrf: 21.2726
21
 
22
  ## Model description
23
 
@@ -49,13 +49,13 @@ The following hyperparameters were used during training:
49
 
50
  ### Training results
51
 
52
- | Training Loss | Epoch | Step | Validation Loss | Chrf |
53
- |:-------------:|:-----:|:----:|:---------------:|:-------:|
54
- | 8.3321 | 1.0 | 447 | 7.9944 | 16.8707 |
55
- | 8.2447 | 2.0 | 894 | 7.9054 | 16.7970 |
56
- | 7.8946 | 3.0 | 1341 | 7.7068 | 19.7205 |
57
- | 7.8613 | 4.0 | 1788 | 7.6445 | 20.4812 |
58
- | 7.5683 | 5.0 | 2235 | 7.6123 | 21.2726 |
59
 
60
 
61
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [jbochi/madlad400-3b-mt](https://huggingface.co/jbochi/madlad400-3b-mt) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 7.4433
20
+ - Chrf: 37.7656
21
 
22
  ## Model description
23
 
 
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss | Chrf |
53
+ |:-------------:|:------:|:----:|:---------------:|:-------:|
54
+ | 7.5714 | 0.9997 | 1748 | 7.4837 | 36.0379 |
55
+ | 7.5863 | 2.0 | 3497 | 7.4686 | 36.6073 |
56
+ | 7.5366 | 2.9997 | 5245 | 7.4529 | 37.1613 |
57
+ | 7.5282 | 4.0 | 6994 | 7.4461 | 37.4309 |
58
+ | 7.6738 | 4.9986 | 8740 | 7.4433 | 37.7656 |
59
 
60
 
61
  ### Framework versions
adapter_config.json CHANGED
@@ -20,8 +20,8 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "q",
24
- "v"
25
  ],
26
  "task_type": "SEQ_2_SEQ_LM",
27
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
+ "v",
24
+ "q"
25
  ],
26
  "task_type": "SEQ_2_SEQ_LM",
27
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d71a0f601f08e49f17141ad2096cfe015022c17d64db12b595d0eeab3b1dad17
3
  size 18928616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f278fc9d96027d2b1edebfbedf8ea59657ed1e66a30543d9f26aeec16edb2879
3
  size 18928616