saraaaaaaaaaaaaaa commited on
Commit
4067cdd
·
1 Parent(s): 9dc97d3

Training in progress epoch 0

Browse files
Files changed (3) hide show
  1. README.md +12 -14
  2. config.json +1 -1
  3. tf_model.h5 +2 -2
README.md CHANGED
@@ -15,13 +15,13 @@ probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [asafaya/bert-base-arabic](https://huggingface.co/asafaya/bert-base-arabic) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Train Loss: 0.1031
19
- - Validation Loss: 0.1133
20
- - Train Accuracy: 0.9691
21
- - Train F1: 0.9560
22
- - Train Precision: 0.9584
23
- - Train Recall: 0.9535
24
- - Epoch: 2
25
 
26
  ## Model description
27
 
@@ -40,21 +40,19 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 909, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': np.float32(0.9), 'beta_2': np.float32(0.999), 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
44
  - training_precision: float32
45
 
46
  ### Training results
47
 
48
  | Train Loss | Validation Loss | Train Accuracy | Train F1 | Train Precision | Train Recall | Epoch |
49
  |:----------:|:---------------:|:--------------:|:--------:|:---------------:|:------------:|:-----:|
50
- | 0.4636 | 0.1392 | 0.9619 | 0.9455 | 0.9489 | 0.9421 | 0 |
51
- | 0.1257 | 0.1173 | 0.9677 | 0.9540 | 0.9562 | 0.9518 | 1 |
52
- | 0.1031 | 0.1133 | 0.9691 | 0.9560 | 0.9584 | 0.9535 | 2 |
53
 
54
 
55
  ### Framework versions
56
 
57
- - Transformers 4.51.3
58
  - TensorFlow 2.18.0
59
- - Datasets 3.6.0
60
- - Tokenizers 0.21.1
 
15
 
16
  This model is a fine-tuned version of [asafaya/bert-base-arabic](https://huggingface.co/asafaya/bert-base-arabic) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Train Loss: 0.4023
19
+ - Validation Loss: 0.1317
20
+ - Train Accuracy: 0.9636
21
+ - Train F1: 0.9482
22
+ - Train Precision: 0.9512
23
+ - Train Recall: 0.9453
24
+ - Epoch: 0
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 909, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
44
  - training_precision: float32
45
 
46
  ### Training results
47
 
48
  | Train Loss | Validation Loss | Train Accuracy | Train F1 | Train Precision | Train Recall | Epoch |
49
  |:----------:|:---------------:|:--------------:|:--------:|:---------------:|:------------:|:-----:|
50
+ | 0.4023 | 0.1317 | 0.9636 | 0.9482 | 0.9512 | 0.9453 | 0 |
 
 
51
 
52
 
53
  ### Framework versions
54
 
55
+ - Transformers 4.51.1
56
  - TensorFlow 2.18.0
57
+ - Datasets 3.5.0
58
+ - Tokenizers 0.21.0
config.json CHANGED
@@ -56,7 +56,7 @@
56
  "output_past": true,
57
  "pad_token_id": 0,
58
  "position_embedding_type": "absolute",
59
- "transformers_version": "4.51.3",
60
  "type_vocab_size": 2,
61
  "use_cache": true,
62
  "vocab_size": 32000
 
56
  "output_past": true,
57
  "pad_token_id": 0,
58
  "position_embedding_type": "absolute",
59
+ "transformers_version": "4.51.1",
60
  "type_vocab_size": 2,
61
  "use_cache": true,
62
  "vocab_size": 32000
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d34e058821acd58c88a53f2db4b3d82d80c1edec6541448378137609c9c3d18
3
- size 440432652
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:020b408da5a348d92463c44f72771db09b85444a3fda49634215471b4ecf94bb
3
+ size 440444940