Update README.md
Browse files
README.md
CHANGED
@@ -72,8 +72,10 @@ The following hyperparameters were used during training:
|
|
72 |
### Training results
|
73 |
|
74 |
### Evaluation results
|
75 |
-
Perplexity on the first 5000 examples of the Wiki-40B test sets, using the code provided in the [perplexity docs]
|
76 |
-
|
|
|
|
|
77 |
|
78 |
|
79 |
The following script was used for evaluation
|
|
|
72 |
### Training results
|
73 |
|
74 |
### Evaluation results
|
75 |
+
Perplexity on the first 5000 examples of the Wiki-40B test sets, using the code provided in the [perplexity docs](https://huggingface.co/docs/transformers/perplexity), with 512 tokes of stride:
|
76 |
+
| Target language | PPL |
|
77 |
+
|-----------------|-------------------|
|
78 |
+
| en | 33.41002655029297 |
|
79 |
|
80 |
|
81 |
The following script was used for evaluation
|