updating readme
Browse files
README.md
ADDED
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Hugging Face's logo
|
2 |
+
---
|
3 |
+
language: am
|
4 |
+
datasets:
|
5 |
+
|
6 |
+
---
|
7 |
+
# bert-base-multilingual-cased-finetuned-amharic
|
8 |
+
## Model description
|
9 |
+
**bert-base-multilingual-cased-finetuned-amharic** is a **Amharic BERT** model obtained by replacing mBERT vocabulary by amharic vocabulary because the language was not supported, and fine-tuning **bert-base-multilingual-cased** model on Amharic language texts. It provides **better performance** than the multilingual Amharic on named entity recognition datasets.
|
10 |
+
|
11 |
+
Specifically, this model is a *bert-base-multilingual-cased* model that was fine-tuned on Amharic corpus using Amharic vocabulary.
|
12 |
+
## Intended uses & limitations
|
13 |
+
#### How to use
|
14 |
+
You can use this model with Transformers *pipeline* for masked token prediction.
|
15 |
+
```python
|
16 |
+
>>> from transformers import pipeline
|
17 |
+
>>> unmasker = pipeline('fill-mask', model='Davlan/bert-base-multilingual-cased-finetuned-amharic')
|
18 |
+
>>> unmasker("α¨α ααͺα« α¨α ααͺα« ααα΅ αα© ααααα°α αααͺ ααα΅αα α α α«α΅ α αα«α΅ α¨αα«α°αα΅α [MASK] αααα«αΈαα α¨α ααͺα« α¨ααͺ αα³α ααα΅α΄α α α΅α³ααα’")
|
19 |
+
|
20 |
+
|
21 |
+
```
|
22 |
+
#### Limitations and bias
|
23 |
+
This model is limited by its training dataset of entity-annotated news articles from a specific span of time. This may not generalize well for all use cases in different domains.
|
24 |
+
## Training data
|
25 |
+
This model was fine-tuned on [Amharic CC-100](http://data.statmt.org/cc-100/)
|
26 |
+
|
27 |
+
## Training procedure
|
28 |
+
This model was trained on a single NVIDIA V100 GPU
|
29 |
+
|
30 |
+
## Eval results on Test set (F-score, average over 5 runs)
|
31 |
+
Dataset| mBERT F1 | am_bert F1
|
32 |
+
-|-|-
|
33 |
+
[MasakhaNER](https://github.com/masakhane-io/masakhane-ner) | 0.0 | 60.89
|
34 |
+
|
35 |
+
### BibTeX entry and citation info
|
36 |
+
By David Adelani
|
37 |
+
```
|
38 |
+
|
39 |
+
```
|
40 |
+
|
41 |
+
|