Davlan commited on
Commit
9028349
Β·
1 Parent(s): b8bee02

updating readme

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Hugging Face's logo
2
+ ---
3
+ language: am
4
+ datasets:
5
+
6
+ ---
7
+ # bert-base-multilingual-cased-finetuned-amharic
8
+ ## Model description
9
+ **bert-base-multilingual-cased-finetuned-amharic** is a **Amharic BERT** model obtained by replacing mBERT vocabulary by amharic vocabulary because the language was not supported, and fine-tuning **bert-base-multilingual-cased** model on Amharic language texts. It provides **better performance** than the multilingual Amharic on named entity recognition datasets.
10
+
11
+ Specifically, this model is a *bert-base-multilingual-cased* model that was fine-tuned on Amharic corpus using Amharic vocabulary.
12
+ ## Intended uses & limitations
13
+ #### How to use
14
+ You can use this model with Transformers *pipeline* for masked token prediction.
15
+ ```python
16
+ >>> from transformers import pipeline
17
+ >>> unmasker = pipeline('fill-mask', model='Davlan/bert-base-multilingual-cased-finetuned-amharic')
18
+ >>> unmasker("α‹¨αŠ αˆœαˆͺካ α‹¨αŠ ααˆͺካ α‰€αŠ•α‹΅ αˆα‹© αˆ˜αˆα‹•αŠ­α‰°αŠ› αŒ„αˆαˆͺ αŒαˆα‰΅αˆ›αŠ• α‰ αŠ αˆ«α‰΅ αŠ αŒˆαˆ«α‰΅ α‹¨αˆšα‹«α‹°αŒ‰α‰΅αŠ• [MASK] αˆ˜αŒ€αˆ˜αˆ«α‰Έα‹αŠ• α‹¨αŠ αˆœαˆͺካ የውαŒͺ αŒ‰α‹³α‹­ αˆšαŠ•αˆ΅α‰΄αˆ­ αŠ αˆ΅α‰³α‹ˆα‰€α’")
19
+
20
+
21
+ ```
22
+ #### Limitations and bias
23
+ This model is limited by its training dataset of entity-annotated news articles from a specific span of time. This may not generalize well for all use cases in different domains.
24
+ ## Training data
25
+ This model was fine-tuned on [Amharic CC-100](http://data.statmt.org/cc-100/)
26
+
27
+ ## Training procedure
28
+ This model was trained on a single NVIDIA V100 GPU
29
+
30
+ ## Eval results on Test set (F-score, average over 5 runs)
31
+ Dataset| mBERT F1 | am_bert F1
32
+ -|-|-
33
+ [MasakhaNER](https://github.com/masakhane-io/masakhane-ner) | 0.0 | 60.89
34
+
35
+ ### BibTeX entry and citation info
36
+ By David Adelani
37
+ ```
38
+
39
+ ```
40
+
41
+