Add XLM-RoBERTa Khmer custom tokenizer
Browse files- README.md +1 -2
- tokenizer.json +0 -0
README.md
CHANGED
|
@@ -1,4 +1,3 @@
|
|
| 1 |
-
|
| 2 |
---
|
| 3 |
language:
|
| 4 |
- km
|
|
@@ -11,7 +10,7 @@ tags:
|
|
| 11 |
datasets:
|
| 12 |
- custom-khmer-dataset
|
| 13 |
widget:
|
| 14 |
-
- text:
|
| 15 |
---
|
| 16 |
|
| 17 |
# XLM-RoBERTa Khmer Custom Tokenizer
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- km
|
|
|
|
| 10 |
datasets:
|
| 11 |
- custom-khmer-dataset
|
| 12 |
widget:
|
| 13 |
+
- text: ខ្ញុំចង់<mask>ភាសាខ្មែរ
|
| 14 |
---
|
| 15 |
|
| 16 |
# XLM-RoBERTa Khmer Custom Tokenizer
|
tokenizer.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|