Update README.md
Browse files
README.md
CHANGED
@@ -42,7 +42,7 @@ pretty_name: “ayayay - ukrainized aya tokenizer”
|
|
42 |
|
43 |
<img src="ayayay.png" width="400px" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
44 |
|
45 |
-
#### Ayayay is the first tokenizer that makes Ukrainian the core language in a multilingual vocabulary—while retaining as much compatibility with the original Aya-Expanse tokenizer as possible through careful (partially manual) token remapping.
|
46 |
|
47 |
## Feature Overview:
|
48 |
|
@@ -99,10 +99,10 @@ Some tokens are identical to those in the original Aya-Expanse tokenizer. For th
|
|
99 |
**BibTeX:**
|
100 |
|
101 |
```bibtex
|
102 |
-
@misc{
|
103 |
author = "{Bohdan Didenko}",
|
104 |
-
title = "{Post \#
|
105 |
-
howpublished = "\url{https://t.me/zaduha/
|
106 |
month = june,
|
107 |
year = {2025},
|
108 |
note = "[Online; accessed 8 June 2025]"
|
|
|
42 |
|
43 |
<img src="ayayay.png" width="400px" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
44 |
|
45 |
+
#### Ayayay is the first tokenizer that makes Ukrainian the core language in a multilingual vocabulary — while retaining as much compatibility with the original Aya-Expanse tokenizer as possible through careful (partially manual) token remapping.
|
46 |
|
47 |
## Feature Overview:
|
48 |
|
|
|
99 |
**BibTeX:**
|
100 |
|
101 |
```bibtex
|
102 |
+
@misc{zaduha2025post9164,
|
103 |
author = "{Bohdan Didenko}",
|
104 |
+
title = "{Post \#9164 on Telegram Channel Zaduha}",
|
105 |
+
howpublished = "\url{https://t.me/zaduha/9164}",
|
106 |
month = june,
|
107 |
year = {2025},
|
108 |
note = "[Online; accessed 8 June 2025]"
|