Update README.md
Browse files
README.md
CHANGED
|
@@ -79,10 +79,18 @@ print(tokenizer.decode(outputs[0]))
|
|
| 79 |
|
| 80 |
## MT-Bench
|
| 81 |
|
| 82 |
-
| Model | Average | 1st turn | 2nd turn |
|
| 83 |
-
|
| 84 |
-
| google/gemma-1.1-7b-it | 4.63 | 5.18 | 4.08 |
|
| 85 |
-
| *
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
|
| 87 |
|
| 88 |
## RoGemma Model Family
|
|
|
|
| 79 |
|
| 80 |
## MT-Bench
|
| 81 |
|
| 82 |
+
| Model | Average | 1st turn | 2nd turn | Answers in Ro |
|
| 83 |
+
|--------------------|:--------:|:--------:|:--------:|:--------:|
|
| 84 |
+
| google/gemma-1.1-7b-it | 4.63 | 5.18 | 4.08 | **160 / 160**|
|
| 85 |
+
| *RoGemma-7b-Instruct*| ***4.83***|***5.56***| ***4.10*** |**160 / 160**|
|
| 86 |
+
|
| 87 |
+
## RoCulturaBench
|
| 88 |
+
|
| 89 |
+
| Model | Score | Answers in Ro|
|
| 90 |
+
|--------------------|:--------:|:--------:|
|
| 91 |
+
| google/gemma-1.1-7b-it | **3.22** | **100 / 100** |
|
| 92 |
+
| *RoLlama3-8b-Instruct*| *3.47*| ***100 / 100*** |
|
| 93 |
+
|
| 94 |
|
| 95 |
|
| 96 |
## RoGemma Model Family
|