Update README.md
Browse files
README.md
CHANGED
@@ -174,7 +174,7 @@ The benchmarks and corresponding scores listed in the table below are taken dire
|
|
174 |
|
175 |
## Evaluation Appendix
|
176 |
|
177 |
-
In the comparisons presented above, Motif 2.6B showed average performance improvements of -15.36% and -14.78% over Llama 3 8B and Gemma 2 9B, respectively, based on the benchmark scores reported in their original technical reports. However, when compared to the benchmarks and scores reported in the Qwen 2.5 technical report, Motif 2.6B shows an average improvement of +18.55% over Llama 3 8B and +
|
178 |
|
179 |
### Comparison to Llama 3 8B and Gemma 2 9B based on scores from the *Qwen2.5 technical report*
|
180 |
The benchmarks and corresponding scores listed in the table below are taken directly from the [Qwen2.5 technical report](https://arxiv.org/abs/2412.15115).
|
|
|
174 |
|
175 |
## Evaluation Appendix
|
176 |
|
177 |
+
In the comparisons presented above, Motif 2.6B showed average performance improvements of -15.36% and -14.78% over Llama 3 8B and Gemma 2 9B, respectively, based on the benchmark scores reported in their original technical reports. However, when compared to the benchmarks and scores reported in the Qwen 2.5 technical report, Motif 2.6B shows an average improvement of +18.55% over Llama 3 8B and +1.12% over Gemma 2 9B. See the table below for details.
|
178 |
|
179 |
### Comparison to Llama 3 8B and Gemma 2 9B based on scores from the *Qwen2.5 technical report*
|
180 |
The benchmarks and corresponding scores listed in the table below are taken directly from the [Qwen2.5 technical report](https://arxiv.org/abs/2412.15115).
|