JH-Motif commited on
Commit
b633c5c
·
verified ·
1 Parent(s): 58b7fb7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -174,7 +174,7 @@ The benchmarks and corresponding scores listed in the table below are taken dire
174
 
175
  ## Evaluation Appendix
176
 
177
- In the comparisons presented above, Motif 2.6B showed average performance improvements of -15.36% and -14.78% over Llama 3 8B and Gemma 2 9B, respectively, based on the benchmark scores reported in their original technical reports. However, when compared to the benchmarks and scores reported in the Qwen 2.5 technical report, Motif 2.6B shows an average improvement of +18.55% over Llama 3 8B and +2.63% over Gemma 2 9B. See the table below for details.
178
 
179
  ### Comparison to Llama 3 8B and Gemma 2 9B based on scores from the *Qwen2.5 technical report*
180
  The benchmarks and corresponding scores listed in the table below are taken directly from the [Qwen2.5 technical report](https://arxiv.org/abs/2412.15115).
 
174
 
175
  ## Evaluation Appendix
176
 
177
+ In the comparisons presented above, Motif 2.6B showed average performance improvements of -15.36% and -14.78% over Llama 3 8B and Gemma 2 9B, respectively, based on the benchmark scores reported in their original technical reports. However, when compared to the benchmarks and scores reported in the Qwen 2.5 technical report, Motif 2.6B shows an average improvement of +18.55% over Llama 3 8B and +1.12% over Gemma 2 9B. See the table below for details.
178
 
179
  ### Comparison to Llama 3 8B and Gemma 2 9B based on scores from the *Qwen2.5 technical report*
180
  The benchmarks and corresponding scores listed in the table below are taken directly from the [Qwen2.5 technical report](https://arxiv.org/abs/2412.15115).