Motif-Technologies
/

Motif-2.6B

Text Generation

text-generation-inference

Model card Files Files and versions

SungminLee commited on 23 days ago

Commit

31762c4

·

verified ·

1 Parent(s): 6cd2bd0

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -133,10 +133,10 @@ The benchmarks and corresponding scores listed in the table below are taken dire
 |IFEval|-|59.5|77.4|74.02|+24.40%|-4.37%|
 |GSM9K|8-shot, CoT|44.4|77.7|74.9|+68.69%|-3.60%|
 |MATH|0-shot, CoT|30.6|48|49.68|+62.35%|+3.50%|
-|ARC Challenge|0-shot|59.4|78.5|74.2|+24.92%|-5.48%|
 |GPQA|0-shot|27.2|32.8|25.45|-6.43%|-22.41%|
 |Hellaswag|0-shot|41.2|69.8|61.35|+48.91%|-12.11%|
-|||||**Average**|**+39.42%**|**-3.83%**|
 \*: We were unable to find an evaluation framework for this benchmark.

 |IFEval|-|59.5|77.4|74.02|+24.40%|-4.37%|
 |GSM9K|8-shot, CoT|44.4|77.7|74.9|+68.69%|-3.60%|
 |MATH|0-shot, CoT|30.6|48|49.68|+62.35%|+3.50%|
+|ARC Challenge|0-shot|59.4|78.6|74.2|+24.92%|-5.6%|
 |GPQA|0-shot|27.2|32.8|25.45|-6.43%|-22.41%|
 |Hellaswag|0-shot|41.2|69.8|61.35|+48.91%|-12.11%|
+|||||**Average**|**+39.42%**|**-3.86%**|
 \*: We were unable to find an evaluation framework for this benchmark.