Update README.md
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ This model was trained with a WizardCoder base, which itself uses a StarCoder ba
|
|
| 20 |
|
| 21 |
The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
|
| 22 |
|
| 23 |
-
It comes in at 39% on HumanEval, with WizardCoder at 57%. This is
|
| 24 |
|
| 25 |
However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
|
| 26 |
|
|
|
|
| 20 |
|
| 21 |
The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
|
| 22 |
|
| 23 |
+
It comes in at 39% on HumanEval, with WizardCoder at 57%. This is a preliminary experiment, and we are exploring improvements now.
|
| 24 |
|
| 25 |
However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
|
| 26 |
|