OpenHermes-7B-Symbolic
Model description
OpenHermes-7B-Symbolic is a OpenHermes-2.5-Mistral-7B fine-tuned on 93K comprehensive and meticulously curated samples. Each sample was structured to facilitate the model's understanding and generation of complex, hierarchical ICD medical coding system.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 64.44 |
| AI2 Reasoning Challenge (25-Shot) | 63.14 |
| HellaSwag (10-Shot) | 82.73 |
| MMLU (5-Shot) | 62.62 |
| TruthfulQA (0-shot) | 48.82 |
| Winogrande (5-shot) | 75.85 |
| GSM8k (5-shot) | 53.45 |
- Downloads last month
- 1,034
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for hedronstone/OpenHermes-7B-Symbolic
Space using hedronstone/OpenHermes-7B-Symbolic 1
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard63.140
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard82.730
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard62.620
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard48.820
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard75.850
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard53.450