Uploaded model
- Developed by: LeroyDyer
- License: apache-2.0
- Finetuned from model : LeroyDyer/_Spydaz_Web_AI_AGI_R1_MUSR_I
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 22.64 |
| IFEval (0-Shot) | 49.24 |
| BBH (3-Shot) | 24.69 |
| MATH Lvl 5 (4-Shot) | 5.44 |
| GPQA (0-shot) | 3.13 |
| MuSR (0-shot) | 32.37 |
| MMLU-PRO (5-shot) | 21.00 |
- Downloads last month
- 27
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for LeroyDyer/_Spydaz_Web_AI_AGI_R1_OmG_Coder
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard49.240
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard24.690
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard5.440
- acc_norm on GPQA (0-shot)Open LLM Leaderboard3.130
- acc_norm on MuSR (0-shot)Open LLM Leaderboard32.370
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard21.000