ZeroXClem commited on
Commit
49c9efd
ยท
verified ยท
1 Parent(s): 3512e8f

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +112 -4
README.md CHANGED
@@ -1,18 +1,113 @@
1
  ---
 
 
2
  license: apache-2.0
 
3
  tags:
4
  - merge
5
  - mergekit
6
  - lazymergekit
7
- language:
8
- - en
9
  base_model:
10
  - invisietch/L3.1-EtherealRainbow-v1.0-rc1-8B
11
  - ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B
12
  - ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B
13
  - djuna/L3.1-Purosani-2-8B
14
  pipeline_tag: text-generation
15
- library_name: transformers
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ---
17
 
18
 
@@ -175,4 +270,17 @@ Your contributions fuel the progress of **next-gen AI models**! ๐Ÿš€๐Ÿ’œ
175
 
176
  If you encounter any issues, have suggestions, or wish to contribute, feel free to open a **discussion** or submit a **pull request**.
177
 
178
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
  license: apache-2.0
5
+ library_name: transformers
6
  tags:
7
  - merge
8
  - mergekit
9
  - lazymergekit
 
 
10
  base_model:
11
  - invisietch/L3.1-EtherealRainbow-v1.0-rc1-8B
12
  - ZeroXClem/L3SAO-Mix-SuperHermes-NovaPurosani-8B
13
  - ZeroXClem/Llama3.1-Hermes3-SuperNova-8B-L3.1-Purosani-2-8B
14
  - djuna/L3.1-Purosani-2-8B
15
  pipeline_tag: text-generation
16
+ model-index:
17
+ - name: Llama-3.1-8B-SuperNova-EtherealHermes
18
+ results:
19
+ - task:
20
+ type: text-generation
21
+ name: Text Generation
22
+ dataset:
23
+ name: IFEval (0-Shot)
24
+ type: HuggingFaceH4/ifeval
25
+ args:
26
+ num_few_shot: 0
27
+ metrics:
28
+ - type: inst_level_strict_acc and prompt_level_strict_acc
29
+ value: 73.39
30
+ name: strict accuracy
31
+ source:
32
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
33
+ name: Open LLM Leaderboard
34
+ - task:
35
+ type: text-generation
36
+ name: Text Generation
37
+ dataset:
38
+ name: BBH (3-Shot)
39
+ type: BBH
40
+ args:
41
+ num_few_shot: 3
42
+ metrics:
43
+ - type: acc_norm
44
+ value: 32.07
45
+ name: normalized accuracy
46
+ source:
47
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
48
+ name: Open LLM Leaderboard
49
+ - task:
50
+ type: text-generation
51
+ name: Text Generation
52
+ dataset:
53
+ name: MATH Lvl 5 (4-Shot)
54
+ type: hendrycks/competition_math
55
+ args:
56
+ num_few_shot: 4
57
+ metrics:
58
+ - type: exact_match
59
+ value: 17.45
60
+ name: exact match
61
+ source:
62
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
63
+ name: Open LLM Leaderboard
64
+ - task:
65
+ type: text-generation
66
+ name: Text Generation
67
+ dataset:
68
+ name: GPQA (0-shot)
69
+ type: Idavidrein/gpqa
70
+ args:
71
+ num_few_shot: 0
72
+ metrics:
73
+ - type: acc_norm
74
+ value: 5.7
75
+ name: acc_norm
76
+ source:
77
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
78
+ name: Open LLM Leaderboard
79
+ - task:
80
+ type: text-generation
81
+ name: Text Generation
82
+ dataset:
83
+ name: MuSR (0-shot)
84
+ type: TAUR-Lab/MuSR
85
+ args:
86
+ num_few_shot: 0
87
+ metrics:
88
+ - type: acc_norm
89
+ value: 11.32
90
+ name: acc_norm
91
+ source:
92
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
93
+ name: Open LLM Leaderboard
94
+ - task:
95
+ type: text-generation
96
+ name: Text Generation
97
+ dataset:
98
+ name: MMLU-PRO (5-shot)
99
+ type: TIGER-Lab/MMLU-Pro
100
+ config: main
101
+ split: test
102
+ args:
103
+ num_few_shot: 5
104
+ metrics:
105
+ - type: acc
106
+ value: 30.5
107
+ name: accuracy
108
+ source:
109
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=ZeroXClem/Llama-3.1-8B-SuperNova-EtherealHermes
110
+ name: Open LLM Leaderboard
111
  ---
112
 
113
 
 
270
 
271
  If you encounter any issues, have suggestions, or wish to contribute, feel free to open a **discussion** or submit a **pull request**.
272
 
273
+ ---
274
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
275
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/ZeroXClem__Llama-3.1-8B-SuperNova-EtherealHermes-details)
276
+
277
+ | Metric |Value|
278
+ |-------------------|----:|
279
+ |Avg. |28.41|
280
+ |IFEval (0-Shot) |73.39|
281
+ |BBH (3-Shot) |32.07|
282
+ |MATH Lvl 5 (4-Shot)|17.45|
283
+ |GPQA (0-shot) | 5.70|
284
+ |MuSR (0-shot) |11.32|
285
+ |MMLU-PRO (5-shot) |30.50|
286
+