Hugging Face's logo

aloobun
/
d-SmolLM2-360M

Text Generation
Transformers
Safetensors
English
llama
smollm2
smollm2-360m
distillation
Eval Results
text-generation-inference
Model card Files
xet
Community
1
aloobun commited on
Commit
ee3ccc2
·
verified ·
1 Parent(s): 2a5343b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -21,15 +21,15 @@ Eval results using SmolLM evaluation scripts show distilled model slightly gaine
21
  | | | qem | 0.0961 | 0.1004 |
22
  | custom:arc:_average:0 | | acc_norm | 0.5303 | 0.5305 |
23
  | custom:arc:challenge:0| 0 | acc_norm | 0.3771 | 0.3797 |
24
- | custom:arc:easy:0 | 0 | acc_norm | **0.6835** | 0.6814 |
25
- | custom:commonsense_qa:0| 0 | acc_norm | **0.3784** | 0.3759 |
26
  | custom:gsm8k:5 | 0 | qem | 0.0326 | 0.0334 |
27
  | custom:hellaswag:0 | 0 | acc_norm | 0.5418 | 0.5456 |
28
  | custom:mmlu_pro:0 | 0 | acc_norm | 0.1127 | 0.1130 |
29
- | custom:openbook_qa:0 | 0 | acc_norm | **0.3760** | 0.3720 |
30
  | custom:piqa:0 | 0 | acc_norm | 0.7214 | 0.7220 |
31
  | custom:trivia_qa:0 | 0 | qem | 0.1596 | 0.1675 |
32
- | custom:winogrande:0 | 0 | acc_norm | **0.5312** | 0.5241 |
33
 
34
 
35
 
 
21
  | | | qem | 0.0961 | 0.1004 |
22
  | custom:arc:_average:0 | | acc_norm | 0.5303 | 0.5305 |
23
  | custom:arc:challenge:0| 0 | acc_norm | 0.3771 | 0.3797 |
24
+ | custom:arc:easy:0 | 0 | acc_norm | 0.6835 | 0.6814 |
25
+ | custom:commonsense_qa:0| 0 | acc_norm | 0.3784 | 0.3759 |
26
  | custom:gsm8k:5 | 0 | qem | 0.0326 | 0.0334 |
27
  | custom:hellaswag:0 | 0 | acc_norm | 0.5418 | 0.5456 |
28
  | custom:mmlu_pro:0 | 0 | acc_norm | 0.1127 | 0.1130 |
29
+ | custom:openbook_qa:0 | 0 | acc_norm | 0.3760 | 0.3720 |
30
  | custom:piqa:0 | 0 | acc_norm | 0.7214 | 0.7220 |
31
  | custom:trivia_qa:0 | 0 | qem | 0.1596 | 0.1675 |
32
+ | custom:winogrande:0 | 0 | acc_norm | 0.5312 | 0.5241 |
33
 
34
 
35