Hugging Face's logo

appvoid
/
palmer-004-turbo

Text Generation
Transformers
Safetensors
GGUF
English
llama
text-generation-inference
unsloth
trl
sft
Model card Files Community
2
appvoid commited on
Commit
52d788b
·
verified ·
1 Parent(s): 891b7ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -40,11 +40,12 @@ These are zero-shot evaluations performed on current state-of-the-art language m
40
 
41
  | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
42
  |--------------------------------|-------|-------|-----------|--------|------------|---------|
43
- | smollm-360m | 0.2537| 0.3626| 0.5350 | 0.7116 | 0.5659 | 0.4858 |
44
  | tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
45
- | danube3-500m-chat (current sota)| 0.2554 | **0.3626** | 0.6072 | 0.7432 | 0.6140 | 0.5164 |
46
- | palmer-004-turbo |**0.2736**|0.3558|**0.6179**|0.7367|0.6117|**0.5191**|
47
- | palmer-004 | 0.2661 |0.3490 | 0.6173 | **0.7481** | **0.6417** |**0.5244**|
 
48
 
49
 
50
  #### thanks to
 
40
 
41
  | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
42
  |--------------------------------|-------|-------|-----------|--------|------------|---------|
43
+ | smollm-360m | 0.2537|**0.3626**| 0.5350 | 0.7116 | 0.5659 | 0.4858 |
44
  | tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
45
+ | qwen2-0.5b |**0.4413**| 0.2892| 0.4905 | 0.6931 | 0.5699 | 0.4968 |
46
+ | danube3-500m-chat (current sota)| 0.2554|**0.3626**|0.6072 | 0.7432 | 0.6140 | 0.5164 |
47
+ | palmer-004-turbo |0.2736|0.3558|**0.6179**|0.7367 | 0.6117 |**0.5191**|
48
+ | palmer-004 | 0.2661| 0.3490| 0.6173 |**0.7481**|**0.6417** |**0.5244**|
49
 
50
 
51
  #### thanks to