Abhaykoul commited on
Commit
e922dda
·
verified ·
1 Parent(s): 434ee25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -14
README.md CHANGED
@@ -1,21 +1,38 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
3
  ---
4
  # HelpingAI-3B
5
- # Subscribe to my YouTube channel
6
- [Subscribe](https://youtube.com/@OEvortex)
7
 
8
- GGUF version Comming soon
9
 
10
- HelpingAI-3b is a new HelpingAI model that can assist with day todays tasks. It's trained on a diverse range of datasets
11
 
12
- | Metric |Value|
13
- |---------------------------------|----:|
14
- |Avg. |55.59|
15
- |AI2 Reasoning Challenge (25-Shot)|50.60|
16
- |HellaSwag (10-Shot) |76.64|
17
- |MMLU (5-Shot) |46.82|
18
- |TruthfulQA (0-shot) |55.62|
19
- |Winogrande (5-shot) |67.80|
20
- |GSM8k (5-shot) |36.09|
 
 
 
 
 
 
 
 
 
 
 
 
21
 
 
1
  ---
2
+ license: other
3
+ license_name: hsul
4
+ license_link: https://huggingface.co/OEvortex/vortex-3b/raw/main/LICENSE.md
5
+ language:
6
+ - en
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - 3B
10
  ---
11
  # HelpingAI-3B
 
 
12
 
13
+ ## Introduction
14
 
15
+ HelpingAI-3B is a state-of-the-art AI model designed to assist with day-to-day tasks. It's trained on a diverse range of datasets, making it versatile and adaptable to various applications.
16
 
17
+ ## Model Overview
18
+
19
+ HelpingAI-3B is the latest model in the HelpingAI series. It's built on advanced machine learning algorithms and trained on a wide variety of data sources. This ensures that the model is capable of understanding and generating responses in a wide range of contexts.
20
+ ## Performance Comparison
21
+
22
+ The performance of HelpingAI-3B is compared with other relevant models on various metrics in the table below:
23
+
24
+ | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
25
+ |-|-|-|-|-|-|-|-|
26
+ | rocket-3B | 55.77 | 50.6 | 76.69 | 47.1 | 55.82 | 67.96 | 36.47 |
27
+ | **HelpingAI-3B** | **55.59** | **50.6** | **76.64** | **46.82** | **55.62** | **67.8** | **36.09** |
28
+ | stableLM-zephyr-3b | 53.43 | 46.08 | 74.16 | 46.17 | 46.49 | 65.51 | 42.15 |
29
+ | mmd-3b | 53.22 | 44.8 | 70.41 | 50.9 | 43.2 | 66.22 | 43.82 |
30
+ | MiniGPT-3B-Bacchus | 52.55 | 43.52 | 70.45 | 50.49 | 43.52 | 66.85 | 40.49 |
31
+ | MiniGPT-3B-Hercules-v2.0 | 52.52 | 43.26 | 71.11 | 51.82 | 40.37 | 66.46 | 42.08 |
32
+ | MiniGPT-3B-OpenHermes-2.5-v2 | 51.91 | 47.44 | 72 | 53.06 | 42.28 | 65.43 | 31.24 |
33
+ | MiniChat-2-3B | 51.49 | 44.88 | 67.69 | 47.59 | 49.64 | 66.46 | 32.68 |
34
+ | smol-3b | 50.27 | 46.33 | 68.23 | 46.33 | 50.73 | 65.35 | 24.64 |
35
+ | MiniChat-1.5-3B | 50.23 | 46.5 | 68.28 | 46.67 | 50.71 | 65.04 | 24.18 |
36
+ | 3BigReasonCinder | 48.16 | 41.72 | 65.16 | 44.79 | 44.76 | 64.96 | 27.6 |
37
+ | MintMerlin-3B | 47.63 | 44.37 | 66.56 | 43.21 | 47.07 | 64.4 | 20.17 |
38