Update README.md
Browse files
README.md
CHANGED
@@ -1,21 +1,38 @@
|
|
1 |
---
|
2 |
-
license:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
# HelpingAI-3B
|
5 |
-
# Subscribe to my YouTube channel
|
6 |
-
[Subscribe](https://youtube.com/@OEvortex)
|
7 |
|
8 |
-
|
9 |
|
10 |
-
HelpingAI-
|
11 |
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
|
19 |
-
|Winogrande
|
20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
|
|
1 |
---
|
2 |
+
license: other
|
3 |
+
license_name: hsul
|
4 |
+
license_link: https://huggingface.co/OEvortex/vortex-3b/raw/main/LICENSE.md
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
pipeline_tag: text-generation
|
8 |
+
tags:
|
9 |
+
- 3B
|
10 |
---
|
11 |
# HelpingAI-3B
|
|
|
|
|
12 |
|
13 |
+
## Introduction
|
14 |
|
15 |
+
HelpingAI-3B is a state-of-the-art AI model designed to assist with day-to-day tasks. It's trained on a diverse range of datasets, making it versatile and adaptable to various applications.
|
16 |
|
17 |
+
## Model Overview
|
18 |
+
|
19 |
+
HelpingAI-3B is the latest model in the HelpingAI series. It's built on advanced machine learning algorithms and trained on a wide variety of data sources. This ensures that the model is capable of understanding and generating responses in a wide range of contexts.
|
20 |
+
## Performance Comparison
|
21 |
+
|
22 |
+
The performance of HelpingAI-3B is compared with other relevant models on various metrics in the table below:
|
23 |
+
|
24 |
+
| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|
25 |
+
|-|-|-|-|-|-|-|-|
|
26 |
+
| rocket-3B | 55.77 | 50.6 | 76.69 | 47.1 | 55.82 | 67.96 | 36.47 |
|
27 |
+
| **HelpingAI-3B** | **55.59** | **50.6** | **76.64** | **46.82** | **55.62** | **67.8** | **36.09** |
|
28 |
+
| stableLM-zephyr-3b | 53.43 | 46.08 | 74.16 | 46.17 | 46.49 | 65.51 | 42.15 |
|
29 |
+
| mmd-3b | 53.22 | 44.8 | 70.41 | 50.9 | 43.2 | 66.22 | 43.82 |
|
30 |
+
| MiniGPT-3B-Bacchus | 52.55 | 43.52 | 70.45 | 50.49 | 43.52 | 66.85 | 40.49 |
|
31 |
+
| MiniGPT-3B-Hercules-v2.0 | 52.52 | 43.26 | 71.11 | 51.82 | 40.37 | 66.46 | 42.08 |
|
32 |
+
| MiniGPT-3B-OpenHermes-2.5-v2 | 51.91 | 47.44 | 72 | 53.06 | 42.28 | 65.43 | 31.24 |
|
33 |
+
| MiniChat-2-3B | 51.49 | 44.88 | 67.69 | 47.59 | 49.64 | 66.46 | 32.68 |
|
34 |
+
| smol-3b | 50.27 | 46.33 | 68.23 | 46.33 | 50.73 | 65.35 | 24.64 |
|
35 |
+
| MiniChat-1.5-3B | 50.23 | 46.5 | 68.28 | 46.67 | 50.71 | 65.04 | 24.18 |
|
36 |
+
| 3BigReasonCinder | 48.16 | 41.72 | 65.16 | 44.79 | 44.76 | 64.96 | 27.6 |
|
37 |
+
| MintMerlin-3B | 47.63 | 44.37 | 66.56 | 43.21 | 47.07 | 64.4 | 20.17 |
|
38 |
|