Update README.md
Browse files
README.md
CHANGED
@@ -7,22 +7,23 @@ pipeline_tag: text-generation
|
|
7 |
|
8 |
**Llama3.2-Typhoon2-3B-instruct** is a instruct Thai 🇹🇭 large language model with 3 billion parameters, and it is based on Llama3.2-3B.
|
9 |
|
10 |
-
Here’s the table with the **highest value in each column highlighted** in **bold**:
|
11 |
|
12 |
-
| Model | IFEval - TH | IFEval - EN | MT-Bench TH | MT-Bench EN | Thai Code-Switching (t=0.7) | Thai Code-Switching (t=1.0) | FunctionCall-TH | FunctionCall-EN |
|
13 |
-
|----------------------------------------|-------------|-------------|-------------|-------------|-----------------------------|-----------------------------|----------------|----------------|
|
14 |
-
| **Typhoon2 Llama3.2 3B Instruct** | **68.36%** | 72.18% | **5.3352** | 7.206 | **99.2%** | **96%** | **71.36%** | **75.90%** |
|
15 |
-
| **Qwen2.5 3B Instruct** | 58.86% | 67.25% | 4.6263 | **7.846** | 78.6% | 38% | 53.78% | 62.55% |
|
16 |
-
| **Llama3.2 3B Instruct** | 44.84% | **71.98%** | 4.3241 | 7.725 | 93.8% | 21.2% | 35.43% | 53.87% |
|
17 |
|
|
|
18 |
|
19 |
-
|
20 |
-
- The highest value in each column is highlighted in **bold**.
|
21 |
|
22 |
-
|
|
|
|
|
23 |
|
|
|
24 |
|
25 |
-
|
|
|
|
|
|
|
|
|
26 |
|
27 |
|
28 |
For release post, please see our [blog](...).
|
|
|
7 |
|
8 |
**Llama3.2-Typhoon2-3B-instruct** is a instruct Thai 🇹🇭 large language model with 3 billion parameters, and it is based on Llama3.2-3B.
|
9 |
|
|
|
10 |
|
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
+
## Performance
|
13 |
|
14 |
+
**Instruction-Following & Function Call Performance**
|
|
|
15 |
|
16 |
+
<div align="center">
|
17 |
+
<img src="https://storage.googleapis.com/typhoon-public/assets/typhoon2-text/llama3b_general.png" alt="Typhoon General Performance" width="100%" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
|
18 |
+
</div>
|
19 |
|
20 |
+
**Detail Performance**
|
21 |
|
22 |
+
| Model | IFEval - TH | IFEval - EN | MT-Bench TH | MT-Bench EN | Thai Code-Switching (t=0.7) | Thai Code-Switching (t=1.0) | FunctionCall-TH | FunctionCall-EN |
|
23 |
+
|----------------------------------------|-------------|-------------|-------------|-------------|-----------------------------|-----------------------------|----------------|----------------|
|
24 |
+
| **Typhoon2 Llama3.2 3B Instruct** | **68.36%** | 72.18% | **5.3352** | 7.206 | **99.2%** | **96%** | **71.36%** | **75.90%** |
|
25 |
+
| **Qwen2.5 3B Instruct** | 58.86% | 67.25% | 4.6263 | **7.846** | 78.6% | 38% | 53.78% | 62.55% |
|
26 |
+
| **Llama3.2 3B Instruct** | 44.84% | **71.98%** | 4.3241 | 7.725 | 93.8% | 21.2% | 35.43% | 53.87% |
|
27 |
|
28 |
|
29 |
For release post, please see our [blog](...).
|