Update README.md
Browse files
README.md
CHANGED
@@ -149,7 +149,7 @@ We report in the following table our internal pipeline benchmarks:
|
|
149 |
| -------- | ------- | ------- | ------- | ------ | ----- | ----- | ----- | ------ | ---- |
|
150 |
| Falcon-3-3B-Base | 3B | 6.46GB | 15.74 | 11.78 | 21.58 | 6.27 | 18.09 | 6.26 | 15.74 |
|
151 |
| Qwen2.5-3B | 3B | 6.17GB | 26.9 | 14.8 | 24.3 | 11.76 | 24.48 | 6.38 | 18.1 |
|
152 |
-
| Falcon-E-3B-Base | 3B | **
|
153 |
|
154 |
</details>
|
155 |
|
@@ -178,7 +178,7 @@ Below are the results for instruction fine-tuned models:
|
|
178 |
| -------- | ------- | ------- | ------- | ------ | ----- | ----- | ----- | ------ | ---- |
|
179 |
| Falcon-3-3B-Instruct | 3B | 6.46GB | 69.77 | 25 | 26.29 | 11.13 | 22.28 | 5.15 | 26.6 |
|
180 |
| Qwen2.5-3B-Instruct | 3B | 6.17GB | 64.75 | 36.78 | 25.8 | 7.57 | 25.05 | 3.02 | 27.16 |
|
181 |
-
| Falcon-E-3B-Instruct | 3B | **
|
182 |
|
183 |
</details>
|
184 |
|
|
|
149 |
| -------- | ------- | ------- | ------- | ------ | ----- | ----- | ----- | ------ | ---- |
|
150 |
| Falcon-3-3B-Base | 3B | 6.46GB | 15.74 | 11.78 | 21.58 | 6.27 | 18.09 | 6.26 | 15.74 |
|
151 |
| Qwen2.5-3B | 3B | 6.17GB | 26.9 | 14.8 | 24.3 | 11.76 | 24.48 | 6.38 | 18.1 |
|
152 |
+
| Falcon-E-3B-Base | 3B | **999MB** | 36.67 | 13.45 | 8.67 | 4.14 | 19.83 | 27.16 | 18.32 |
|
153 |
|
154 |
</details>
|
155 |
|
|
|
178 |
| -------- | ------- | ------- | ------- | ------ | ----- | ----- | ----- | ------ | ---- |
|
179 |
| Falcon-3-3B-Instruct | 3B | 6.46GB | 69.77 | 25 | 26.29 | 11.13 | 22.28 | 5.15 | 26.6 |
|
180 |
| Qwen2.5-3B-Instruct | 3B | 6.17GB | 64.75 | 36.78 | 25.8 | 7.57 | 25.05 | 3.02 | 27.16 |
|
181 |
+
| Falcon-E-3B-Instruct | 3B | **999MB** | 60.97 | 15.3 | 23.59 | 2.12 | 26.45 | 7.45 | 22.64666667 |
|
182 |
|
183 |
</details>
|
184 |
|