lbourdois commited on
Commit
d210f2f
·
verified ·
1 Parent(s): dfd25d5

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +187 -182
README.md CHANGED
@@ -1,182 +1,187 @@
1
- ---
2
- language:
3
- - zh
4
- - en
5
- - fr
6
- - de
7
- - ja
8
- - ko
9
- - it
10
- - fi
11
- license: apache-2.0
12
- tags:
13
- - llamaify
14
- - qwen2.5
15
- pipeline_tag: text-generation
16
- model-index:
17
- - name: openbuddy-qwen2.5llamaify-7b-v23.1-200k
18
- results:
19
- - task:
20
- type: text-generation
21
- name: Text Generation
22
- dataset:
23
- name: IFEval (0-Shot)
24
- type: HuggingFaceH4/ifeval
25
- args:
26
- num_few_shot: 0
27
- metrics:
28
- - type: inst_level_strict_acc and prompt_level_strict_acc
29
- value: 56.73
30
- name: strict accuracy
31
- source:
32
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
33
- name: Open LLM Leaderboard
34
- - task:
35
- type: text-generation
36
- name: Text Generation
37
- dataset:
38
- name: BBH (3-Shot)
39
- type: BBH
40
- args:
41
- num_few_shot: 3
42
- metrics:
43
- - type: acc_norm
44
- value: 36.4
45
- name: normalized accuracy
46
- source:
47
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
48
- name: Open LLM Leaderboard
49
- - task:
50
- type: text-generation
51
- name: Text Generation
52
- dataset:
53
- name: MATH Lvl 5 (4-Shot)
54
- type: hendrycks/competition_math
55
- args:
56
- num_few_shot: 4
57
- metrics:
58
- - type: exact_match
59
- value: 11.4
60
- name: exact match
61
- source:
62
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
63
- name: Open LLM Leaderboard
64
- - task:
65
- type: text-generation
66
- name: Text Generation
67
- dataset:
68
- name: GPQA (0-shot)
69
- type: Idavidrein/gpqa
70
- args:
71
- num_few_shot: 0
72
- metrics:
73
- - type: acc_norm
74
- value: 8.61
75
- name: acc_norm
76
- source:
77
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
78
- name: Open LLM Leaderboard
79
- - task:
80
- type: text-generation
81
- name: Text Generation
82
- dataset:
83
- name: MuSR (0-shot)
84
- type: TAUR-Lab/MuSR
85
- args:
86
- num_few_shot: 0
87
- metrics:
88
- - type: acc_norm
89
- value: 13.81
90
- name: acc_norm
91
- source:
92
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
93
- name: Open LLM Leaderboard
94
- - task:
95
- type: text-generation
96
- name: Text Generation
97
- dataset:
98
- name: MMLU-PRO (5-shot)
99
- type: TIGER-Lab/MMLU-Pro
100
- config: main
101
- split: test
102
- args:
103
- num_few_shot: 5
104
- metrics:
105
- - type: acc
106
- value: 32.75
107
- name: accuracy
108
- source:
109
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
110
- name: Open LLM Leaderboard
111
- base_model: Qwen/Qwen2.5-7B-Instruct
112
- ---
113
-
114
-
115
- # OpenBuddy - Open Multilingual Chatbot
116
-
117
-
118
- GitHub and Usage Guide: [https://github.com/OpenBuddy/OpenBuddy](https://github.com/OpenBuddy/OpenBuddy)
119
-
120
- Website and Demo: [https://openbuddy.ai](https://openbuddy.ai)
121
-
122
- Evaluation result of this model: [Evaluation.txt](Evaluation.txt)
123
-
124
- ![Demo](https://raw.githubusercontent.com/OpenBuddy/OpenBuddy/main/media/demo.png)
125
-
126
-
127
-
128
- # Copyright Notice
129
-
130
- Base Model: Qwen2.5-7B-Chat
131
-
132
- License: Apache 2.0
133
-
134
- # Prompt Format
135
-
136
- We recommend using the fast tokenizer from `transformers`, which should be enabled by default in the `transformers` and `vllm` libraries. Other implementations including `sentencepiece` may not work as expected, especially for special tokens like `<|role|>`, `<|says|>` and `<|end|>`.
137
-
138
- ```
139
- <|role|>system<|says|>You(assistant) are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human(user).
140
- Always answer as helpfully and logically as possible, while being safe. Your answers should not include any harmful, political, religious, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.
141
- You cannot access the internet, but you have vast knowledge, cutoff: 2023-04.
142
- You are trained by OpenBuddy team, (https://openbuddy.ai, https://github.com/OpenBuddy/OpenBuddy), not related to GPT or OpenAI.<|end|>
143
- <|role|>user<|says|>History input 1<|end|>
144
- <|role|>assistant<|says|>History output 1<|end|>
145
- <|role|>user<|says|>History input 2<|end|>
146
- <|role|>assistant<|says|>History output 2<|end|>
147
- <|role|>user<|says|>Current input<|end|>
148
- <|role|>assistant<|says|>
149
- ```
150
-
151
-
152
- This format is also defined in `tokenizer_config.json`, which means you can directly use `vllm` to deploy an OpenAI-like API service. For more information, please refer to the [vllm documentation](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html).
153
-
154
- ## Disclaimer
155
-
156
- All OpenBuddy models have inherent limitations and may potentially produce outputs that are erroneous, harmful, offensive, or otherwise undesirable. Users should not use these models in critical or high-stakes situations that may lead to personal injury, property damage, or significant losses. Examples of such scenarios include, but are not limited to, the medical field, controlling software and hardware systems that may cause harm, and making important financial or legal decisions.
157
-
158
- OpenBuddy is provided "as-is" without any warranty of any kind, either express or implied, including, but not limited to, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement. In no event shall the authors, contributors, or copyright holders be liable for any claim, damages, or other liabilities, whether in an action of contract, tort, or otherwise, arising from, out of, or in connection with the software or the use or other dealings in the software.
159
-
160
- By using OpenBuddy, you agree to these terms and conditions, and acknowledge that you understand the potential risks associated with its use. You also agree to indemnify and hold harmless the authors, contributors, and copyright holders from any claims, damages, or liabilities arising from your use of OpenBuddy.
161
-
162
-
163
- ## 免责声明
164
-
165
- 所有OpenBuddy模型均存在固有的局限性,可能产生错误的、有害的、冒犯性的或其他不良的输出。用户在关键或高风险场景中应谨慎行事,不要使用这些模型,以免导致人身伤害、财产损失或重大损失。此类场景的例子包括但不限于医疗领域、可能导致伤害的软硬件系统的控制以及进行重要的财务或法律决策。
166
-
167
- OpenBuddy按“原样”提供,不附带任何种类的明示或暗示的保证,包括但不限于适销性、特定目的的适用性和非侵权的暗示保证。在任何情况下,作者、贡献者或版权所有者均不对因软件或使用或其他软件交易而产生的任何索赔、损害赔偿或其他责任(无论是合同、侵权还是其他原因)承担责任。
168
-
169
- 使用OpenBuddy即表示您同意这些条款和条件,并承认您了解其使用可能带来的潜在风险。您还同意赔偿并使作者、贡献者和版权所有者免受因您使用OpenBuddy而产生的任何索赔、损害赔偿或责任的影响。
170
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
171
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_OpenBuddy__openbuddy-qwen2.5llamaify-7b-v23.1-200k)
172
-
173
- | Metric |Value|
174
- |-------------------|----:|
175
- |Avg. |26.62|
176
- |IFEval (0-Shot) |56.73|
177
- |BBH (3-Shot) |36.40|
178
- |MATH Lvl 5 (4-Shot)|11.40|
179
- |GPQA (0-shot) | 8.61|
180
- |MuSR (0-shot) |13.81|
181
- |MMLU-PRO (5-shot) |32.75|
182
-
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - zho
4
+ - eng
5
+ - fra
6
+ - spa
7
+ - por
8
+ - deu
9
+ - ita
10
+ - rus
11
+ - jpn
12
+ - kor
13
+ - vie
14
+ - tha
15
+ - ara
16
+ license: apache-2.0
17
+ tags:
18
+ - llamaify
19
+ - qwen2.5
20
+ pipeline_tag: text-generation
21
+ base_model: Qwen/Qwen2.5-7B-Instruct
22
+ model-index:
23
+ - name: openbuddy-qwen2.5llamaify-7b-v23.1-200k
24
+ results:
25
+ - task:
26
+ type: text-generation
27
+ name: Text Generation
28
+ dataset:
29
+ name: IFEval (0-Shot)
30
+ type: HuggingFaceH4/ifeval
31
+ args:
32
+ num_few_shot: 0
33
+ metrics:
34
+ - type: inst_level_strict_acc and prompt_level_strict_acc
35
+ value: 56.73
36
+ name: strict accuracy
37
+ source:
38
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
39
+ name: Open LLM Leaderboard
40
+ - task:
41
+ type: text-generation
42
+ name: Text Generation
43
+ dataset:
44
+ name: BBH (3-Shot)
45
+ type: BBH
46
+ args:
47
+ num_few_shot: 3
48
+ metrics:
49
+ - type: acc_norm
50
+ value: 36.4
51
+ name: normalized accuracy
52
+ source:
53
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
54
+ name: Open LLM Leaderboard
55
+ - task:
56
+ type: text-generation
57
+ name: Text Generation
58
+ dataset:
59
+ name: MATH Lvl 5 (4-Shot)
60
+ type: hendrycks/competition_math
61
+ args:
62
+ num_few_shot: 4
63
+ metrics:
64
+ - type: exact_match
65
+ value: 11.4
66
+ name: exact match
67
+ source:
68
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
69
+ name: Open LLM Leaderboard
70
+ - task:
71
+ type: text-generation
72
+ name: Text Generation
73
+ dataset:
74
+ name: GPQA (0-shot)
75
+ type: Idavidrein/gpqa
76
+ args:
77
+ num_few_shot: 0
78
+ metrics:
79
+ - type: acc_norm
80
+ value: 8.61
81
+ name: acc_norm
82
+ source:
83
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
84
+ name: Open LLM Leaderboard
85
+ - task:
86
+ type: text-generation
87
+ name: Text Generation
88
+ dataset:
89
+ name: MuSR (0-shot)
90
+ type: TAUR-Lab/MuSR
91
+ args:
92
+ num_few_shot: 0
93
+ metrics:
94
+ - type: acc_norm
95
+ value: 13.81
96
+ name: acc_norm
97
+ source:
98
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
99
+ name: Open LLM Leaderboard
100
+ - task:
101
+ type: text-generation
102
+ name: Text Generation
103
+ dataset:
104
+ name: MMLU-PRO (5-shot)
105
+ type: TIGER-Lab/MMLU-Pro
106
+ config: main
107
+ split: test
108
+ args:
109
+ num_few_shot: 5
110
+ metrics:
111
+ - type: acc
112
+ value: 32.75
113
+ name: accuracy
114
+ source:
115
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
116
+ name: Open LLM Leaderboard
117
+ ---
118
+
119
+
120
+ # OpenBuddy - Open Multilingual Chatbot
121
+
122
+
123
+ GitHub and Usage Guide: [https://github.com/OpenBuddy/OpenBuddy](https://github.com/OpenBuddy/OpenBuddy)
124
+
125
+ Website and Demo: [https://openbuddy.ai](https://openbuddy.ai)
126
+
127
+ Evaluation result of this model: [Evaluation.txt](Evaluation.txt)
128
+
129
+ ![Demo](https://raw.githubusercontent.com/OpenBuddy/OpenBuddy/main/media/demo.png)
130
+
131
+
132
+
133
+ # Copyright Notice
134
+
135
+ Base Model: Qwen2.5-7B-Chat
136
+
137
+ License: Apache 2.0
138
+
139
+ # Prompt Format
140
+
141
+ We recommend using the fast tokenizer from `transformers`, which should be enabled by default in the `transformers` and `vllm` libraries. Other implementations including `sentencepiece` may not work as expected, especially for special tokens like `<|role|>`, `<|says|>` and `<|end|>`.
142
+
143
+ ```
144
+ <|role|>system<|says|>You(assistant) are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human(user).
145
+ Always answer as helpfully and logically as possible, while being safe. Your answers should not include any harmful, political, religious, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.
146
+ You cannot access the internet, but you have vast knowledge, cutoff: 2023-04.
147
+ You are trained by OpenBuddy team, (https://openbuddy.ai, https://github.com/OpenBuddy/OpenBuddy), not related to GPT or OpenAI.<|end|>
148
+ <|role|>user<|says|>History input 1<|end|>
149
+ <|role|>assistant<|says|>History output 1<|end|>
150
+ <|role|>user<|says|>History input 2<|end|>
151
+ <|role|>assistant<|says|>History output 2<|end|>
152
+ <|role|>user<|says|>Current input<|end|>
153
+ <|role|>assistant<|says|>
154
+ ```
155
+
156
+
157
+ This format is also defined in `tokenizer_config.json`, which means you can directly use `vllm` to deploy an OpenAI-like API service. For more information, please refer to the [vllm documentation](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html).
158
+
159
+ ## Disclaimer
160
+
161
+ All OpenBuddy models have inherent limitations and may potentially produce outputs that are erroneous, harmful, offensive, or otherwise undesirable. Users should not use these models in critical or high-stakes situations that may lead to personal injury, property damage, or significant losses. Examples of such scenarios include, but are not limited to, the medical field, controlling software and hardware systems that may cause harm, and making important financial or legal decisions.
162
+
163
+ OpenBuddy is provided "as-is" without any warranty of any kind, either express or implied, including, but not limited to, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement. In no event shall the authors, contributors, or copyright holders be liable for any claim, damages, or other liabilities, whether in an action of contract, tort, or otherwise, arising from, out of, or in connection with the software or the use or other dealings in the software.
164
+
165
+ By using OpenBuddy, you agree to these terms and conditions, and acknowledge that you understand the potential risks associated with its use. You also agree to indemnify and hold harmless the authors, contributors, and copyright holders from any claims, damages, or liabilities arising from your use of OpenBuddy.
166
+
167
+
168
+ ## 免责声明
169
+
170
+ 所有OpenBuddy模型均存在固有的局限性,可能产生错误的、有害的、冒犯性的或其他不良的输出。用户在关键或高风险场景中应谨慎行事,不要使用这些模型,以免导致人身伤害、财产损失或重大损失。此类场景的例子包括但不限于医疗领域、可能导致伤害的软硬件系统的控制以及进行重要的财务或法律决策。
171
+
172
+ OpenBuddy按“原样”提供,不附带任何种类的明示或暗示的保证,包括但不限于适销性、特定目的的适用性和非侵权的暗示保证。在任何情况下,作者、贡献者或版权所有者均不对因软件或使用或其他软件交易而产生的任何索赔、损害赔偿或其他责任(无论是合同、侵权还是其他原因)承担责任。
173
+
174
+ 使用OpenBuddy即表示您同意这些条款和条件,并承认您了解其使用可能带来的潜在风险。您还同意赔偿并使作者、贡献者和版权所有者免受因您使用OpenBuddy而产生的任何索赔、损害赔偿或责任的影响。
175
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
176
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_OpenBuddy__openbuddy-qwen2.5llamaify-7b-v23.1-200k)
177
+
178
+ | Metric |Value|
179
+ |-------------------|----:|
180
+ |Avg. |26.62|
181
+ |IFEval (0-Shot) |56.73|
182
+ |BBH (3-Shot) |36.40|
183
+ |MATH Lvl 5 (4-Shot)|11.40|
184
+ |GPQA (0-shot) | 8.61|
185
+ |MuSR (0-shot) |13.81|
186
+ |MMLU-PRO (5-shot) |32.75|
187
+