lbourdois commited on
Commit
0def720
·
verified ·
1 Parent(s): 3ce6cf1

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +114 -101
README.md CHANGED
@@ -1,101 +1,114 @@
1
- ---
2
- base_model:
3
- - Krystalan/DRT-o1-14B
4
- - huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated
5
- - djuna/Q2.5-Veltha-14B-0.5
6
- - Qwen/Qwen2.5-14B
7
- - netease-youdao/Confucius-o1-14B
8
- library_name: transformers
9
- tags:
10
- - mergekit
11
- - merge
12
-
13
- ---
14
- # merge
15
-
16
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
-
18
- ## Merge Details
19
- ### Merge Method
20
-
21
- This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) as a base.
22
-
23
- ### Models Merged
24
-
25
- The following models were included in the merge:
26
- * [Krystalan/DRT-o1-14B](https://huggingface.co/Krystalan/DRT-o1-14B)
27
- * [huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated)
28
- * [djuna/Q2.5-Veltha-14B-0.5](https://huggingface.co/djuna/Q2.5-Veltha-14B-0.5)
29
- * [netease-youdao/Confucius-o1-14B](https://huggingface.co/netease-youdao/Confucius-o1-14B)
30
-
31
- ### Configuration
32
-
33
- The following YAML configuration was used to produce this model:
34
-
35
- ```yaml
36
- models:
37
- - model: Qwen/Qwen2.5-14B
38
- - model: netease-youdao/Confucius-o1-14B
39
- - model: djuna/Q2.5-Veltha-14B-0.5
40
- - model: Krystalan/DRT-o1-14B
41
- - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated
42
- parameters:
43
- select_topk: 0.5
44
- merge_method: sce
45
- base_model: Qwen/Qwen2.5-14B
46
- tokenizer:
47
- source: "djuna/Q2.5-Veltha-14B-0.5"
48
- tokens:
49
- <|endoftext|>:
50
- source: "djuna/Q2.5-Veltha-14B-0.5"
51
- <|im_start|>:
52
- source: "djuna/Q2.5-Veltha-14B-0.5"
53
- <|im_end|>:
54
- source: "djuna/Q2.5-Veltha-14B-0.5"
55
- <|object_ref_start|>:
56
- source: "djuna/Q2.5-Veltha-14B-0.5"
57
- <|object_ref_end|>:
58
- source: "djuna/Q2.5-Veltha-14B-0.5"
59
- <|box_start|>:
60
- source: "djuna/Q2.5-Veltha-14B-0.5"
61
- <|box_end|>:
62
- source: "djuna/Q2.5-Veltha-14B-0.5"
63
- <|end▁of▁sentence|>:
64
- source:
65
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
66
- kind: "model_token"
67
- token: "<|end▁of▁sentence|>"
68
- <|User|>:
69
- source:
70
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
71
- kind: "model_token"
72
- token: "<|User|>"
73
- <|Assistant|>:
74
- source:
75
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
76
- kind: "model_token"
77
- token: "<|Assistant|>"
78
- <|begin▁of▁sentence|>:
79
- source:
80
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
81
- kind: "model_token"
82
- token: "<|begin▁of▁sentence|>"
83
- <|EOT|>:
84
- source:
85
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
86
- kind: "model_token"
87
- token: "<|EOT|>"
88
- <think>:
89
- source:
90
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
91
- kind: "model_token"
92
- token: "<think>"
93
- </think>:
94
- source:
95
- model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
96
- kind: "model_token"
97
- token: "</think>"
98
- dtype: float32
99
- out_dtype: bfloat16
100
-
101
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Krystalan/DRT-o1-14B
4
+ - huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated
5
+ - djuna/Q2.5-Veltha-14B-0.5
6
+ - Qwen/Qwen2.5-14B
7
+ - netease-youdao/Confucius-o1-14B
8
+ library_name: transformers
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+ language:
13
+ - zho
14
+ - eng
15
+ - fra
16
+ - spa
17
+ - por
18
+ - deu
19
+ - ita
20
+ - rus
21
+ - jpn
22
+ - kor
23
+ - vie
24
+ - tha
25
+ - ara
26
+ ---
27
+ # merge
28
+
29
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
30
+
31
+ ## Merge Details
32
+ ### Merge Method
33
+
34
+ This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) as a base.
35
+
36
+ ### Models Merged
37
+
38
+ The following models were included in the merge:
39
+ * [Krystalan/DRT-o1-14B](https://huggingface.co/Krystalan/DRT-o1-14B)
40
+ * [huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated)
41
+ * [djuna/Q2.5-Veltha-14B-0.5](https://huggingface.co/djuna/Q2.5-Veltha-14B-0.5)
42
+ * [netease-youdao/Confucius-o1-14B](https://huggingface.co/netease-youdao/Confucius-o1-14B)
43
+
44
+ ### Configuration
45
+
46
+ The following YAML configuration was used to produce this model:
47
+
48
+ ```yaml
49
+ models:
50
+ - model: Qwen/Qwen2.5-14B
51
+ - model: netease-youdao/Confucius-o1-14B
52
+ - model: djuna/Q2.5-Veltha-14B-0.5
53
+ - model: Krystalan/DRT-o1-14B
54
+ - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated
55
+ parameters:
56
+ select_topk: 0.5
57
+ merge_method: sce
58
+ base_model: Qwen/Qwen2.5-14B
59
+ tokenizer:
60
+ source: "djuna/Q2.5-Veltha-14B-0.5"
61
+ tokens:
62
+ <|endoftext|>:
63
+ source: "djuna/Q2.5-Veltha-14B-0.5"
64
+ <|im_start|>:
65
+ source: "djuna/Q2.5-Veltha-14B-0.5"
66
+ <|im_end|>:
67
+ source: "djuna/Q2.5-Veltha-14B-0.5"
68
+ <|object_ref_start|>:
69
+ source: "djuna/Q2.5-Veltha-14B-0.5"
70
+ <|object_ref_end|>:
71
+ source: "djuna/Q2.5-Veltha-14B-0.5"
72
+ <|box_start|>:
73
+ source: "djuna/Q2.5-Veltha-14B-0.5"
74
+ <|box_end|>:
75
+ source: "djuna/Q2.5-Veltha-14B-0.5"
76
+ <|end▁of▁sentence|>:
77
+ source:
78
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
79
+ kind: "model_token"
80
+ token: "<|end▁of▁sentence|>"
81
+ <|User|>:
82
+ source:
83
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
84
+ kind: "model_token"
85
+ token: "<|User|>"
86
+ <|Assistant|>:
87
+ source:
88
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
89
+ kind: "model_token"
90
+ token: "<|Assistant|>"
91
+ <|begin▁of▁sentence|>:
92
+ source:
93
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
94
+ kind: "model_token"
95
+ token: "<|begin▁of▁sentence|>"
96
+ <|EOT|>:
97
+ source:
98
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
99
+ kind: "model_token"
100
+ token: "<|EOT|>"
101
+ <think>:
102
+ source:
103
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
104
+ kind: "model_token"
105
+ token: "<think>"
106
+ </think>:
107
+ source:
108
+ model: "huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated"
109
+ kind: "model_token"
110
+ token: "</think>"
111
+ dtype: float32
112
+ out_dtype: bfloat16
113
+
114
+ ```