phatvo commited on
Commit
fb69595
·
verified ·
1 Parent(s): c6243ab

Upload TextGenerationPipeline

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +1 -0
  2. README.md +199 -0
  3. added_tokens.json +28 -0
  4. chat_template.jinja +131 -0
  5. config.json +134 -0
  6. generation_config.json +13 -0
  7. merges.txt +0 -0
  8. model-00001-of-00051.safetensors +3 -0
  9. model-00002-of-00051.safetensors +3 -0
  10. model-00003-of-00051.safetensors +3 -0
  11. model-00004-of-00051.safetensors +3 -0
  12. model-00005-of-00051.safetensors +3 -0
  13. model-00006-of-00051.safetensors +3 -0
  14. model-00007-of-00051.safetensors +3 -0
  15. model-00008-of-00051.safetensors +3 -0
  16. model-00009-of-00051.safetensors +3 -0
  17. model-00010-of-00051.safetensors +3 -0
  18. model-00011-of-00051.safetensors +3 -0
  19. model-00012-of-00051.safetensors +3 -0
  20. model-00013-of-00051.safetensors +3 -0
  21. model-00014-of-00051.safetensors +3 -0
  22. model-00015-of-00051.safetensors +3 -0
  23. model-00016-of-00051.safetensors +3 -0
  24. model-00017-of-00051.safetensors +3 -0
  25. model-00018-of-00051.safetensors +3 -0
  26. model-00019-of-00051.safetensors +3 -0
  27. model-00020-of-00051.safetensors +3 -0
  28. model-00021-of-00051.safetensors +3 -0
  29. model-00022-of-00051.safetensors +3 -0
  30. model-00023-of-00051.safetensors +3 -0
  31. model-00024-of-00051.safetensors +3 -0
  32. model-00025-of-00051.safetensors +3 -0
  33. model-00026-of-00051.safetensors +3 -0
  34. model-00027-of-00051.safetensors +3 -0
  35. model-00028-of-00051.safetensors +3 -0
  36. model-00029-of-00051.safetensors +3 -0
  37. model-00030-of-00051.safetensors +3 -0
  38. model-00031-of-00051.safetensors +3 -0
  39. model-00032-of-00051.safetensors +3 -0
  40. model-00033-of-00051.safetensors +3 -0
  41. model-00034-of-00051.safetensors +3 -0
  42. model-00035-of-00051.safetensors +3 -0
  43. model-00036-of-00051.safetensors +3 -0
  44. model-00037-of-00051.safetensors +3 -0
  45. model-00038-of-00051.safetensors +3 -0
  46. model-00039-of-00051.safetensors +3 -0
  47. model-00040-of-00051.safetensors +3 -0
  48. model-00041-of-00051.safetensors +3 -0
  49. model-00042-of-00051.safetensors +3 -0
  50. model-00043-of-00051.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags: []
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {% macro render_item_list(item_list, tag_name='required') %}
2
+ {%- if item_list is defined and item_list is iterable and item_list | length > 0 %}
3
+ {%- if tag_name %}{{- '\n<' ~ tag_name ~ '>' -}}{% endif %}
4
+ {{- '[' }}
5
+ {%- for item in item_list -%}
6
+ {%- if loop.index > 1 %}{{- ", "}}{% endif -%}
7
+ {%- if item is string -%}
8
+ {{ "`" ~ item ~ "`" }}
9
+ {%- else -%}
10
+ {{ item }}
11
+ {%- endif -%}
12
+ {%- endfor -%}
13
+ {{- ']' }}
14
+ {%- if tag_name %}{{- '</' ~ tag_name ~ '>' -}}{% endif %}
15
+ {%- endif %}
16
+ {% endmacro %}
17
+
18
+ {%- if messages[0]["role"] == "system" %}
19
+ {%- set system_message = messages[0]["content"] %}
20
+ {%- set loop_messages = messages[1:] %}
21
+ {%- else %}
22
+ {%- set loop_messages = messages %}
23
+ {%- endif %}
24
+
25
+ {%- if not tools is defined %}
26
+ {%- set tools = [] %}
27
+ {%- endif %}
28
+
29
+ {%- if system_message is defined %}
30
+ {{- "<|im_start|>system\n" + system_message }}
31
+ {%- else %}
32
+ {%- if tools is iterable and tools | length > 0 %}
33
+ {{- "<|im_start|>system\nYou are Qwen, a helpful AI assistant that can interact with a computer to solve tasks." }}
34
+ {%- endif %}
35
+ {%- endif %}
36
+ {%- if tools is iterable and tools | length > 0 %}
37
+ {{- "\n\nYou have access to the following functions:\n\n" }}
38
+ {{- "<tools>" }}
39
+ {%- for tool in tools %}
40
+ {%- if tool.function is defined %}
41
+ {%- set tool = tool.function %}
42
+ {%- endif %}
43
+ {{- "\n<function>\n<name>" ~ tool.name ~ "</name>" }}
44
+ {{- '\n<description>' ~ (tool.description | trim) ~ '</description>' }}
45
+ {{- '\n<parameters>' }}
46
+ {%- for param_name, param_fields in tool.parameters.properties|items %}
47
+ {{- '\n<parameter>' }}
48
+ {{- '\n<name>' ~ param_name ~ '</name>' }}
49
+ {%- if param_fields.type is defined %}
50
+ {{- '\n<type>' ~ (param_fields.type | string) ~ '</type>' }}
51
+ {%- endif %}
52
+ {%- if param_fields.description is defined %}
53
+ {{- '\n<description>' ~ (param_fields.description | trim) ~ '</description>' }}
54
+ {%- endif %}
55
+ {{- render_item_list(param_fields.enum, 'enum') }}
56
+ {%- set handled_keys = ['type', 'description', 'enum', 'required'] %}
57
+ {%- for json_key in param_fields.keys() | reject("in", handled_keys) %}
58
+ {%- set normed_json_key = json_key | replace("-", "_") | replace(" ", "_") | replace("$", "") %}
59
+ {%- if param_fields[json_key] is mapping %}
60
+ {{- '\n<' ~ normed_json_key ~ '>' ~ (param_fields[json_key] | tojson | safe) ~ '</' ~ normed_json_key ~ '>' }}
61
+ {%- else %}
62
+ {{-'\n<' ~ normed_json_key ~ '>' ~ (param_fields[json_key] | string) ~ '</' ~ normed_json_key ~ '>' }}
63
+ {%- endif %}
64
+ {%- endfor %}
65
+ {{- render_item_list(param_fields.required, 'required') }}
66
+ {{- '\n</parameter>' }}
67
+ {%- endfor %}
68
+ {{- render_item_list(tool.parameters.required, 'required') }}
69
+ {{- '\n</parameters>' }}
70
+ {%- if tool.return is defined %}
71
+ {%- if tool.return is mapping %}
72
+ {{- '\n<return>' ~ (tool.return | tojson | safe) ~ '</return>' }}
73
+ {%- else %}
74
+ {{- '\n<return>' ~ (tool.return | string) ~ '</return>' }}
75
+ {%- endif %}
76
+ {%- endif %}
77
+ {{- '\n</function>' }}
78
+ {%- endfor %}
79
+ {{- "\n</tools>" }}
80
+ {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
81
+ {%- endif %}
82
+ {%- if system_message is defined %}
83
+ {{- '<|im_end|>\n' }}
84
+ {%- else %}
85
+ {%- if tools is iterable and tools | length > 0 %}
86
+ {{- '<|im_end|>\n' }}
87
+ {%- endif %}
88
+ {%- endif %}
89
+ {%- for message in loop_messages %}
90
+ {%- if message.role == "assistant" and message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}
91
+ {{- '<|im_start|>' + message.role }}
92
+ {%- if message.content is defined and message.content is string and message.content | trim | length > 0 %}
93
+ {{- '\n' + message.content | trim + '\n' }}
94
+ {%- endif %}
95
+ {%- for tool_call in message.tool_calls %}
96
+ {%- if tool_call.function is defined %}
97
+ {%- set tool_call = tool_call.function %}
98
+ {%- endif %}
99
+ {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
100
+ {%- if tool_call.arguments is defined %}
101
+ {%- for args_name, args_value in tool_call.arguments|items %}
102
+ {{- '<parameter=' + args_name + '>\n' }}
103
+ {%- set args_value = args_value if args_value is string else args_value | string %}
104
+ {{- args_value }}
105
+ {{- '\n</parameter>\n' }}
106
+ {%- endfor %}
107
+ {%- endif %}
108
+ {{- '</function>\n</tool_call>' }}
109
+ {%- endfor %}
110
+ {{- '<|im_end|>\n' }}
111
+ {%- elif message.role == "user" or message.role == "system" or message.role == "assistant" %}
112
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
113
+ {%- elif message.role == "tool" %}
114
+ {%- if loop.previtem and loop.previtem.role != "tool" %}
115
+ {{- '<|im_start|>user\n' }}
116
+ {%- endif %}
117
+ {{- '<tool_response>\n' }}
118
+ {{- message.content }}
119
+ {{- '\n</tool_response>\n' }}
120
+ {%- if not loop.last and loop.nextitem.role != "tool" %}
121
+ {{- '<|im_end|>\n' }}
122
+ {%- elif loop.last %}
123
+ {{- '<|im_end|>\n' }}
124
+ {%- endif %}
125
+ {%- else %}
126
+ {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>\n' }}
127
+ {%- endif %}
128
+ {%- endfor %}
129
+ {%- if add_generation_prompt %}
130
+ {{- '<|im_start|>assistant\n' }}
131
+ {%- endif %}
config.json ADDED
@@ -0,0 +1,134 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3MoeForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "decoder_sparse_step": 1,
8
+ "eos_token_id": 151645,
9
+ "head_dim": 128,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 6144,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 8192,
14
+ "max_position_embeddings": 262144,
15
+ "max_window_layers": 62,
16
+ "mlp_only_layers": [],
17
+ "model_type": "qwen3_moe",
18
+ "moe_intermediate_size": 2560,
19
+ "norm_topk_prob": true,
20
+ "num_attention_heads": 96,
21
+ "num_experts": 160,
22
+ "num_experts_per_tok": 8,
23
+ "num_hidden_layers": 62,
24
+ "num_key_value_heads": 8,
25
+ "output_router_logits": false,
26
+ "qkv_bias": false,
27
+ "quantization_config": {
28
+ "config_groups": {
29
+ "group_0": {
30
+ "input_activations": null,
31
+ "output_activations": null,
32
+ "targets": [
33
+ "Linear"
34
+ ],
35
+ "weights": {
36
+ "actorder": null,
37
+ "block_structure": null,
38
+ "dynamic": false,
39
+ "group_size": 128,
40
+ "num_bits": 4,
41
+ "observer": "minmax",
42
+ "observer_kwargs": {},
43
+ "strategy": "group",
44
+ "symmetric": true,
45
+ "type": "int"
46
+ }
47
+ }
48
+ },
49
+ "format": "pack-quantized",
50
+ "global_compression_ratio": null,
51
+ "ignore": [
52
+ "model.layers.0.mlp.gate",
53
+ "model.layers.1.mlp.gate",
54
+ "model.layers.2.mlp.gate",
55
+ "model.layers.3.mlp.gate",
56
+ "model.layers.4.mlp.gate",
57
+ "model.layers.5.mlp.gate",
58
+ "model.layers.6.mlp.gate",
59
+ "model.layers.7.mlp.gate",
60
+ "model.layers.8.mlp.gate",
61
+ "model.layers.9.mlp.gate",
62
+ "model.layers.10.mlp.gate",
63
+ "model.layers.11.mlp.gate",
64
+ "model.layers.12.mlp.gate",
65
+ "model.layers.13.mlp.gate",
66
+ "model.layers.14.mlp.gate",
67
+ "model.layers.15.mlp.gate",
68
+ "model.layers.16.mlp.gate",
69
+ "model.layers.17.mlp.gate",
70
+ "model.layers.18.mlp.gate",
71
+ "model.layers.19.mlp.gate",
72
+ "model.layers.20.mlp.gate",
73
+ "model.layers.21.mlp.gate",
74
+ "model.layers.22.mlp.gate",
75
+ "model.layers.23.mlp.gate",
76
+ "model.layers.24.mlp.gate",
77
+ "model.layers.25.mlp.gate",
78
+ "model.layers.26.mlp.gate",
79
+ "model.layers.27.mlp.gate",
80
+ "model.layers.28.mlp.gate",
81
+ "model.layers.29.mlp.gate",
82
+ "model.layers.30.mlp.gate",
83
+ "model.layers.31.mlp.gate",
84
+ "model.layers.32.mlp.gate",
85
+ "model.layers.33.mlp.gate",
86
+ "model.layers.34.mlp.gate",
87
+ "model.layers.35.mlp.gate",
88
+ "model.layers.36.mlp.gate",
89
+ "model.layers.37.mlp.gate",
90
+ "model.layers.38.mlp.gate",
91
+ "model.layers.39.mlp.gate",
92
+ "model.layers.40.mlp.gate",
93
+ "model.layers.41.mlp.gate",
94
+ "model.layers.42.mlp.gate",
95
+ "model.layers.43.mlp.gate",
96
+ "model.layers.44.mlp.gate",
97
+ "model.layers.45.mlp.gate",
98
+ "model.layers.46.mlp.gate",
99
+ "model.layers.47.mlp.gate",
100
+ "model.layers.48.mlp.gate",
101
+ "model.layers.49.mlp.gate",
102
+ "model.layers.50.mlp.gate",
103
+ "model.layers.51.mlp.gate",
104
+ "model.layers.52.mlp.gate",
105
+ "model.layers.53.mlp.gate",
106
+ "model.layers.54.mlp.gate",
107
+ "model.layers.55.mlp.gate",
108
+ "model.layers.56.mlp.gate",
109
+ "model.layers.57.mlp.gate",
110
+ "model.layers.58.mlp.gate",
111
+ "model.layers.59.mlp.gate",
112
+ "model.layers.60.mlp.gate",
113
+ "model.layers.61.mlp.gate",
114
+ "lm_head"
115
+ ],
116
+ "kv_cache_scheme": null,
117
+ "quant_method": "compressed-tensors",
118
+ "quantization_status": "compressed",
119
+ "sparsity_config": {}
120
+ },
121
+ "rms_norm_eps": 1e-06,
122
+ "rope_scaling": null,
123
+ "rope_theta": 10000000,
124
+ "router_aux_loss_coef": 0.0,
125
+ "shared_expert_intermediate_size": 0,
126
+ "sliding_window": null,
127
+ "tie_word_embeddings": false,
128
+ "torch_dtype": "float16",
129
+ "transformers_version": "4.52.4",
130
+ "use_cache": true,
131
+ "use_qk_norm": true,
132
+ "use_sliding_window": false,
133
+ "vocab_size": 151936
134
+ }
generation_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "do_sample": true,
3
+ "eos_token_id": [
4
+ 151645,
5
+ 151643
6
+ ],
7
+ "pad_token_id": 151643,
8
+ "repetition_penalty": 1.05,
9
+ "temperature": 0.7,
10
+ "top_k": 20,
11
+ "top_p": 0.8,
12
+ "transformers_version": "4.52.4"
13
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:201f66e7e783a435fa41f5d8ebf9c834b0ec910e3815835cdff0e7458ce5899b
3
+ size 4994971760
model-00002-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4f1212e50ec3784bbbda6d0c75dc697a4263ea3aa39ac1eacd30fe7de5380a3
3
+ size 4998401240
model-00003-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32cd8134d424dd11016327cf3511d1efb6daca9cb413119c66af580076bcb195
3
+ size 4993167520
model-00004-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef4583c38cd8c3a7d8302ed9d54cb10fd1fb1248168a0136c8801307e0fa6204
3
+ size 4993167576
model-00005-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6d4922a13a764f46407739edf75ccec2af8821897256da881c938772e482d37
3
+ size 4993167832
model-00006-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a255fc251d064b3d33a927f5816ad16fc3d1429aa212452c50dd72d15fc4c88f
3
+ size 4998401176
model-00007-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d3c9ec8932b9462df5593a161caf72573aed44fd6ee0ad9bae4dabff49f069c
3
+ size 4993167552
model-00008-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:656450c246bef76c67c6f2cb05c4b2fb536120785555e4e6ab2534fa4ee5539e
3
+ size 4993167576
model-00009-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c42d9b6c859f3435a4e1e302bbce7d2a00cd102867ac34153e9dfba556eac01
3
+ size 4993169064
model-00010-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a55a9ff0a7fc435668d660d01ebb01373f5dd0740a56c0b28f116497bb22a9a5
3
+ size 4998402944
model-00011-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d5d10709f5a8b859e5f4cf7201ca78eb3d33ca60ac4e6ce73eb001aa79fbaa7
3
+ size 4993169408
model-00012-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a676939e89ae27ee473b393c36cb159c76d84ed5263defc521aceceb5507804b
3
+ size 4993169408
model-00013-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1acc0bda3cdc08326ca647946630679eaaab521d07e6aa022c4174c246ea7ed0
3
+ size 4993169728
model-00014-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a549d6fd38a26175bce3c377c9f9dd85814690d5193a82aa4451e2b556916cef
3
+ size 4998402912
model-00015-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:603089604448eaf4d820be5eadfb9f9df58c20f1df94528bc4e340dffa49cc30
3
+ size 4993169408
model-00016-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8a52d77e9d8d00c00350e6e5f4f84839194cb7d52685d66d7a9b12b8fb1cbb5
3
+ size 4993169408
model-00017-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58e7a45ac4903cd88c111d5bbf411ea00017a4fb4a94b8bb73767d2c64e2b5a8
3
+ size 4993169760
model-00018-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60dd6c573066ccc0e1243e5984ffed85de2a17f5d603cadf8dd0e102d7aaef7d
3
+ size 4998402880
model-00019-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c91e45355c846fa1e14f44eeb44f11f94000c4bc2c9f6a7f9e0fd453f3806fc4
3
+ size 4993169408
model-00020-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f19232a74a9645f92f418797eb540404b2c5bda6beea7e2d57ef807ee7e757e9
3
+ size 4993169408
model-00021-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c526baa885445c42a91d45be93f067c2554977c24cf48ba440d25d6282a508f
3
+ size 4993169784
model-00022-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7c8b007d8acd8b8528d7093f4ef7806c053ca93e3d009db0b0722617dd4fe7f
3
+ size 4998402848
model-00023-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db2ff417d0d2e7f56be6e87dca0816f6b2308b1df2b62e68d3ddfa58855fb8b3
3
+ size 4993169408
model-00024-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7eed777f17f702d39223cc797c13f2559bec8047e6610f150845e6cf90c983fc
3
+ size 4993169440
model-00025-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d70e8310d6fe5e65f856b33050852f6f04da7ad7ed21ec0662417f58ec4e02d
3
+ size 4993169784
model-00026-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e4d3d7411b41b5c57c2f0b8491c1b99324f9f1bed6089bf7c53efdec2ec70f4
3
+ size 4998402816
model-00027-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be1d9e6ce2f86b92031dfd9f8dab44cf0b4e1793c332c1d01578b537c33e082c
3
+ size 4993169408
model-00028-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35f1a39acd645714e90fa627ffa8e316d7ad2ec882ffda6a51b6e37dfc09ffcc
3
+ size 4993169472
model-00029-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9d822063099c44365713b9d19e945739f9d38e51d4f172b64b753ee7cddc7be
3
+ size 4993169784
model-00030-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82be6dff1dc946d6dd98df8e79337ddaeaa089fc5330d64e7ba6baf66d4482ba
3
+ size 4998402784
model-00031-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8c6059ed22feff0beb6dca2bb3f731f18895e0348359a05103250329bd6921
3
+ size 4993169408
model-00032-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e928c17cd827be9766d161e626c831074fea86ffaa4b3ff27a28a21f180bade4
3
+ size 4993169504
model-00033-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:050d14a295b4e82329a71d91d6fe6a68e03953bdc7c8bae7ea2cbf30eda19e8e
3
+ size 4993169784
model-00034-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcc36c0cdffd2e259d544af85f682320c0b461101319fb372c9af120d3bc38bc
3
+ size 4998402760
model-00035-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87d4f91dbb99c090166d5ed582cb3b9097a76a089505fd9a4785684af77d8117
3
+ size 4993169408
model-00036-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40a1e071a7a1192735b873543862e6a9ab75c664749f8b2cc2e397bec1d9cdba
3
+ size 4993169536
model-00037-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6724f0b83a76755ed395f9412257928ee6b94ad761e59f1ed63592675675fe2
3
+ size 4993169784
model-00038-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0be25a72b10889c4738de5f156ac0641ad817ca914bb0032fc38a4b915e78a8b
3
+ size 4998402728
model-00039-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f12aa67dc3cd968213fd6a4b1bb865821457dfa170c0836b591d27beca3514ec
3
+ size 4993169408
model-00040-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10b97fd4bb19c3c7c4436b605f341fe6dcc6093c2c5619319cd5337957b2104f
3
+ size 4993169560
model-00041-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cba3f6cbdadb31f739b6261038ba8a603bb83cc4c504e3c7c85c2687ddcd99f0
3
+ size 4993169784
model-00042-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b214eb45232c311de861c1d2ddd09ddcf3fa8c201e04d33b7d06dc50c1b1b7c9
3
+ size 4998402696
model-00043-of-00051.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98910ac81d655174389184007445c4a04df2a397c28c045491dda79cd7aed7b3
3
+ size 4993169408