ManjunathReddy commited on
Commit
2a37b68
·
1 Parent(s): 58cf6ec

Delete checkpoint-960

Browse files
Files changed (27) hide show
  1. checkpoint-960/checkpoint-960/README.md +0 -204
  2. checkpoint-960/checkpoint-960/adapter_config.json +0 -28
  3. checkpoint-960/checkpoint-960/adapter_config.json:Zone.Identifier +0 -0
  4. checkpoint-960/checkpoint-960/adapter_model.safetensors +0 -3
  5. checkpoint-960/checkpoint-960/adapter_model.safetensors:Zone.Identifier +0 -0
  6. checkpoint-960/checkpoint-960/added_tokens.json +0 -40
  7. checkpoint-960/checkpoint-960/added_tokens.json:Zone.Identifier +0 -0
  8. checkpoint-960/checkpoint-960/merges.txt +0 -0
  9. checkpoint-960/checkpoint-960/merges.txt:Zone.Identifier +0 -0
  10. checkpoint-960/checkpoint-960/optimizer.pt +0 -3
  11. checkpoint-960/checkpoint-960/optimizer.pt:Zone.Identifier +0 -0
  12. checkpoint-960/checkpoint-960/rng_state.pth +0 -3
  13. checkpoint-960/checkpoint-960/rng_state.pth:Zone.Identifier +0 -0
  14. checkpoint-960/checkpoint-960/scheduler.pt +0 -3
  15. checkpoint-960/checkpoint-960/scheduler.pt:Zone.Identifier +0 -0
  16. checkpoint-960/checkpoint-960/special_tokens_map.json +0 -24
  17. checkpoint-960/checkpoint-960/special_tokens_map.json:Zone.Identifier +0 -0
  18. checkpoint-960/checkpoint-960/tokenizer.json +0 -0
  19. checkpoint-960/checkpoint-960/tokenizer.json:Zone.Identifier +0 -0
  20. checkpoint-960/checkpoint-960/tokenizer_config.json +0 -324
  21. checkpoint-960/checkpoint-960/tokenizer_config.json:Zone.Identifier +0 -0
  22. checkpoint-960/checkpoint-960/trainer_state.json +0 -597
  23. checkpoint-960/checkpoint-960/trainer_state.json:Zone.Identifier +0 -0
  24. checkpoint-960/checkpoint-960/training_args.bin +0 -3
  25. checkpoint-960/checkpoint-960/training_args.bin:Zone.Identifier +0 -0
  26. checkpoint-960/checkpoint-960/vocab.json +0 -0
  27. checkpoint-960/checkpoint-960/vocab.json:Zone.Identifier +0 -0
checkpoint-960/checkpoint-960/README.md DELETED
@@ -1,204 +0,0 @@
1
- ---
2
- library_name: peft
3
- base_model: microsoft/phi-2
4
- ---
5
-
6
- # Model Card for Model ID
7
-
8
- <!-- Provide a quick summary of what the model is/does. -->
9
-
10
-
11
-
12
- ## Model Details
13
-
14
- ### Model Description
15
-
16
- <!-- Provide a longer summary of what this model is. -->
17
-
18
-
19
-
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
-
28
- ### Model Sources [optional]
29
-
30
- <!-- Provide the basic links for the model. -->
31
-
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
35
-
36
- ## Uses
37
-
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
-
40
- ### Direct Use
41
-
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
-
46
- ### Downstream Use [optional]
47
-
48
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
-
50
- [More Information Needed]
51
-
52
- ### Out-of-Scope Use
53
-
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
- [More Information Needed]
57
-
58
- ## Bias, Risks, and Limitations
59
-
60
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
-
62
- [More Information Needed]
63
-
64
- ### Recommendations
65
-
66
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
-
68
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
-
70
- ## How to Get Started with the Model
71
-
72
- Use the code below to get started with the model.
73
-
74
- [More Information Needed]
75
-
76
- ## Training Details
77
-
78
- ### Training Data
79
-
80
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
-
82
- [More Information Needed]
83
-
84
- ### Training Procedure
85
-
86
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
-
88
- #### Preprocessing [optional]
89
-
90
- [More Information Needed]
91
-
92
-
93
- #### Training Hyperparameters
94
-
95
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
-
97
- #### Speeds, Sizes, Times [optional]
98
-
99
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
-
101
- [More Information Needed]
102
-
103
- ## Evaluation
104
-
105
- <!-- This section describes the evaluation protocols and provides the results. -->
106
-
107
- ### Testing Data, Factors & Metrics
108
-
109
- #### Testing Data
110
-
111
- <!-- This should link to a Dataset Card if possible. -->
112
-
113
- [More Information Needed]
114
-
115
- #### Factors
116
-
117
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
-
119
- [More Information Needed]
120
-
121
- #### Metrics
122
-
123
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
-
125
- [More Information Needed]
126
-
127
- ### Results
128
-
129
- [More Information Needed]
130
-
131
- #### Summary
132
-
133
-
134
-
135
- ## Model Examination [optional]
136
-
137
- <!-- Relevant interpretability work for the model goes here -->
138
-
139
- [More Information Needed]
140
-
141
- ## Environmental Impact
142
-
143
- <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
-
145
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
-
147
- - **Hardware Type:** [More Information Needed]
148
- - **Hours used:** [More Information Needed]
149
- - **Cloud Provider:** [More Information Needed]
150
- - **Compute Region:** [More Information Needed]
151
- - **Carbon Emitted:** [More Information Needed]
152
-
153
- ## Technical Specifications [optional]
154
-
155
- ### Model Architecture and Objective
156
-
157
- [More Information Needed]
158
-
159
- ### Compute Infrastructure
160
-
161
- [More Information Needed]
162
-
163
- #### Hardware
164
-
165
- [More Information Needed]
166
-
167
- #### Software
168
-
169
- [More Information Needed]
170
-
171
- ## Citation [optional]
172
-
173
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
-
175
- **BibTeX:**
176
-
177
- [More Information Needed]
178
-
179
- **APA:**
180
-
181
- [More Information Needed]
182
-
183
- ## Glossary [optional]
184
-
185
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
-
187
- [More Information Needed]
188
-
189
- ## More Information [optional]
190
-
191
- [More Information Needed]
192
-
193
- ## Model Card Authors [optional]
194
-
195
- [More Information Needed]
196
-
197
- ## Model Card Contact
198
-
199
- [More Information Needed]
200
-
201
-
202
- ### Framework versions
203
-
204
- - PEFT 0.7.2.dev0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/adapter_config.json DELETED
@@ -1,28 +0,0 @@
1
- {
2
- "alpha_pattern": {},
3
- "auto_mapping": null,
4
- "base_model_name_or_path": "microsoft/phi-2",
5
- "bias": "none",
6
- "fan_in_fan_out": false,
7
- "inference_mode": true,
8
- "init_lora_weights": true,
9
- "layers_pattern": null,
10
- "layers_to_transform": null,
11
- "loftq_config": {},
12
- "lora_alpha": 16,
13
- "lora_dropout": 0.1,
14
- "megatron_config": null,
15
- "megatron_core": "megatron.core",
16
- "modules_to_save": null,
17
- "peft_type": "LORA",
18
- "r": 64,
19
- "rank_pattern": {},
20
- "revision": null,
21
- "target_modules": [
22
- "Wqkv",
23
- "fc2",
24
- "fc1"
25
- ],
26
- "task_type": "CAUSAL_LM",
27
- "use_rslora": false
28
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/adapter_config.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/adapter_model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:388ac43ab16da987a83f2d6668f704dd5f0abb0bf68a671c550aa7a66d09d14c
3
- size 293626136
 
 
 
 
checkpoint-960/checkpoint-960/adapter_model.safetensors:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/added_tokens.json DELETED
@@ -1,40 +0,0 @@
1
- {
2
- "\t\t": 50294,
3
- "\t\t\t": 50293,
4
- "\t\t\t\t": 50292,
5
- "\t\t\t\t\t": 50291,
6
- "\t\t\t\t\t\t": 50290,
7
- "\t\t\t\t\t\t\t": 50289,
8
- "\t\t\t\t\t\t\t\t": 50288,
9
- "\t\t\t\t\t\t\t\t\t": 50287,
10
- " ": 50286,
11
- " ": 50285,
12
- " ": 50284,
13
- " ": 50283,
14
- " ": 50282,
15
- " ": 50281,
16
- " ": 50280,
17
- " ": 50279,
18
- " ": 50278,
19
- " ": 50277,
20
- " ": 50276,
21
- " ": 50275,
22
- " ": 50274,
23
- " ": 50273,
24
- " ": 50272,
25
- " ": 50271,
26
- " ": 50270,
27
- " ": 50269,
28
- " ": 50268,
29
- " ": 50267,
30
- " ": 50266,
31
- " ": 50265,
32
- " ": 50264,
33
- " ": 50263,
34
- " ": 50262,
35
- " ": 50261,
36
- " ": 50260,
37
- " ": 50259,
38
- " ": 50258,
39
- " ": 50257
40
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/added_tokens.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/merges.txt DELETED
The diff for this file is too large to render. See raw diff
 
checkpoint-960/checkpoint-960/merges.txt:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/optimizer.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:815b8fe252f9879b8df9e1742b840c9c07c9e01012c8d0bdd01dd42e0415f069
3
- size 587321658
 
 
 
 
checkpoint-960/checkpoint-960/optimizer.pt:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/rng_state.pth DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc9ef34e1aecee7db389e914ca03447ab6ab633408231a36507f3dde62aa727b
3
- size 14244
 
 
 
 
checkpoint-960/checkpoint-960/rng_state.pth:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/scheduler.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7df40c2372e995711cd2139259b0afbd1b583e873344e5a95064c06af0d88ab9
3
- size 1064
 
 
 
 
checkpoint-960/checkpoint-960/scheduler.pt:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/special_tokens_map.json DELETED
@@ -1,24 +0,0 @@
1
- {
2
- "bos_token": {
3
- "content": "<|endoftext|>",
4
- "lstrip": false,
5
- "normalized": false,
6
- "rstrip": false,
7
- "single_word": false
8
- },
9
- "eos_token": {
10
- "content": "<|endoftext|>",
11
- "lstrip": false,
12
- "normalized": false,
13
- "rstrip": false,
14
- "single_word": false
15
- },
16
- "pad_token": "<|endoftext|>",
17
- "unk_token": {
18
- "content": "<|endoftext|>",
19
- "lstrip": false,
20
- "normalized": false,
21
- "rstrip": false,
22
- "single_word": false
23
- }
24
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/special_tokens_map.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/tokenizer.json DELETED
The diff for this file is too large to render. See raw diff
 
checkpoint-960/checkpoint-960/tokenizer.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/tokenizer_config.json DELETED
@@ -1,324 +0,0 @@
1
- {
2
- "add_prefix_space": false,
3
- "added_tokens_decoder": {
4
- "50256": {
5
- "content": "<|endoftext|>",
6
- "lstrip": false,
7
- "normalized": false,
8
- "rstrip": false,
9
- "single_word": false,
10
- "special": true
11
- },
12
- "50257": {
13
- "content": " ",
14
- "lstrip": false,
15
- "normalized": true,
16
- "rstrip": false,
17
- "single_word": false,
18
- "special": false
19
- },
20
- "50258": {
21
- "content": " ",
22
- "lstrip": false,
23
- "normalized": true,
24
- "rstrip": false,
25
- "single_word": false,
26
- "special": false
27
- },
28
- "50259": {
29
- "content": " ",
30
- "lstrip": false,
31
- "normalized": true,
32
- "rstrip": false,
33
- "single_word": false,
34
- "special": false
35
- },
36
- "50260": {
37
- "content": " ",
38
- "lstrip": false,
39
- "normalized": true,
40
- "rstrip": false,
41
- "single_word": false,
42
- "special": false
43
- },
44
- "50261": {
45
- "content": " ",
46
- "lstrip": false,
47
- "normalized": true,
48
- "rstrip": false,
49
- "single_word": false,
50
- "special": false
51
- },
52
- "50262": {
53
- "content": " ",
54
- "lstrip": false,
55
- "normalized": true,
56
- "rstrip": false,
57
- "single_word": false,
58
- "special": false
59
- },
60
- "50263": {
61
- "content": " ",
62
- "lstrip": false,
63
- "normalized": true,
64
- "rstrip": false,
65
- "single_word": false,
66
- "special": false
67
- },
68
- "50264": {
69
- "content": " ",
70
- "lstrip": false,
71
- "normalized": true,
72
- "rstrip": false,
73
- "single_word": false,
74
- "special": false
75
- },
76
- "50265": {
77
- "content": " ",
78
- "lstrip": false,
79
- "normalized": true,
80
- "rstrip": false,
81
- "single_word": false,
82
- "special": false
83
- },
84
- "50266": {
85
- "content": " ",
86
- "lstrip": false,
87
- "normalized": true,
88
- "rstrip": false,
89
- "single_word": false,
90
- "special": false
91
- },
92
- "50267": {
93
- "content": " ",
94
- "lstrip": false,
95
- "normalized": true,
96
- "rstrip": false,
97
- "single_word": false,
98
- "special": false
99
- },
100
- "50268": {
101
- "content": " ",
102
- "lstrip": false,
103
- "normalized": true,
104
- "rstrip": false,
105
- "single_word": false,
106
- "special": false
107
- },
108
- "50269": {
109
- "content": " ",
110
- "lstrip": false,
111
- "normalized": true,
112
- "rstrip": false,
113
- "single_word": false,
114
- "special": false
115
- },
116
- "50270": {
117
- "content": " ",
118
- "lstrip": false,
119
- "normalized": true,
120
- "rstrip": false,
121
- "single_word": false,
122
- "special": false
123
- },
124
- "50271": {
125
- "content": " ",
126
- "lstrip": false,
127
- "normalized": true,
128
- "rstrip": false,
129
- "single_word": false,
130
- "special": false
131
- },
132
- "50272": {
133
- "content": " ",
134
- "lstrip": false,
135
- "normalized": true,
136
- "rstrip": false,
137
- "single_word": false,
138
- "special": false
139
- },
140
- "50273": {
141
- "content": " ",
142
- "lstrip": false,
143
- "normalized": true,
144
- "rstrip": false,
145
- "single_word": false,
146
- "special": false
147
- },
148
- "50274": {
149
- "content": " ",
150
- "lstrip": false,
151
- "normalized": true,
152
- "rstrip": false,
153
- "single_word": false,
154
- "special": false
155
- },
156
- "50275": {
157
- "content": " ",
158
- "lstrip": false,
159
- "normalized": true,
160
- "rstrip": false,
161
- "single_word": false,
162
- "special": false
163
- },
164
- "50276": {
165
- "content": " ",
166
- "lstrip": false,
167
- "normalized": true,
168
- "rstrip": false,
169
- "single_word": false,
170
- "special": false
171
- },
172
- "50277": {
173
- "content": " ",
174
- "lstrip": false,
175
- "normalized": true,
176
- "rstrip": false,
177
- "single_word": false,
178
- "special": false
179
- },
180
- "50278": {
181
- "content": " ",
182
- "lstrip": false,
183
- "normalized": true,
184
- "rstrip": false,
185
- "single_word": false,
186
- "special": false
187
- },
188
- "50279": {
189
- "content": " ",
190
- "lstrip": false,
191
- "normalized": true,
192
- "rstrip": false,
193
- "single_word": false,
194
- "special": false
195
- },
196
- "50280": {
197
- "content": " ",
198
- "lstrip": false,
199
- "normalized": true,
200
- "rstrip": false,
201
- "single_word": false,
202
- "special": false
203
- },
204
- "50281": {
205
- "content": " ",
206
- "lstrip": false,
207
- "normalized": true,
208
- "rstrip": false,
209
- "single_word": false,
210
- "special": false
211
- },
212
- "50282": {
213
- "content": " ",
214
- "lstrip": false,
215
- "normalized": true,
216
- "rstrip": false,
217
- "single_word": false,
218
- "special": false
219
- },
220
- "50283": {
221
- "content": " ",
222
- "lstrip": false,
223
- "normalized": true,
224
- "rstrip": false,
225
- "single_word": false,
226
- "special": false
227
- },
228
- "50284": {
229
- "content": " ",
230
- "lstrip": false,
231
- "normalized": true,
232
- "rstrip": false,
233
- "single_word": false,
234
- "special": false
235
- },
236
- "50285": {
237
- "content": " ",
238
- "lstrip": false,
239
- "normalized": true,
240
- "rstrip": false,
241
- "single_word": false,
242
- "special": false
243
- },
244
- "50286": {
245
- "content": " ",
246
- "lstrip": false,
247
- "normalized": true,
248
- "rstrip": false,
249
- "single_word": false,
250
- "special": false
251
- },
252
- "50287": {
253
- "content": "\t\t\t\t\t\t\t\t\t",
254
- "lstrip": false,
255
- "normalized": true,
256
- "rstrip": false,
257
- "single_word": false,
258
- "special": false
259
- },
260
- "50288": {
261
- "content": "\t\t\t\t\t\t\t\t",
262
- "lstrip": false,
263
- "normalized": true,
264
- "rstrip": false,
265
- "single_word": false,
266
- "special": false
267
- },
268
- "50289": {
269
- "content": "\t\t\t\t\t\t\t",
270
- "lstrip": false,
271
- "normalized": true,
272
- "rstrip": false,
273
- "single_word": false,
274
- "special": false
275
- },
276
- "50290": {
277
- "content": "\t\t\t\t\t\t",
278
- "lstrip": false,
279
- "normalized": true,
280
- "rstrip": false,
281
- "single_word": false,
282
- "special": false
283
- },
284
- "50291": {
285
- "content": "\t\t\t\t\t",
286
- "lstrip": false,
287
- "normalized": true,
288
- "rstrip": false,
289
- "single_word": false,
290
- "special": false
291
- },
292
- "50292": {
293
- "content": "\t\t\t\t",
294
- "lstrip": false,
295
- "normalized": true,
296
- "rstrip": false,
297
- "single_word": false,
298
- "special": false
299
- },
300
- "50293": {
301
- "content": "\t\t\t",
302
- "lstrip": false,
303
- "normalized": true,
304
- "rstrip": false,
305
- "single_word": false,
306
- "special": false
307
- },
308
- "50294": {
309
- "content": "\t\t",
310
- "lstrip": false,
311
- "normalized": true,
312
- "rstrip": false,
313
- "single_word": false,
314
- "special": false
315
- }
316
- },
317
- "bos_token": "<|endoftext|>",
318
- "clean_up_tokenization_spaces": true,
319
- "eos_token": "<|endoftext|>",
320
- "model_max_length": 2048,
321
- "pad_token": "<|endoftext|>",
322
- "tokenizer_class": "CodeGenTokenizer",
323
- "unk_token": "<|endoftext|>"
324
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/tokenizer_config.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/trainer_state.json DELETED
@@ -1,597 +0,0 @@
1
- {
2
- "best_metric": null,
3
- "best_model_checkpoint": null,
4
- "epoch": 0.8546628088137103,
5
- "eval_steps": 500,
6
- "global_step": 960,
7
- "is_hyper_param_search": false,
8
- "is_local_process_zero": true,
9
- "is_world_process_zero": true,
10
- "log_history": [
11
- {
12
- "epoch": 0.01,
13
- "learning_rate": 0.0002,
14
- "loss": 1.727,
15
- "step": 10
16
- },
17
- {
18
- "epoch": 0.02,
19
- "learning_rate": 0.0002,
20
- "loss": 1.7292,
21
- "step": 20
22
- },
23
- {
24
- "epoch": 0.03,
25
- "learning_rate": 0.0002,
26
- "loss": 1.7416,
27
- "step": 30
28
- },
29
- {
30
- "epoch": 0.04,
31
- "learning_rate": 0.0002,
32
- "loss": 2.0158,
33
- "step": 40
34
- },
35
- {
36
- "epoch": 0.04,
37
- "learning_rate": 0.0002,
38
- "loss": 2.143,
39
- "step": 50
40
- },
41
- {
42
- "epoch": 0.05,
43
- "learning_rate": 0.0002,
44
- "loss": 1.6469,
45
- "step": 60
46
- },
47
- {
48
- "epoch": 0.06,
49
- "learning_rate": 0.0002,
50
- "loss": 1.6423,
51
- "step": 70
52
- },
53
- {
54
- "epoch": 0.07,
55
- "learning_rate": 0.0002,
56
- "loss": 1.6669,
57
- "step": 80
58
- },
59
- {
60
- "epoch": 0.08,
61
- "learning_rate": 0.0002,
62
- "loss": 1.919,
63
- "step": 90
64
- },
65
- {
66
- "epoch": 0.09,
67
- "learning_rate": 0.0002,
68
- "loss": 2.1557,
69
- "step": 100
70
- },
71
- {
72
- "epoch": 0.1,
73
- "learning_rate": 0.0002,
74
- "loss": 1.5989,
75
- "step": 110
76
- },
77
- {
78
- "epoch": 0.11,
79
- "learning_rate": 0.0002,
80
- "loss": 1.6912,
81
- "step": 120
82
- },
83
- {
84
- "epoch": 0.12,
85
- "learning_rate": 0.0002,
86
- "loss": 1.565,
87
- "step": 130
88
- },
89
- {
90
- "epoch": 0.12,
91
- "learning_rate": 0.0002,
92
- "loss": 1.9146,
93
- "step": 140
94
- },
95
- {
96
- "epoch": 0.13,
97
- "learning_rate": 0.0002,
98
- "loss": 2.089,
99
- "step": 150
100
- },
101
- {
102
- "epoch": 0.14,
103
- "learning_rate": 0.0002,
104
- "loss": 1.5365,
105
- "step": 160
106
- },
107
- {
108
- "epoch": 0.15,
109
- "learning_rate": 0.0002,
110
- "loss": 1.6268,
111
- "step": 170
112
- },
113
- {
114
- "epoch": 0.16,
115
- "learning_rate": 0.0002,
116
- "loss": 1.6888,
117
- "step": 180
118
- },
119
- {
120
- "epoch": 0.17,
121
- "learning_rate": 0.0002,
122
- "loss": 1.9569,
123
- "step": 190
124
- },
125
- {
126
- "epoch": 0.18,
127
- "learning_rate": 0.0002,
128
- "loss": 2.1153,
129
- "step": 200
130
- },
131
- {
132
- "epoch": 0.19,
133
- "learning_rate": 0.0002,
134
- "loss": 1.5511,
135
- "step": 210
136
- },
137
- {
138
- "epoch": 0.2,
139
- "learning_rate": 0.0002,
140
- "loss": 1.6054,
141
- "step": 220
142
- },
143
- {
144
- "epoch": 0.2,
145
- "learning_rate": 0.0002,
146
- "loss": 1.5985,
147
- "step": 230
148
- },
149
- {
150
- "epoch": 0.21,
151
- "learning_rate": 0.0002,
152
- "loss": 1.8473,
153
- "step": 240
154
- },
155
- {
156
- "epoch": 0.22,
157
- "learning_rate": 0.0002,
158
- "loss": 1.9949,
159
- "step": 250
160
- },
161
- {
162
- "epoch": 0.23,
163
- "learning_rate": 0.0002,
164
- "loss": 1.5932,
165
- "step": 260
166
- },
167
- {
168
- "epoch": 0.24,
169
- "learning_rate": 0.0002,
170
- "loss": 1.5968,
171
- "step": 270
172
- },
173
- {
174
- "epoch": 0.25,
175
- "learning_rate": 0.0002,
176
- "loss": 1.5577,
177
- "step": 280
178
- },
179
- {
180
- "epoch": 0.26,
181
- "learning_rate": 0.0002,
182
- "loss": 1.943,
183
- "step": 290
184
- },
185
- {
186
- "epoch": 0.27,
187
- "learning_rate": 0.0002,
188
- "loss": 2.1429,
189
- "step": 300
190
- },
191
- {
192
- "epoch": 0.28,
193
- "learning_rate": 0.0002,
194
- "loss": 1.5053,
195
- "step": 310
196
- },
197
- {
198
- "epoch": 0.28,
199
- "learning_rate": 0.0002,
200
- "loss": 1.6697,
201
- "step": 320
202
- },
203
- {
204
- "epoch": 0.29,
205
- "learning_rate": 0.0002,
206
- "loss": 1.567,
207
- "step": 330
208
- },
209
- {
210
- "epoch": 0.3,
211
- "learning_rate": 0.0002,
212
- "loss": 1.8498,
213
- "step": 340
214
- },
215
- {
216
- "epoch": 0.31,
217
- "learning_rate": 0.0002,
218
- "loss": 2.0758,
219
- "step": 350
220
- },
221
- {
222
- "epoch": 0.32,
223
- "learning_rate": 0.0002,
224
- "loss": 1.5627,
225
- "step": 360
226
- },
227
- {
228
- "epoch": 0.33,
229
- "learning_rate": 0.0002,
230
- "loss": 1.5358,
231
- "step": 370
232
- },
233
- {
234
- "epoch": 0.34,
235
- "learning_rate": 0.0002,
236
- "loss": 1.7167,
237
- "step": 380
238
- },
239
- {
240
- "epoch": 0.35,
241
- "learning_rate": 0.0002,
242
- "loss": 1.9932,
243
- "step": 390
244
- },
245
- {
246
- "epoch": 0.36,
247
- "learning_rate": 0.0002,
248
- "loss": 2.0632,
249
- "step": 400
250
- },
251
- {
252
- "epoch": 0.37,
253
- "learning_rate": 0.0002,
254
- "loss": 1.5227,
255
- "step": 410
256
- },
257
- {
258
- "epoch": 0.37,
259
- "learning_rate": 0.0002,
260
- "loss": 1.6192,
261
- "step": 420
262
- },
263
- {
264
- "epoch": 0.38,
265
- "learning_rate": 0.0002,
266
- "loss": 1.6087,
267
- "step": 430
268
- },
269
- {
270
- "epoch": 0.39,
271
- "learning_rate": 0.0002,
272
- "loss": 1.9396,
273
- "step": 440
274
- },
275
- {
276
- "epoch": 0.4,
277
- "learning_rate": 0.0002,
278
- "loss": 2.1026,
279
- "step": 450
280
- },
281
- {
282
- "epoch": 0.41,
283
- "learning_rate": 0.0002,
284
- "loss": 1.625,
285
- "step": 460
286
- },
287
- {
288
- "epoch": 0.42,
289
- "learning_rate": 0.0002,
290
- "loss": 1.5609,
291
- "step": 470
292
- },
293
- {
294
- "epoch": 0.43,
295
- "learning_rate": 0.0002,
296
- "loss": 1.542,
297
- "step": 480
298
- },
299
- {
300
- "epoch": 0.44,
301
- "learning_rate": 0.0002,
302
- "loss": 1.9439,
303
- "step": 490
304
- },
305
- {
306
- "epoch": 0.45,
307
- "learning_rate": 0.0002,
308
- "loss": 2.0576,
309
- "step": 500
310
- },
311
- {
312
- "epoch": 0.45,
313
- "learning_rate": 0.0002,
314
- "loss": 1.5826,
315
- "step": 510
316
- },
317
- {
318
- "epoch": 0.46,
319
- "learning_rate": 0.0002,
320
- "loss": 1.6084,
321
- "step": 520
322
- },
323
- {
324
- "epoch": 0.47,
325
- "learning_rate": 0.0002,
326
- "loss": 1.6451,
327
- "step": 530
328
- },
329
- {
330
- "epoch": 0.48,
331
- "learning_rate": 0.0002,
332
- "loss": 1.8193,
333
- "step": 540
334
- },
335
- {
336
- "epoch": 0.49,
337
- "learning_rate": 0.0002,
338
- "loss": 2.0495,
339
- "step": 550
340
- },
341
- {
342
- "epoch": 0.5,
343
- "learning_rate": 0.0002,
344
- "loss": 1.6288,
345
- "step": 560
346
- },
347
- {
348
- "epoch": 0.51,
349
- "learning_rate": 0.0002,
350
- "loss": 1.5786,
351
- "step": 570
352
- },
353
- {
354
- "epoch": 0.52,
355
- "learning_rate": 0.0002,
356
- "loss": 1.6585,
357
- "step": 580
358
- },
359
- {
360
- "epoch": 0.53,
361
- "learning_rate": 0.0002,
362
- "loss": 1.9045,
363
- "step": 590
364
- },
365
- {
366
- "epoch": 0.53,
367
- "learning_rate": 0.0002,
368
- "loss": 2.0053,
369
- "step": 600
370
- },
371
- {
372
- "epoch": 0.54,
373
- "learning_rate": 0.0002,
374
- "loss": 1.5491,
375
- "step": 610
376
- },
377
- {
378
- "epoch": 0.55,
379
- "learning_rate": 0.0002,
380
- "loss": 1.6077,
381
- "step": 620
382
- },
383
- {
384
- "epoch": 0.56,
385
- "learning_rate": 0.0002,
386
- "loss": 1.6346,
387
- "step": 630
388
- },
389
- {
390
- "epoch": 0.57,
391
- "learning_rate": 0.0002,
392
- "loss": 1.9414,
393
- "step": 640
394
- },
395
- {
396
- "epoch": 0.58,
397
- "learning_rate": 0.0002,
398
- "loss": 2.1672,
399
- "step": 650
400
- },
401
- {
402
- "epoch": 0.59,
403
- "learning_rate": 0.0002,
404
- "loss": 1.5987,
405
- "step": 660
406
- },
407
- {
408
- "epoch": 0.6,
409
- "learning_rate": 0.0002,
410
- "loss": 1.5833,
411
- "step": 670
412
- },
413
- {
414
- "epoch": 0.61,
415
- "learning_rate": 0.0002,
416
- "loss": 1.5564,
417
- "step": 680
418
- },
419
- {
420
- "epoch": 0.61,
421
- "learning_rate": 0.0002,
422
- "loss": 1.8669,
423
- "step": 690
424
- },
425
- {
426
- "epoch": 0.62,
427
- "learning_rate": 0.0002,
428
- "loss": 2.1056,
429
- "step": 700
430
- },
431
- {
432
- "epoch": 0.63,
433
- "learning_rate": 0.0002,
434
- "loss": 1.5699,
435
- "step": 710
436
- },
437
- {
438
- "epoch": 0.64,
439
- "learning_rate": 0.0002,
440
- "loss": 1.6089,
441
- "step": 720
442
- },
443
- {
444
- "epoch": 0.65,
445
- "learning_rate": 0.0002,
446
- "loss": 1.6524,
447
- "step": 730
448
- },
449
- {
450
- "epoch": 0.66,
451
- "learning_rate": 0.0002,
452
- "loss": 1.821,
453
- "step": 740
454
- },
455
- {
456
- "epoch": 0.67,
457
- "learning_rate": 0.0002,
458
- "loss": 2.0973,
459
- "step": 750
460
- },
461
- {
462
- "epoch": 0.68,
463
- "learning_rate": 0.0002,
464
- "loss": 1.5607,
465
- "step": 760
466
- },
467
- {
468
- "epoch": 0.69,
469
- "learning_rate": 0.0002,
470
- "loss": 1.5428,
471
- "step": 770
472
- },
473
- {
474
- "epoch": 0.69,
475
- "learning_rate": 0.0002,
476
- "loss": 1.5836,
477
- "step": 780
478
- },
479
- {
480
- "epoch": 0.7,
481
- "learning_rate": 0.0002,
482
- "loss": 1.9913,
483
- "step": 790
484
- },
485
- {
486
- "epoch": 0.71,
487
- "learning_rate": 0.0002,
488
- "loss": 1.9762,
489
- "step": 800
490
- },
491
- {
492
- "epoch": 0.72,
493
- "learning_rate": 0.0002,
494
- "loss": 1.5603,
495
- "step": 810
496
- },
497
- {
498
- "epoch": 0.73,
499
- "learning_rate": 0.0002,
500
- "loss": 1.591,
501
- "step": 820
502
- },
503
- {
504
- "epoch": 0.74,
505
- "learning_rate": 0.0002,
506
- "loss": 1.486,
507
- "step": 830
508
- },
509
- {
510
- "epoch": 0.75,
511
- "learning_rate": 0.0002,
512
- "loss": 1.8912,
513
- "step": 840
514
- },
515
- {
516
- "epoch": 0.76,
517
- "learning_rate": 0.0002,
518
- "loss": 1.9843,
519
- "step": 850
520
- },
521
- {
522
- "epoch": 0.77,
523
- "learning_rate": 0.0002,
524
- "loss": 1.6012,
525
- "step": 860
526
- },
527
- {
528
- "epoch": 0.77,
529
- "learning_rate": 0.0002,
530
- "loss": 1.6078,
531
- "step": 870
532
- },
533
- {
534
- "epoch": 0.78,
535
- "learning_rate": 0.0002,
536
- "loss": 1.587,
537
- "step": 880
538
- },
539
- {
540
- "epoch": 0.79,
541
- "learning_rate": 0.0002,
542
- "loss": 1.9116,
543
- "step": 890
544
- },
545
- {
546
- "epoch": 0.8,
547
- "learning_rate": 0.0002,
548
- "loss": 2.0363,
549
- "step": 900
550
- },
551
- {
552
- "epoch": 0.81,
553
- "learning_rate": 0.0002,
554
- "loss": 1.5466,
555
- "step": 910
556
- },
557
- {
558
- "epoch": 0.82,
559
- "learning_rate": 0.0002,
560
- "loss": 1.604,
561
- "step": 920
562
- },
563
- {
564
- "epoch": 0.83,
565
- "learning_rate": 0.0002,
566
- "loss": 1.6372,
567
- "step": 930
568
- },
569
- {
570
- "epoch": 0.84,
571
- "learning_rate": 0.0002,
572
- "loss": 1.9387,
573
- "step": 940
574
- },
575
- {
576
- "epoch": 0.85,
577
- "learning_rate": 0.0002,
578
- "loss": 1.9897,
579
- "step": 950
580
- },
581
- {
582
- "epoch": 0.85,
583
- "learning_rate": 0.0002,
584
- "loss": 1.5116,
585
- "step": 960
586
- }
587
- ],
588
- "logging_steps": 10,
589
- "max_steps": 1000,
590
- "num_input_tokens_seen": 0,
591
- "num_train_epochs": 1,
592
- "save_steps": 10,
593
- "total_flos": 4.998476659212288e+16,
594
- "train_batch_size": 4,
595
- "trial_name": null,
596
- "trial_params": null
597
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
checkpoint-960/checkpoint-960/trainer_state.json:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/training_args.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:4176ab35784e945d30c8bfe54747313b50577ba0295d87426a328dc2f10a584d
3
- size 4728
 
 
 
 
checkpoint-960/checkpoint-960/training_args.bin:Zone.Identifier DELETED
File without changes
checkpoint-960/checkpoint-960/vocab.json DELETED
The diff for this file is too large to render. See raw diff
 
checkpoint-960/checkpoint-960/vocab.json:Zone.Identifier DELETED
File without changes