Hugging Face's logo

eageringdev
/
d80f5ece-2ead-4ecf-9c97-01e3f6e0c4ca

PEFT
Safetensors
qwen2
axolotl
Generated from Trainer
Model card Files
xet
Community
eageringdev commited on
Commit
9405ef3
·
verified ·
1 Parent(s): f497e33

Training in progress, step 371, checkpoint

Browse files
Files changed (14) hide show
  1. last-checkpoint/README.md +202 -0
  2. last-checkpoint/adapter_config.json +34 -0
  3. last-checkpoint/adapter_model.safetensors +3 -0
  4. last-checkpoint/added_tokens.json +24 -0
  5. last-checkpoint/merges.txt +0 -0
  6. last-checkpoint/optimizer.pt +3 -0
  7. last-checkpoint/rng_state.pth +3 -0
  8. last-checkpoint/scheduler.pt +3 -0
  9. last-checkpoint/special_tokens_map.json +31 -0
  10. last-checkpoint/tokenizer.json +3 -0
  11. last-checkpoint/tokenizer_config.json +209 -0
  12. last-checkpoint/trainer_state.json +2630 -0
  13. last-checkpoint/training_args.bin +3 -0
  14. last-checkpoint/vocab.json +0 -0
last-checkpoint/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/Qwen2.5-3B
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.13.2
last-checkpoint/adapter_config.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "unsloth/Qwen2.5-3B",
5
+ "bias": "none",
6
+ "fan_in_fan_out": null,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 16,
14
+ "lora_dropout": 0.05,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 8,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "o_proj",
24
+ "k_proj",
25
+ "q_proj",
26
+ "gate_proj",
27
+ "down_proj",
28
+ "up_proj",
29
+ "v_proj"
30
+ ],
31
+ "task_type": "CAUSAL_LM",
32
+ "use_dora": false,
33
+ "use_rslora": false
34
+ }
last-checkpoint/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4c08492ff7f3f6dfa7b63df2955220e44f3874a802429e39a1add1eaa0bfde9
3
+ size 59933632
last-checkpoint/added_tokens.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</tool_call>": 151658,
3
+ "<tool_call>": 151657,
4
+ "<|box_end|>": 151649,
5
+ "<|box_start|>": 151648,
6
+ "<|endoftext|>": 151643,
7
+ "<|file_sep|>": 151664,
8
+ "<|fim_middle|>": 151660,
9
+ "<|fim_pad|>": 151662,
10
+ "<|fim_prefix|>": 151659,
11
+ "<|fim_suffix|>": 151661,
12
+ "<|im_end|>": 151645,
13
+ "<|im_start|>": 151644,
14
+ "<|image_pad|>": 151655,
15
+ "<|object_ref_end|>": 151647,
16
+ "<|object_ref_start|>": 151646,
17
+ "<|quad_end|>": 151651,
18
+ "<|quad_start|>": 151650,
19
+ "<|repo_name|>": 151663,
20
+ "<|video_pad|>": 151656,
21
+ "<|vision_end|>": 151653,
22
+ "<|vision_pad|>": 151654,
23
+ "<|vision_start|>": 151652
24
+ }
last-checkpoint/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
last-checkpoint/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e88a0264b8ef796e023e32684dc4256b38a370a12ae1783bf59cb4c1c17de7a4
3
+ size 31823460
last-checkpoint/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:217c65e4884f63d2b6ca1d3588fd96df189313c63e99a665276cd6f66569b317
3
+ size 14244
last-checkpoint/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac9f923af3a51a5565dcfd7260cd469b37e8c12e6c629e14c431ce23782c9704
3
+ size 1064
last-checkpoint/special_tokens_map.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|endoftext|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": {
25
+ "content": "<|vision_pad|>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ }
last-checkpoint/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
3
+ size 11421896
last-checkpoint/tokenizer_config.json ADDED
@@ -0,0 +1,209 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ }
181
+ },
182
+ "additional_special_tokens": [
183
+ "<|im_start|>",
184
+ "<|im_end|>",
185
+ "<|object_ref_start|>",
186
+ "<|object_ref_end|>",
187
+ "<|box_start|>",
188
+ "<|box_end|>",
189
+ "<|quad_start|>",
190
+ "<|quad_end|>",
191
+ "<|vision_start|>",
192
+ "<|vision_end|>",
193
+ "<|vision_pad|>",
194
+ "<|image_pad|>",
195
+ "<|video_pad|>"
196
+ ],
197
+ "bos_token": null,
198
+ "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% set loop_messages = messages %}{% for message in loop_messages %}{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n'+ message['content'] | trim + '<|eot_id|>' %}{% if loop.index0 == 0 %}{% set content = bos_token + content %}{% endif %}{{ content }}{% endfor %}{% if add_generation_prompt %}{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}{% endif %}",
199
+ "clean_up_tokenization_spaces": false,
200
+ "eos_token": "<|endoftext|>",
201
+ "errors": "replace",
202
+ "extra_special_tokens": {},
203
+ "model_max_length": 32768,
204
+ "pad_token": "<|vision_pad|>",
205
+ "padding_side": "left",
206
+ "split_special_tokens": false,
207
+ "tokenizer_class": "Qwen2Tokenizer",
208
+ "unk_token": null
209
+ }
last-checkpoint/trainer_state.json ADDED
@@ -0,0 +1,2630 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 0.14363143631436315,
5
+ "eval_steps": 500,
6
+ "global_step": 371,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.00038714672861014324,
13
+ "grad_norm": 0.048257023096084595,
14
+ "learning_rate": 2e-05,
15
+ "loss": 0.0394,
16
+ "step": 1
17
+ },
18
+ {
19
+ "epoch": 0.0007742934572202865,
20
+ "grad_norm": 0.048200540244579315,
21
+ "learning_rate": 4e-05,
22
+ "loss": 0.048,
23
+ "step": 2
24
+ },
25
+ {
26
+ "epoch": 0.0011614401858304297,
27
+ "grad_norm": 0.10289892554283142,
28
+ "learning_rate": 6e-05,
29
+ "loss": 0.0864,
30
+ "step": 3
31
+ },
32
+ {
33
+ "epoch": 0.001548586914440573,
34
+ "grad_norm": 0.10379760712385178,
35
+ "learning_rate": 8e-05,
36
+ "loss": 0.0887,
37
+ "step": 4
38
+ },
39
+ {
40
+ "epoch": 0.0019357336430507162,
41
+ "grad_norm": 0.14089909195899963,
42
+ "learning_rate": 0.0001,
43
+ "loss": 0.1072,
44
+ "step": 5
45
+ },
46
+ {
47
+ "epoch": 0.0023228803716608595,
48
+ "grad_norm": 0.16513778269290924,
49
+ "learning_rate": 9.999988720152121e-05,
50
+ "loss": 0.1346,
51
+ "step": 6
52
+ },
53
+ {
54
+ "epoch": 0.0027100271002710027,
55
+ "grad_norm": 0.17860881984233856,
56
+ "learning_rate": 9.999954880659377e-05,
57
+ "loss": 0.1306,
58
+ "step": 7
59
+ },
60
+ {
61
+ "epoch": 0.003097173828881146,
62
+ "grad_norm": 0.2414817363023758,
63
+ "learning_rate": 9.999898481674448e-05,
64
+ "loss": 0.1593,
65
+ "step": 8
66
+ },
67
+ {
68
+ "epoch": 0.003484320557491289,
69
+ "grad_norm": 0.2995632588863373,
70
+ "learning_rate": 9.999819523451806e-05,
71
+ "loss": 0.1684,
72
+ "step": 9
73
+ },
74
+ {
75
+ "epoch": 0.0038714672861014324,
76
+ "grad_norm": 0.2831806242465973,
77
+ "learning_rate": 9.999718006347704e-05,
78
+ "loss": 0.1538,
79
+ "step": 10
80
+ },
81
+ {
82
+ "epoch": 0.004258614014711576,
83
+ "grad_norm": 0.3746040463447571,
84
+ "learning_rate": 9.999593930820181e-05,
85
+ "loss": 0.1573,
86
+ "step": 11
87
+ },
88
+ {
89
+ "epoch": 0.004645760743321719,
90
+ "grad_norm": 0.5143625736236572,
91
+ "learning_rate": 9.999447297429058e-05,
92
+ "loss": 0.1596,
93
+ "step": 12
94
+ },
95
+ {
96
+ "epoch": 0.005032907471931862,
97
+ "grad_norm": 0.5252905488014221,
98
+ "learning_rate": 9.999278106835936e-05,
99
+ "loss": 0.1503,
100
+ "step": 13
101
+ },
102
+ {
103
+ "epoch": 0.005420054200542005,
104
+ "grad_norm": 0.43592771887779236,
105
+ "learning_rate": 9.999086359804195e-05,
106
+ "loss": 0.1396,
107
+ "step": 14
108
+ },
109
+ {
110
+ "epoch": 0.005807200929152149,
111
+ "grad_norm": 0.7996945381164551,
112
+ "learning_rate": 9.998872057198982e-05,
113
+ "loss": 0.1226,
114
+ "step": 15
115
+ },
116
+ {
117
+ "epoch": 0.006194347657762292,
118
+ "grad_norm": 0.8167794942855835,
119
+ "learning_rate": 9.998635199987219e-05,
120
+ "loss": 0.1368,
121
+ "step": 16
122
+ },
123
+ {
124
+ "epoch": 0.006581494386372435,
125
+ "grad_norm": 0.8105260729789734,
126
+ "learning_rate": 9.998375789237593e-05,
127
+ "loss": 0.1199,
128
+ "step": 17
129
+ },
130
+ {
131
+ "epoch": 0.006968641114982578,
132
+ "grad_norm": 0.7661561369895935,
133
+ "learning_rate": 9.998093826120548e-05,
134
+ "loss": 0.1011,
135
+ "step": 18
136
+ },
137
+ {
138
+ "epoch": 0.007355787843592722,
139
+ "grad_norm": 0.6599623560905457,
140
+ "learning_rate": 9.997789311908284e-05,
141
+ "loss": 0.0966,
142
+ "step": 19
143
+ },
144
+ {
145
+ "epoch": 0.007742934572202865,
146
+ "grad_norm": 0.8486294150352478,
147
+ "learning_rate": 9.997462247974752e-05,
148
+ "loss": 0.0979,
149
+ "step": 20
150
+ },
151
+ {
152
+ "epoch": 0.008130081300813009,
153
+ "grad_norm": 0.6950157284736633,
154
+ "learning_rate": 9.997112635795643e-05,
155
+ "loss": 0.0894,
156
+ "step": 21
157
+ },
158
+ {
159
+ "epoch": 0.008517228029423151,
160
+ "grad_norm": 0.4815932512283325,
161
+ "learning_rate": 9.996740476948385e-05,
162
+ "loss": 0.0649,
163
+ "step": 22
164
+ },
165
+ {
166
+ "epoch": 0.008904374758033295,
167
+ "grad_norm": 0.41461682319641113,
168
+ "learning_rate": 9.996345773112139e-05,
169
+ "loss": 0.0704,
170
+ "step": 23
171
+ },
172
+ {
173
+ "epoch": 0.009291521486643438,
174
+ "grad_norm": 0.42949068546295166,
175
+ "learning_rate": 9.995928526067784e-05,
176
+ "loss": 0.0715,
177
+ "step": 24
178
+ },
179
+ {
180
+ "epoch": 0.009678668215253582,
181
+ "grad_norm": 0.3920012414455414,
182
+ "learning_rate": 9.99548873769791e-05,
183
+ "loss": 0.048,
184
+ "step": 25
185
+ },
186
+ {
187
+ "epoch": 0.010065814943863724,
188
+ "grad_norm": 0.261152058839798,
189
+ "learning_rate": 9.995026409986821e-05,
190
+ "loss": 0.0343,
191
+ "step": 26
192
+ },
193
+ {
194
+ "epoch": 0.010452961672473868,
195
+ "grad_norm": 0.3788264989852905,
196
+ "learning_rate": 9.994541545020509e-05,
197
+ "loss": 0.0403,
198
+ "step": 27
199
+ },
200
+ {
201
+ "epoch": 0.01084010840108401,
202
+ "grad_norm": 0.8691251873970032,
203
+ "learning_rate": 9.994034144986653e-05,
204
+ "loss": 0.063,
205
+ "step": 28
206
+ },
207
+ {
208
+ "epoch": 0.011227255129694155,
209
+ "grad_norm": 0.5656071305274963,
210
+ "learning_rate": 9.993504212174613e-05,
211
+ "loss": 0.0415,
212
+ "step": 29
213
+ },
214
+ {
215
+ "epoch": 0.011614401858304297,
216
+ "grad_norm": 0.42919209599494934,
217
+ "learning_rate": 9.992951748975412e-05,
218
+ "loss": 0.0229,
219
+ "step": 30
220
+ },
221
+ {
222
+ "epoch": 0.012001548586914441,
223
+ "grad_norm": 0.46598193049430847,
224
+ "learning_rate": 9.992376757881735e-05,
225
+ "loss": 0.0208,
226
+ "step": 31
227
+ },
228
+ {
229
+ "epoch": 0.012388695315524584,
230
+ "grad_norm": 0.5426745414733887,
231
+ "learning_rate": 9.991779241487899e-05,
232
+ "loss": 0.0188,
233
+ "step": 32
234
+ },
235
+ {
236
+ "epoch": 0.012775842044134728,
237
+ "grad_norm": 0.8520743250846863,
238
+ "learning_rate": 9.991159202489871e-05,
239
+ "loss": 0.0278,
240
+ "step": 33
241
+ },
242
+ {
243
+ "epoch": 0.01316298877274487,
244
+ "grad_norm": 0.6999525427818298,
245
+ "learning_rate": 9.990516643685222e-05,
246
+ "loss": 0.0145,
247
+ "step": 34
248
+ },
249
+ {
250
+ "epoch": 0.013550135501355014,
251
+ "grad_norm": 1.101209282875061,
252
+ "learning_rate": 9.989851567973139e-05,
253
+ "loss": 0.0096,
254
+ "step": 35
255
+ },
256
+ {
257
+ "epoch": 0.013937282229965157,
258
+ "grad_norm": 1.42173433303833,
259
+ "learning_rate": 9.989163978354408e-05,
260
+ "loss": 0.01,
261
+ "step": 36
262
+ },
263
+ {
264
+ "epoch": 0.014324428958575301,
265
+ "grad_norm": 0.1809816062450409,
266
+ "learning_rate": 9.988453877931386e-05,
267
+ "loss": 0.0026,
268
+ "step": 37
269
+ },
270
+ {
271
+ "epoch": 0.014711575687185443,
272
+ "grad_norm": 0.5789023637771606,
273
+ "learning_rate": 9.987721269908006e-05,
274
+ "loss": 0.0264,
275
+ "step": 38
276
+ },
277
+ {
278
+ "epoch": 0.015098722415795587,
279
+ "grad_norm": 1.4514374732971191,
280
+ "learning_rate": 9.98696615758975e-05,
281
+ "loss": 0.0197,
282
+ "step": 39
283
+ },
284
+ {
285
+ "epoch": 0.01548586914440573,
286
+ "grad_norm": 1.6745890378952026,
287
+ "learning_rate": 9.986188544383639e-05,
288
+ "loss": 0.0398,
289
+ "step": 40
290
+ },
291
+ {
292
+ "epoch": 0.015873015873015872,
293
+ "grad_norm": 0.31723207235336304,
294
+ "learning_rate": 9.985388433798215e-05,
295
+ "loss": 0.0207,
296
+ "step": 41
297
+ },
298
+ {
299
+ "epoch": 0.016260162601626018,
300
+ "grad_norm": 0.8627777695655823,
301
+ "learning_rate": 9.984565829443531e-05,
302
+ "loss": 0.0182,
303
+ "step": 42
304
+ },
305
+ {
306
+ "epoch": 0.01664730933023616,
307
+ "grad_norm": 0.023634975776076317,
308
+ "learning_rate": 9.983720735031125e-05,
309
+ "loss": 0.0004,
310
+ "step": 43
311
+ },
312
+ {
313
+ "epoch": 0.017034456058846303,
314
+ "grad_norm": 0.45953628420829773,
315
+ "learning_rate": 9.982853154374014e-05,
316
+ "loss": 0.0111,
317
+ "step": 44
318
+ },
319
+ {
320
+ "epoch": 0.017421602787456445,
321
+ "grad_norm": 0.2831597328186035,
322
+ "learning_rate": 9.98196309138667e-05,
323
+ "loss": 0.0109,
324
+ "step": 45
325
+ },
326
+ {
327
+ "epoch": 0.01780874951606659,
328
+ "grad_norm": 0.7697696089744568,
329
+ "learning_rate": 9.981050550084998e-05,
330
+ "loss": 0.0427,
331
+ "step": 46
332
+ },
333
+ {
334
+ "epoch": 0.018195896244676733,
335
+ "grad_norm": 0.5054185390472412,
336
+ "learning_rate": 9.980115534586335e-05,
337
+ "loss": 0.0093,
338
+ "step": 47
339
+ },
340
+ {
341
+ "epoch": 0.018583042973286876,
342
+ "grad_norm": 0.16788819432258606,
343
+ "learning_rate": 9.979158049109407e-05,
344
+ "loss": 0.0024,
345
+ "step": 48
346
+ },
347
+ {
348
+ "epoch": 0.018970189701897018,
349
+ "grad_norm": 2.8662874698638916,
350
+ "learning_rate": 9.978178097974337e-05,
351
+ "loss": 0.0919,
352
+ "step": 49
353
+ },
354
+ {
355
+ "epoch": 0.019357336430507164,
356
+ "grad_norm": 2.2201218605041504,
357
+ "learning_rate": 9.977175685602602e-05,
358
+ "loss": 0.2433,
359
+ "step": 50
360
+ },
361
+ {
362
+ "epoch": 0.019744483159117306,
363
+ "grad_norm": 0.08052156120538712,
364
+ "learning_rate": 9.976150816517024e-05,
365
+ "loss": 0.0113,
366
+ "step": 51
367
+ },
368
+ {
369
+ "epoch": 0.02013162988772745,
370
+ "grad_norm": 0.10142353922128677,
371
+ "learning_rate": 9.975103495341753e-05,
372
+ "loss": 0.0095,
373
+ "step": 52
374
+ },
375
+ {
376
+ "epoch": 0.02051877661633759,
377
+ "grad_norm": 0.14654894173145294,
378
+ "learning_rate": 9.974033726802237e-05,
379
+ "loss": 0.0141,
380
+ "step": 53
381
+ },
382
+ {
383
+ "epoch": 0.020905923344947737,
384
+ "grad_norm": 0.19414274394512177,
385
+ "learning_rate": 9.972941515725206e-05,
386
+ "loss": 0.0129,
387
+ "step": 54
388
+ },
389
+ {
390
+ "epoch": 0.02129307007355788,
391
+ "grad_norm": 0.24451220035552979,
392
+ "learning_rate": 9.971826867038651e-05,
393
+ "loss": 0.0141,
394
+ "step": 55
395
+ },
396
+ {
397
+ "epoch": 0.02168021680216802,
398
+ "grad_norm": 0.1221214234828949,
399
+ "learning_rate": 9.970689785771798e-05,
400
+ "loss": 0.0025,
401
+ "step": 56
402
+ },
403
+ {
404
+ "epoch": 0.022067363530778164,
405
+ "grad_norm": 0.4560745656490326,
406
+ "learning_rate": 9.96953027705509e-05,
407
+ "loss": 0.0127,
408
+ "step": 57
409
+ },
410
+ {
411
+ "epoch": 0.02245451025938831,
412
+ "grad_norm": 0.2530369758605957,
413
+ "learning_rate": 9.968348346120159e-05,
414
+ "loss": 0.0148,
415
+ "step": 58
416
+ },
417
+ {
418
+ "epoch": 0.022841656987998452,
419
+ "grad_norm": 0.7455848455429077,
420
+ "learning_rate": 9.967143998299803e-05,
421
+ "loss": 0.0069,
422
+ "step": 59
423
+ },
424
+ {
425
+ "epoch": 0.023228803716608595,
426
+ "grad_norm": 0.10115598142147064,
427
+ "learning_rate": 9.965917239027972e-05,
428
+ "loss": 0.0094,
429
+ "step": 60
430
+ },
431
+ {
432
+ "epoch": 0.023615950445218737,
433
+ "grad_norm": 0.15474660694599152,
434
+ "learning_rate": 9.964668073839724e-05,
435
+ "loss": 0.0079,
436
+ "step": 61
437
+ },
438
+ {
439
+ "epoch": 0.024003097173828883,
440
+ "grad_norm": 0.020637422800064087,
441
+ "learning_rate": 9.963396508371218e-05,
442
+ "loss": 0.0004,
443
+ "step": 62
444
+ },
445
+ {
446
+ "epoch": 0.024390243902439025,
447
+ "grad_norm": 0.14796803891658783,
448
+ "learning_rate": 9.96210254835968e-05,
449
+ "loss": 0.001,
450
+ "step": 63
451
+ },
452
+ {
453
+ "epoch": 0.024777390631049168,
454
+ "grad_norm": 0.28956761956214905,
455
+ "learning_rate": 9.960786199643377e-05,
456
+ "loss": 0.0013,
457
+ "step": 64
458
+ },
459
+ {
460
+ "epoch": 0.02516453735965931,
461
+ "grad_norm": 0.020133867859840393,
462
+ "learning_rate": 9.959447468161598e-05,
463
+ "loss": 0.0002,
464
+ "step": 65
465
+ },
466
+ {
467
+ "epoch": 0.025551684088269456,
468
+ "grad_norm": 0.43387070298194885,
469
+ "learning_rate": 9.958086359954616e-05,
470
+ "loss": 0.0038,
471
+ "step": 66
472
+ },
473
+ {
474
+ "epoch": 0.025938830816879598,
475
+ "grad_norm": 0.12942586839199066,
476
+ "learning_rate": 9.956702881163669e-05,
477
+ "loss": 0.0018,
478
+ "step": 67
479
+ },
480
+ {
481
+ "epoch": 0.02632597754548974,
482
+ "grad_norm": 0.24969282746315002,
483
+ "learning_rate": 9.955297038030927e-05,
484
+ "loss": 0.0067,
485
+ "step": 68
486
+ },
487
+ {
488
+ "epoch": 0.026713124274099883,
489
+ "grad_norm": 0.06376656889915466,
490
+ "learning_rate": 9.953868836899472e-05,
491
+ "loss": 0.0008,
492
+ "step": 69
493
+ },
494
+ {
495
+ "epoch": 0.02710027100271003,
496
+ "grad_norm": 0.03575746715068817,
497
+ "learning_rate": 9.952418284213257e-05,
498
+ "loss": 0.0009,
499
+ "step": 70
500
+ },
501
+ {
502
+ "epoch": 0.02748741773132017,
503
+ "grad_norm": 0.19091981649398804,
504
+ "learning_rate": 9.95094538651709e-05,
505
+ "loss": 0.0046,
506
+ "step": 71
507
+ },
508
+ {
509
+ "epoch": 0.027874564459930314,
510
+ "grad_norm": 0.03124951757490635,
511
+ "learning_rate": 9.949450150456596e-05,
512
+ "loss": 0.0005,
513
+ "step": 72
514
+ },
515
+ {
516
+ "epoch": 0.028261711188540456,
517
+ "grad_norm": 0.10794883221387863,
518
+ "learning_rate": 9.947932582778188e-05,
519
+ "loss": 0.0009,
520
+ "step": 73
521
+ },
522
+ {
523
+ "epoch": 0.028648857917150602,
524
+ "grad_norm": 0.054995935410261154,
525
+ "learning_rate": 9.946392690329039e-05,
526
+ "loss": 0.0006,
527
+ "step": 74
528
+ },
529
+ {
530
+ "epoch": 0.029036004645760744,
531
+ "grad_norm": 0.12434786558151245,
532
+ "learning_rate": 9.944830480057049e-05,
533
+ "loss": 0.0015,
534
+ "step": 75
535
+ },
536
+ {
537
+ "epoch": 0.029423151374370887,
538
+ "grad_norm": 0.36718836426734924,
539
+ "learning_rate": 9.943245959010819e-05,
540
+ "loss": 0.0123,
541
+ "step": 76
542
+ },
543
+ {
544
+ "epoch": 0.02981029810298103,
545
+ "grad_norm": 0.002867339877411723,
546
+ "learning_rate": 9.941639134339608e-05,
547
+ "loss": 0.0001,
548
+ "step": 77
549
+ },
550
+ {
551
+ "epoch": 0.030197444831591175,
552
+ "grad_norm": 0.02242063172161579,
553
+ "learning_rate": 9.940010013293313e-05,
554
+ "loss": 0.0003,
555
+ "step": 78
556
+ },
557
+ {
558
+ "epoch": 0.030584591560201317,
559
+ "grad_norm": 0.6994889378547668,
560
+ "learning_rate": 9.938358603222429e-05,
561
+ "loss": 0.005,
562
+ "step": 79
563
+ },
564
+ {
565
+ "epoch": 0.03097173828881146,
566
+ "grad_norm": 0.06029118597507477,
567
+ "learning_rate": 9.936684911578018e-05,
568
+ "loss": 0.0009,
569
+ "step": 80
570
+ },
571
+ {
572
+ "epoch": 0.0313588850174216,
573
+ "grad_norm": 0.43654757738113403,
574
+ "learning_rate": 9.934988945911674e-05,
575
+ "loss": 0.0041,
576
+ "step": 81
577
+ },
578
+ {
579
+ "epoch": 0.031746031746031744,
580
+ "grad_norm": 1.1972216367721558,
581
+ "learning_rate": 9.93327071387549e-05,
582
+ "loss": 0.0098,
583
+ "step": 82
584
+ },
585
+ {
586
+ "epoch": 0.03213317847464189,
587
+ "grad_norm": 0.008753047324717045,
588
+ "learning_rate": 9.931530223222027e-05,
589
+ "loss": 0.0001,
590
+ "step": 83
591
+ },
592
+ {
593
+ "epoch": 0.032520325203252036,
594
+ "grad_norm": 0.019141845405101776,
595
+ "learning_rate": 9.929767481804271e-05,
596
+ "loss": 0.0003,
597
+ "step": 84
598
+ },
599
+ {
600
+ "epoch": 0.03290747193186218,
601
+ "grad_norm": 0.13906456530094147,
602
+ "learning_rate": 9.927982497575605e-05,
603
+ "loss": 0.0017,
604
+ "step": 85
605
+ },
606
+ {
607
+ "epoch": 0.03329461866047232,
608
+ "grad_norm": 0.018300075083971024,
609
+ "learning_rate": 9.926175278589769e-05,
610
+ "loss": 0.0004,
611
+ "step": 86
612
+ },
613
+ {
614
+ "epoch": 0.03368176538908246,
615
+ "grad_norm": 0.4637622535228729,
616
+ "learning_rate": 9.924345833000824e-05,
617
+ "loss": 0.0056,
618
+ "step": 87
619
+ },
620
+ {
621
+ "epoch": 0.034068912117692605,
622
+ "grad_norm": 0.00441858172416687,
623
+ "learning_rate": 9.922494169063119e-05,
624
+ "loss": 0.0001,
625
+ "step": 88
626
+ },
627
+ {
628
+ "epoch": 0.03445605884630275,
629
+ "grad_norm": 0.0403720885515213,
630
+ "learning_rate": 9.920620295131247e-05,
631
+ "loss": 0.0007,
632
+ "step": 89
633
+ },
634
+ {
635
+ "epoch": 0.03484320557491289,
636
+ "grad_norm": 0.17813202738761902,
637
+ "learning_rate": 9.918724219660013e-05,
638
+ "loss": 0.0015,
639
+ "step": 90
640
+ },
641
+ {
642
+ "epoch": 0.03523035230352303,
643
+ "grad_norm": 0.058298081159591675,
644
+ "learning_rate": 9.916805951204397e-05,
645
+ "loss": 0.0004,
646
+ "step": 91
647
+ },
648
+ {
649
+ "epoch": 0.03561749903213318,
650
+ "grad_norm": 0.29420581459999084,
651
+ "learning_rate": 9.91486549841951e-05,
652
+ "loss": 0.0176,
653
+ "step": 92
654
+ },
655
+ {
656
+ "epoch": 0.036004645760743324,
657
+ "grad_norm": 0.005454974714666605,
658
+ "learning_rate": 9.912902870060552e-05,
659
+ "loss": 0.0001,
660
+ "step": 93
661
+ },
662
+ {
663
+ "epoch": 0.03639179248935347,
664
+ "grad_norm": 0.01605985127389431,
665
+ "learning_rate": 9.910918074982787e-05,
666
+ "loss": 0.0002,
667
+ "step": 94
668
+ },
669
+ {
670
+ "epoch": 0.03677893921796361,
671
+ "grad_norm": 0.08237680792808533,
672
+ "learning_rate": 9.908911122141486e-05,
673
+ "loss": 0.0011,
674
+ "step": 95
675
+ },
676
+ {
677
+ "epoch": 0.03716608594657375,
678
+ "grad_norm": 0.6426149606704712,
679
+ "learning_rate": 9.906882020591903e-05,
680
+ "loss": 0.0214,
681
+ "step": 96
682
+ },
683
+ {
684
+ "epoch": 0.037553232675183894,
685
+ "grad_norm": 0.21502873301506042,
686
+ "learning_rate": 9.904830779489216e-05,
687
+ "loss": 0.0019,
688
+ "step": 97
689
+ },
690
+ {
691
+ "epoch": 0.037940379403794036,
692
+ "grad_norm": 0.7887445092201233,
693
+ "learning_rate": 9.902757408088503e-05,
694
+ "loss": 0.0369,
695
+ "step": 98
696
+ },
697
+ {
698
+ "epoch": 0.03832752613240418,
699
+ "grad_norm": 0.013632730580866337,
700
+ "learning_rate": 9.900661915744689e-05,
701
+ "loss": 0.0001,
702
+ "step": 99
703
+ },
704
+ {
705
+ "epoch": 0.03871467286101433,
706
+ "grad_norm": 5.337656021118164,
707
+ "learning_rate": 9.898544311912508e-05,
708
+ "loss": 0.163,
709
+ "step": 100
710
+ },
711
+ {
712
+ "epoch": 0.03910181958962447,
713
+ "grad_norm": 0.07259741425514221,
714
+ "learning_rate": 9.896404606146456e-05,
715
+ "loss": 0.0103,
716
+ "step": 101
717
+ },
718
+ {
719
+ "epoch": 0.03948896631823461,
720
+ "grad_norm": 0.1117100939154625,
721
+ "learning_rate": 9.894242808100762e-05,
722
+ "loss": 0.0058,
723
+ "step": 102
724
+ },
725
+ {
726
+ "epoch": 0.039876113046844755,
727
+ "grad_norm": 0.15869347751140594,
728
+ "learning_rate": 9.892058927529322e-05,
729
+ "loss": 0.009,
730
+ "step": 103
731
+ },
732
+ {
733
+ "epoch": 0.0402632597754549,
734
+ "grad_norm": 0.15626105666160583,
735
+ "learning_rate": 9.889852974285673e-05,
736
+ "loss": 0.0049,
737
+ "step": 104
738
+ },
739
+ {
740
+ "epoch": 0.04065040650406504,
741
+ "grad_norm": 0.20995132625102997,
742
+ "learning_rate": 9.887624958322946e-05,
743
+ "loss": 0.0105,
744
+ "step": 105
745
+ },
746
+ {
747
+ "epoch": 0.04103755323267518,
748
+ "grad_norm": 0.1864119917154312,
749
+ "learning_rate": 9.885374889693809e-05,
750
+ "loss": 0.0128,
751
+ "step": 106
752
+ },
753
+ {
754
+ "epoch": 0.041424699961285325,
755
+ "grad_norm": 0.16312390565872192,
756
+ "learning_rate": 9.883102778550434e-05,
757
+ "loss": 0.0106,
758
+ "step": 107
759
+ },
760
+ {
761
+ "epoch": 0.041811846689895474,
762
+ "grad_norm": 0.07751648128032684,
763
+ "learning_rate": 9.880808635144452e-05,
764
+ "loss": 0.0017,
765
+ "step": 108
766
+ },
767
+ {
768
+ "epoch": 0.042198993418505616,
769
+ "grad_norm": 0.014390280470252037,
770
+ "learning_rate": 9.878492469826896e-05,
771
+ "loss": 0.0003,
772
+ "step": 109
773
+ },
774
+ {
775
+ "epoch": 0.04258614014711576,
776
+ "grad_norm": 0.1289769858121872,
777
+ "learning_rate": 9.876154293048163e-05,
778
+ "loss": 0.0026,
779
+ "step": 110
780
+ },
781
+ {
782
+ "epoch": 0.0429732868757259,
783
+ "grad_norm": 0.25492918491363525,
784
+ "learning_rate": 9.873794115357966e-05,
785
+ "loss": 0.0093,
786
+ "step": 111
787
+ },
788
+ {
789
+ "epoch": 0.04336043360433604,
790
+ "grad_norm": 0.05008332058787346,
791
+ "learning_rate": 9.87141194740528e-05,
792
+ "loss": 0.0011,
793
+ "step": 112
794
+ },
795
+ {
796
+ "epoch": 0.043747580332946186,
797
+ "grad_norm": 0.24651627242565155,
798
+ "learning_rate": 9.869007799938305e-05,
799
+ "loss": 0.0034,
800
+ "step": 113
801
+ },
802
+ {
803
+ "epoch": 0.04413472706155633,
804
+ "grad_norm": 0.004503064788877964,
805
+ "learning_rate": 9.86658168380441e-05,
806
+ "loss": 0.0001,
807
+ "step": 114
808
+ },
809
+ {
810
+ "epoch": 0.04452187379016647,
811
+ "grad_norm": 0.02013341151177883,
812
+ "learning_rate": 9.864133609950078e-05,
813
+ "loss": 0.0003,
814
+ "step": 115
815
+ },
816
+ {
817
+ "epoch": 0.04490902051877662,
818
+ "grad_norm": 0.4879964590072632,
819
+ "learning_rate": 9.861663589420871e-05,
820
+ "loss": 0.019,
821
+ "step": 116
822
+ },
823
+ {
824
+ "epoch": 0.04529616724738676,
825
+ "grad_norm": 0.4585297405719757,
826
+ "learning_rate": 9.859171633361372e-05,
827
+ "loss": 0.022,
828
+ "step": 117
829
+ },
830
+ {
831
+ "epoch": 0.045683313975996905,
832
+ "grad_norm": 0.45999088883399963,
833
+ "learning_rate": 9.856657753015135e-05,
834
+ "loss": 0.0196,
835
+ "step": 118
836
+ },
837
+ {
838
+ "epoch": 0.04607046070460705,
839
+ "grad_norm": 0.15138907730579376,
840
+ "learning_rate": 9.854121959724636e-05,
841
+ "loss": 0.0004,
842
+ "step": 119
843
+ },
844
+ {
845
+ "epoch": 0.04645760743321719,
846
+ "grad_norm": 0.05731305480003357,
847
+ "learning_rate": 9.851564264931219e-05,
848
+ "loss": 0.0004,
849
+ "step": 120
850
+ },
851
+ {
852
+ "epoch": 0.04684475416182733,
853
+ "grad_norm": 0.6728512644767761,
854
+ "learning_rate": 9.848984680175049e-05,
855
+ "loss": 0.0094,
856
+ "step": 121
857
+ },
858
+ {
859
+ "epoch": 0.047231900890437474,
860
+ "grad_norm": 0.009215263649821281,
861
+ "learning_rate": 9.846383217095053e-05,
862
+ "loss": 0.0002,
863
+ "step": 122
864
+ },
865
+ {
866
+ "epoch": 0.047619047619047616,
867
+ "grad_norm": 0.006808656267821789,
868
+ "learning_rate": 9.843759887428873e-05,
869
+ "loss": 0.0001,
870
+ "step": 123
871
+ },
872
+ {
873
+ "epoch": 0.048006194347657766,
874
+ "grad_norm": 0.005876703653484583,
875
+ "learning_rate": 9.841114703012817e-05,
876
+ "loss": 0.0001,
877
+ "step": 124
878
+ },
879
+ {
880
+ "epoch": 0.04839334107626791,
881
+ "grad_norm": 0.019576961174607277,
882
+ "learning_rate": 9.838447675781794e-05,
883
+ "loss": 0.0003,
884
+ "step": 125
885
+ },
886
+ {
887
+ "epoch": 0.04878048780487805,
888
+ "grad_norm": 0.008768095634877682,
889
+ "learning_rate": 9.835758817769269e-05,
890
+ "loss": 0.0002,
891
+ "step": 126
892
+ },
893
+ {
894
+ "epoch": 0.04916763453348819,
895
+ "grad_norm": 0.023376451805233955,
896
+ "learning_rate": 9.833048141107203e-05,
897
+ "loss": 0.0004,
898
+ "step": 127
899
+ },
900
+ {
901
+ "epoch": 0.049554781262098335,
902
+ "grad_norm": 0.065276600420475,
903
+ "learning_rate": 9.830315658026011e-05,
904
+ "loss": 0.0008,
905
+ "step": 128
906
+ },
907
+ {
908
+ "epoch": 0.04994192799070848,
909
+ "grad_norm": 0.240321084856987,
910
+ "learning_rate": 9.827561380854482e-05,
911
+ "loss": 0.0014,
912
+ "step": 129
913
+ },
914
+ {
915
+ "epoch": 0.05032907471931862,
916
+ "grad_norm": 0.01600070670247078,
917
+ "learning_rate": 9.824785322019753e-05,
918
+ "loss": 0.0002,
919
+ "step": 130
920
+ },
921
+ {
922
+ "epoch": 0.05071622144792876,
923
+ "grad_norm": 0.009562276303768158,
924
+ "learning_rate": 9.821987494047229e-05,
925
+ "loss": 0.0003,
926
+ "step": 131
927
+ },
928
+ {
929
+ "epoch": 0.05110336817653891,
930
+ "grad_norm": 0.009312965907156467,
931
+ "learning_rate": 9.819167909560543e-05,
932
+ "loss": 0.0002,
933
+ "step": 132
934
+ },
935
+ {
936
+ "epoch": 0.051490514905149054,
937
+ "grad_norm": 0.016949571669101715,
938
+ "learning_rate": 9.816326581281485e-05,
939
+ "loss": 0.0003,
940
+ "step": 133
941
+ },
942
+ {
943
+ "epoch": 0.051877661633759196,
944
+ "grad_norm": 0.011933255940675735,
945
+ "learning_rate": 9.813463522029957e-05,
946
+ "loss": 0.0003,
947
+ "step": 134
948
+ },
949
+ {
950
+ "epoch": 0.05226480836236934,
951
+ "grad_norm": 0.03951014205813408,
952
+ "learning_rate": 9.810578744723911e-05,
953
+ "loss": 0.0007,
954
+ "step": 135
955
+ },
956
+ {
957
+ "epoch": 0.05265195509097948,
958
+ "grad_norm": 0.008960571140050888,
959
+ "learning_rate": 9.807672262379282e-05,
960
+ "loss": 0.0001,
961
+ "step": 136
962
+ },
963
+ {
964
+ "epoch": 0.053039101819589624,
965
+ "grad_norm": 0.1299860030412674,
966
+ "learning_rate": 9.804744088109943e-05,
967
+ "loss": 0.0038,
968
+ "step": 137
969
+ },
970
+ {
971
+ "epoch": 0.053426248548199766,
972
+ "grad_norm": 0.036717738956213,
973
+ "learning_rate": 9.801794235127636e-05,
974
+ "loss": 0.0004,
975
+ "step": 138
976
+ },
977
+ {
978
+ "epoch": 0.05381339527680991,
979
+ "grad_norm": 0.008997570723295212,
980
+ "learning_rate": 9.798822716741925e-05,
981
+ "loss": 0.0002,
982
+ "step": 139
983
+ },
984
+ {
985
+ "epoch": 0.05420054200542006,
986
+ "grad_norm": 0.03509435057640076,
987
+ "learning_rate": 9.795829546360114e-05,
988
+ "loss": 0.0005,
989
+ "step": 140
990
+ },
991
+ {
992
+ "epoch": 0.0545876887340302,
993
+ "grad_norm": 0.034250613301992416,
994
+ "learning_rate": 9.792814737487207e-05,
995
+ "loss": 0.0006,
996
+ "step": 141
997
+ },
998
+ {
999
+ "epoch": 0.05497483546264034,
1000
+ "grad_norm": 0.0243786983191967,
1001
+ "learning_rate": 9.789778303725838e-05,
1002
+ "loss": 0.0005,
1003
+ "step": 142
1004
+ },
1005
+ {
1006
+ "epoch": 0.055361982191250485,
1007
+ "grad_norm": 0.0226341113448143,
1008
+ "learning_rate": 9.786720258776213e-05,
1009
+ "loss": 0.0004,
1010
+ "step": 143
1011
+ },
1012
+ {
1013
+ "epoch": 0.05574912891986063,
1014
+ "grad_norm": 0.23691046237945557,
1015
+ "learning_rate": 9.783640616436044e-05,
1016
+ "loss": 0.0013,
1017
+ "step": 144
1018
+ },
1019
+ {
1020
+ "epoch": 0.05613627564847077,
1021
+ "grad_norm": 0.010031294077634811,
1022
+ "learning_rate": 9.780539390600489e-05,
1023
+ "loss": 0.0002,
1024
+ "step": 145
1025
+ },
1026
+ {
1027
+ "epoch": 0.05652342237708091,
1028
+ "grad_norm": 0.07630310952663422,
1029
+ "learning_rate": 9.777416595262091e-05,
1030
+ "loss": 0.0013,
1031
+ "step": 146
1032
+ },
1033
+ {
1034
+ "epoch": 0.056910569105691054,
1035
+ "grad_norm": 0.25514844059944153,
1036
+ "learning_rate": 9.774272244510712e-05,
1037
+ "loss": 0.0045,
1038
+ "step": 147
1039
+ },
1040
+ {
1041
+ "epoch": 0.057297715834301204,
1042
+ "grad_norm": 0.03640531376004219,
1043
+ "learning_rate": 9.771106352533472e-05,
1044
+ "loss": 0.0007,
1045
+ "step": 148
1046
+ },
1047
+ {
1048
+ "epoch": 0.057684862562911346,
1049
+ "grad_norm": 0.07202103734016418,
1050
+ "learning_rate": 9.767918933614682e-05,
1051
+ "loss": 0.0016,
1052
+ "step": 149
1053
+ },
1054
+ {
1055
+ "epoch": 0.05807200929152149,
1056
+ "grad_norm": 0.12926505506038666,
1057
+ "learning_rate": 9.764710002135784e-05,
1058
+ "loss": 0.0023,
1059
+ "step": 150
1060
+ },
1061
+ {
1062
+ "epoch": 0.05845915602013163,
1063
+ "grad_norm": 0.05395910516381264,
1064
+ "learning_rate": 9.761479572575279e-05,
1065
+ "loss": 0.0121,
1066
+ "step": 151
1067
+ },
1068
+ {
1069
+ "epoch": 0.05884630274874177,
1070
+ "grad_norm": 0.06644894927740097,
1071
+ "learning_rate": 9.75822765950867e-05,
1072
+ "loss": 0.0046,
1073
+ "step": 152
1074
+ },
1075
+ {
1076
+ "epoch": 0.059233449477351915,
1077
+ "grad_norm": 0.02791532874107361,
1078
+ "learning_rate": 9.754954277608391e-05,
1079
+ "loss": 0.0009,
1080
+ "step": 153
1081
+ },
1082
+ {
1083
+ "epoch": 0.05962059620596206,
1084
+ "grad_norm": 0.03686601668596268,
1085
+ "learning_rate": 9.751659441643742e-05,
1086
+ "loss": 0.0016,
1087
+ "step": 154
1088
+ },
1089
+ {
1090
+ "epoch": 0.0600077429345722,
1091
+ "grad_norm": 0.04866962507367134,
1092
+ "learning_rate": 9.748343166480823e-05,
1093
+ "loss": 0.0016,
1094
+ "step": 155
1095
+ },
1096
+ {
1097
+ "epoch": 0.06039488966318235,
1098
+ "grad_norm": 0.06715308874845505,
1099
+ "learning_rate": 9.745005467082464e-05,
1100
+ "loss": 0.0011,
1101
+ "step": 156
1102
+ },
1103
+ {
1104
+ "epoch": 0.06078203639179249,
1105
+ "grad_norm": 0.10314395278692245,
1106
+ "learning_rate": 9.741646358508164e-05,
1107
+ "loss": 0.0038,
1108
+ "step": 157
1109
+ },
1110
+ {
1111
+ "epoch": 0.061169183120402634,
1112
+ "grad_norm": 0.02877042070031166,
1113
+ "learning_rate": 9.738265855914013e-05,
1114
+ "loss": 0.0005,
1115
+ "step": 158
1116
+ },
1117
+ {
1118
+ "epoch": 0.06155632984901278,
1119
+ "grad_norm": 0.07983982563018799,
1120
+ "learning_rate": 9.734863974552635e-05,
1121
+ "loss": 0.0019,
1122
+ "step": 159
1123
+ },
1124
+ {
1125
+ "epoch": 0.06194347657762292,
1126
+ "grad_norm": 0.006283288821578026,
1127
+ "learning_rate": 9.731440729773114e-05,
1128
+ "loss": 0.0001,
1129
+ "step": 160
1130
+ },
1131
+ {
1132
+ "epoch": 0.06233062330623306,
1133
+ "grad_norm": 0.004482879303395748,
1134
+ "learning_rate": 9.727996137020918e-05,
1135
+ "loss": 0.0001,
1136
+ "step": 161
1137
+ },
1138
+ {
1139
+ "epoch": 0.0627177700348432,
1140
+ "grad_norm": 0.0071263727732002735,
1141
+ "learning_rate": 9.72453021183784e-05,
1142
+ "loss": 0.0001,
1143
+ "step": 162
1144
+ },
1145
+ {
1146
+ "epoch": 0.06310491676345335,
1147
+ "grad_norm": 0.0014257959555834532,
1148
+ "learning_rate": 9.721042969861928e-05,
1149
+ "loss": 0.0,
1150
+ "step": 163
1151
+ },
1152
+ {
1153
+ "epoch": 0.06349206349206349,
1154
+ "grad_norm": 0.06279278546571732,
1155
+ "learning_rate": 9.717534426827404e-05,
1156
+ "loss": 0.0013,
1157
+ "step": 164
1158
+ },
1159
+ {
1160
+ "epoch": 0.06387921022067364,
1161
+ "grad_norm": 0.10048985481262207,
1162
+ "learning_rate": 9.714004598564598e-05,
1163
+ "loss": 0.0015,
1164
+ "step": 165
1165
+ },
1166
+ {
1167
+ "epoch": 0.06426635694928377,
1168
+ "grad_norm": 0.010703545063734055,
1169
+ "learning_rate": 9.710453500999882e-05,
1170
+ "loss": 0.0002,
1171
+ "step": 166
1172
+ },
1173
+ {
1174
+ "epoch": 0.06465350367789392,
1175
+ "grad_norm": 0.0008502176497131586,
1176
+ "learning_rate": 9.706881150155591e-05,
1177
+ "loss": 0.0,
1178
+ "step": 167
1179
+ },
1180
+ {
1181
+ "epoch": 0.06504065040650407,
1182
+ "grad_norm": 0.035037811845541,
1183
+ "learning_rate": 9.703287562149959e-05,
1184
+ "loss": 0.0003,
1185
+ "step": 168
1186
+ },
1187
+ {
1188
+ "epoch": 0.06542779713511421,
1189
+ "grad_norm": 0.0808122381567955,
1190
+ "learning_rate": 9.69967275319703e-05,
1191
+ "loss": 0.0007,
1192
+ "step": 169
1193
+ },
1194
+ {
1195
+ "epoch": 0.06581494386372436,
1196
+ "grad_norm": 0.0047109900042414665,
1197
+ "learning_rate": 9.696036739606606e-05,
1198
+ "loss": 0.0001,
1199
+ "step": 170
1200
+ },
1201
+ {
1202
+ "epoch": 0.06620209059233449,
1203
+ "grad_norm": 0.30203601717948914,
1204
+ "learning_rate": 9.692379537784157e-05,
1205
+ "loss": 0.0048,
1206
+ "step": 171
1207
+ },
1208
+ {
1209
+ "epoch": 0.06658923732094464,
1210
+ "grad_norm": 0.0027131803799420595,
1211
+ "learning_rate": 9.688701164230758e-05,
1212
+ "loss": 0.0001,
1213
+ "step": 172
1214
+ },
1215
+ {
1216
+ "epoch": 0.06697638404955478,
1217
+ "grad_norm": 0.002335549332201481,
1218
+ "learning_rate": 9.685001635543005e-05,
1219
+ "loss": 0.0001,
1220
+ "step": 173
1221
+ },
1222
+ {
1223
+ "epoch": 0.06736353077816493,
1224
+ "grad_norm": 0.0023098927922546864,
1225
+ "learning_rate": 9.681280968412947e-05,
1226
+ "loss": 0.0001,
1227
+ "step": 174
1228
+ },
1229
+ {
1230
+ "epoch": 0.06775067750677506,
1231
+ "grad_norm": 0.001849909545853734,
1232
+ "learning_rate": 9.677539179628005e-05,
1233
+ "loss": 0.0,
1234
+ "step": 175
1235
+ },
1236
+ {
1237
+ "epoch": 0.06813782423538521,
1238
+ "grad_norm": 0.32040995359420776,
1239
+ "learning_rate": 9.673776286070906e-05,
1240
+ "loss": 0.0028,
1241
+ "step": 176
1242
+ },
1243
+ {
1244
+ "epoch": 0.06852497096399536,
1245
+ "grad_norm": 0.0077479127794504166,
1246
+ "learning_rate": 9.669992304719595e-05,
1247
+ "loss": 0.0001,
1248
+ "step": 177
1249
+ },
1250
+ {
1251
+ "epoch": 0.0689121176926055,
1252
+ "grad_norm": 0.020282207056879997,
1253
+ "learning_rate": 9.666187252647165e-05,
1254
+ "loss": 0.0002,
1255
+ "step": 178
1256
+ },
1257
+ {
1258
+ "epoch": 0.06929926442121565,
1259
+ "grad_norm": 0.00533844530582428,
1260
+ "learning_rate": 9.662361147021779e-05,
1261
+ "loss": 0.0001,
1262
+ "step": 179
1263
+ },
1264
+ {
1265
+ "epoch": 0.06968641114982578,
1266
+ "grad_norm": 0.0043952250853180885,
1267
+ "learning_rate": 9.658514005106596e-05,
1268
+ "loss": 0.0001,
1269
+ "step": 180
1270
+ },
1271
+ {
1272
+ "epoch": 0.07007355787843593,
1273
+ "grad_norm": 0.09598931670188904,
1274
+ "learning_rate": 9.654645844259683e-05,
1275
+ "loss": 0.0023,
1276
+ "step": 181
1277
+ },
1278
+ {
1279
+ "epoch": 0.07046070460704607,
1280
+ "grad_norm": 0.006287871859967709,
1281
+ "learning_rate": 9.650756681933947e-05,
1282
+ "loss": 0.0001,
1283
+ "step": 182
1284
+ },
1285
+ {
1286
+ "epoch": 0.07084785133565621,
1287
+ "grad_norm": 0.03524954989552498,
1288
+ "learning_rate": 9.646846535677055e-05,
1289
+ "loss": 0.0002,
1290
+ "step": 183
1291
+ },
1292
+ {
1293
+ "epoch": 0.07123499806426636,
1294
+ "grad_norm": 0.005163317546248436,
1295
+ "learning_rate": 9.642915423131342e-05,
1296
+ "loss": 0.0001,
1297
+ "step": 184
1298
+ },
1299
+ {
1300
+ "epoch": 0.0716221447928765,
1301
+ "grad_norm": 0.03801601007580757,
1302
+ "learning_rate": 9.638963362033756e-05,
1303
+ "loss": 0.0009,
1304
+ "step": 185
1305
+ },
1306
+ {
1307
+ "epoch": 0.07200929152148665,
1308
+ "grad_norm": 0.009458637796342373,
1309
+ "learning_rate": 9.634990370215752e-05,
1310
+ "loss": 0.0001,
1311
+ "step": 186
1312
+ },
1313
+ {
1314
+ "epoch": 0.07239643825009678,
1315
+ "grad_norm": 0.07404721528291702,
1316
+ "learning_rate": 9.630996465603228e-05,
1317
+ "loss": 0.0011,
1318
+ "step": 187
1319
+ },
1320
+ {
1321
+ "epoch": 0.07278358497870693,
1322
+ "grad_norm": 0.1175776869058609,
1323
+ "learning_rate": 9.626981666216439e-05,
1324
+ "loss": 0.001,
1325
+ "step": 188
1326
+ },
1327
+ {
1328
+ "epoch": 0.07317073170731707,
1329
+ "grad_norm": 0.07584076374769211,
1330
+ "learning_rate": 9.622945990169916e-05,
1331
+ "loss": 0.0007,
1332
+ "step": 189
1333
+ },
1334
+ {
1335
+ "epoch": 0.07355787843592722,
1336
+ "grad_norm": 0.01918666809797287,
1337
+ "learning_rate": 9.618889455672384e-05,
1338
+ "loss": 0.0001,
1339
+ "step": 190
1340
+ },
1341
+ {
1342
+ "epoch": 0.07394502516453735,
1343
+ "grad_norm": 1.1152503490447998,
1344
+ "learning_rate": 9.614812081026678e-05,
1345
+ "loss": 0.0111,
1346
+ "step": 191
1347
+ },
1348
+ {
1349
+ "epoch": 0.0743321718931475,
1350
+ "grad_norm": 0.0046646371483802795,
1351
+ "learning_rate": 9.610713884629666e-05,
1352
+ "loss": 0.0,
1353
+ "step": 192
1354
+ },
1355
+ {
1356
+ "epoch": 0.07471931862175765,
1357
+ "grad_norm": 0.0027072590310126543,
1358
+ "learning_rate": 9.60659488497216e-05,
1359
+ "loss": 0.0001,
1360
+ "step": 193
1361
+ },
1362
+ {
1363
+ "epoch": 0.07510646535036779,
1364
+ "grad_norm": 0.4910131096839905,
1365
+ "learning_rate": 9.602455100638836e-05,
1366
+ "loss": 0.0041,
1367
+ "step": 194
1368
+ },
1369
+ {
1370
+ "epoch": 0.07549361207897794,
1371
+ "grad_norm": 0.0024883951991796494,
1372
+ "learning_rate": 9.598294550308149e-05,
1373
+ "loss": 0.0,
1374
+ "step": 195
1375
+ },
1376
+ {
1377
+ "epoch": 0.07588075880758807,
1378
+ "grad_norm": 0.012495968490839005,
1379
+ "learning_rate": 9.594113252752248e-05,
1380
+ "loss": 0.0001,
1381
+ "step": 196
1382
+ },
1383
+ {
1384
+ "epoch": 0.07626790553619822,
1385
+ "grad_norm": 0.012010253965854645,
1386
+ "learning_rate": 9.589911226836896e-05,
1387
+ "loss": 0.0001,
1388
+ "step": 197
1389
+ },
1390
+ {
1391
+ "epoch": 0.07665505226480836,
1392
+ "grad_norm": 0.019101502373814583,
1393
+ "learning_rate": 9.585688491521374e-05,
1394
+ "loss": 0.0002,
1395
+ "step": 198
1396
+ },
1397
+ {
1398
+ "epoch": 0.0770421989934185,
1399
+ "grad_norm": 0.018270643427968025,
1400
+ "learning_rate": 9.58144506585841e-05,
1401
+ "loss": 0.0004,
1402
+ "step": 199
1403
+ },
1404
+ {
1405
+ "epoch": 0.07742934572202866,
1406
+ "grad_norm": 1.0924277305603027,
1407
+ "learning_rate": 9.577180968994082e-05,
1408
+ "loss": 0.0119,
1409
+ "step": 200
1410
+ },
1411
+ {
1412
+ "epoch": 0.07781649245063879,
1413
+ "grad_norm": 0.05194557085633278,
1414
+ "learning_rate": 9.572896220167735e-05,
1415
+ "loss": 0.0083,
1416
+ "step": 201
1417
+ },
1418
+ {
1419
+ "epoch": 0.07820363917924894,
1420
+ "grad_norm": 0.0748182013630867,
1421
+ "learning_rate": 9.568590838711895e-05,
1422
+ "loss": 0.0026,
1423
+ "step": 202
1424
+ },
1425
+ {
1426
+ "epoch": 0.07859078590785908,
1427
+ "grad_norm": 0.04829065874218941,
1428
+ "learning_rate": 9.564264844052182e-05,
1429
+ "loss": 0.0009,
1430
+ "step": 203
1431
+ },
1432
+ {
1433
+ "epoch": 0.07897793263646923,
1434
+ "grad_norm": 0.07577355951070786,
1435
+ "learning_rate": 9.559918255707219e-05,
1436
+ "loss": 0.0031,
1437
+ "step": 204
1438
+ },
1439
+ {
1440
+ "epoch": 0.07936507936507936,
1441
+ "grad_norm": 0.09440341591835022,
1442
+ "learning_rate": 9.555551093288548e-05,
1443
+ "loss": 0.0033,
1444
+ "step": 205
1445
+ },
1446
+ {
1447
+ "epoch": 0.07975222609368951,
1448
+ "grad_norm": 0.028996804729104042,
1449
+ "learning_rate": 9.551163376500543e-05,
1450
+ "loss": 0.0002,
1451
+ "step": 206
1452
+ },
1453
+ {
1454
+ "epoch": 0.08013937282229965,
1455
+ "grad_norm": 0.12111848592758179,
1456
+ "learning_rate": 9.546755125140313e-05,
1457
+ "loss": 0.0018,
1458
+ "step": 207
1459
+ },
1460
+ {
1461
+ "epoch": 0.0805265195509098,
1462
+ "grad_norm": 0.01013265922665596,
1463
+ "learning_rate": 9.542326359097619e-05,
1464
+ "loss": 0.0001,
1465
+ "step": 208
1466
+ },
1467
+ {
1468
+ "epoch": 0.08091366627951994,
1469
+ "grad_norm": 0.04623102769255638,
1470
+ "learning_rate": 9.537877098354786e-05,
1471
+ "loss": 0.0007,
1472
+ "step": 209
1473
+ },
1474
+ {
1475
+ "epoch": 0.08130081300813008,
1476
+ "grad_norm": 0.0021863309666514397,
1477
+ "learning_rate": 9.533407362986606e-05,
1478
+ "loss": 0.0,
1479
+ "step": 210
1480
+ },
1481
+ {
1482
+ "epoch": 0.08168795973674023,
1483
+ "grad_norm": 0.0072447373531758785,
1484
+ "learning_rate": 9.528917173160255e-05,
1485
+ "loss": 0.0001,
1486
+ "step": 211
1487
+ },
1488
+ {
1489
+ "epoch": 0.08207510646535036,
1490
+ "grad_norm": 0.011722790077328682,
1491
+ "learning_rate": 9.524406549135194e-05,
1492
+ "loss": 0.0002,
1493
+ "step": 212
1494
+ },
1495
+ {
1496
+ "epoch": 0.08246225319396051,
1497
+ "grad_norm": 0.08522871136665344,
1498
+ "learning_rate": 9.519875511263086e-05,
1499
+ "loss": 0.0006,
1500
+ "step": 213
1501
+ },
1502
+ {
1503
+ "epoch": 0.08284939992257065,
1504
+ "grad_norm": 0.03702247142791748,
1505
+ "learning_rate": 9.515324079987697e-05,
1506
+ "loss": 0.0007,
1507
+ "step": 214
1508
+ },
1509
+ {
1510
+ "epoch": 0.0832365466511808,
1511
+ "grad_norm": 0.004982550162822008,
1512
+ "learning_rate": 9.51075227584481e-05,
1513
+ "loss": 0.0001,
1514
+ "step": 215
1515
+ },
1516
+ {
1517
+ "epoch": 0.08362369337979095,
1518
+ "grad_norm": 0.0032351913396269083,
1519
+ "learning_rate": 9.506160119462124e-05,
1520
+ "loss": 0.0,
1521
+ "step": 216
1522
+ },
1523
+ {
1524
+ "epoch": 0.08401084010840108,
1525
+ "grad_norm": 0.008003685623407364,
1526
+ "learning_rate": 9.501547631559172e-05,
1527
+ "loss": 0.0001,
1528
+ "step": 217
1529
+ },
1530
+ {
1531
+ "epoch": 0.08439798683701123,
1532
+ "grad_norm": 0.21871095895767212,
1533
+ "learning_rate": 9.496914832947215e-05,
1534
+ "loss": 0.0045,
1535
+ "step": 218
1536
+ },
1537
+ {
1538
+ "epoch": 0.08478513356562137,
1539
+ "grad_norm": 0.05447891354560852,
1540
+ "learning_rate": 9.492261744529163e-05,
1541
+ "loss": 0.0008,
1542
+ "step": 219
1543
+ },
1544
+ {
1545
+ "epoch": 0.08517228029423152,
1546
+ "grad_norm": 0.019385039806365967,
1547
+ "learning_rate": 9.487588387299464e-05,
1548
+ "loss": 0.0003,
1549
+ "step": 220
1550
+ },
1551
+ {
1552
+ "epoch": 0.08555942702284165,
1553
+ "grad_norm": 0.009612143971025944,
1554
+ "learning_rate": 9.482894782344025e-05,
1555
+ "loss": 0.0002,
1556
+ "step": 221
1557
+ },
1558
+ {
1559
+ "epoch": 0.0859465737514518,
1560
+ "grad_norm": 0.1183067038655281,
1561
+ "learning_rate": 9.478180950840103e-05,
1562
+ "loss": 0.0007,
1563
+ "step": 222
1564
+ },
1565
+ {
1566
+ "epoch": 0.08633372048006194,
1567
+ "grad_norm": 0.2591310143470764,
1568
+ "learning_rate": 9.47344691405622e-05,
1569
+ "loss": 0.0008,
1570
+ "step": 223
1571
+ },
1572
+ {
1573
+ "epoch": 0.08672086720867209,
1574
+ "grad_norm": 0.0012734796619042754,
1575
+ "learning_rate": 9.468692693352063e-05,
1576
+ "loss": 0.0,
1577
+ "step": 224
1578
+ },
1579
+ {
1580
+ "epoch": 0.08710801393728224,
1581
+ "grad_norm": 1.0743658542633057,
1582
+ "learning_rate": 9.463918310178384e-05,
1583
+ "loss": 0.0083,
1584
+ "step": 225
1585
+ },
1586
+ {
1587
+ "epoch": 0.08749516066589237,
1588
+ "grad_norm": 0.0012743185507133603,
1589
+ "learning_rate": 9.459123786076912e-05,
1590
+ "loss": 0.0,
1591
+ "step": 226
1592
+ },
1593
+ {
1594
+ "epoch": 0.08788230739450252,
1595
+ "grad_norm": 0.007091084029525518,
1596
+ "learning_rate": 9.454309142680247e-05,
1597
+ "loss": 0.0,
1598
+ "step": 227
1599
+ },
1600
+ {
1601
+ "epoch": 0.08826945412311266,
1602
+ "grad_norm": 0.16258011758327484,
1603
+ "learning_rate": 9.449474401711766e-05,
1604
+ "loss": 0.0007,
1605
+ "step": 228
1606
+ },
1607
+ {
1608
+ "epoch": 0.0886566008517228,
1609
+ "grad_norm": 0.02502388134598732,
1610
+ "learning_rate": 9.444619584985526e-05,
1611
+ "loss": 0.0002,
1612
+ "step": 229
1613
+ },
1614
+ {
1615
+ "epoch": 0.08904374758033294,
1616
+ "grad_norm": 0.020117763429880142,
1617
+ "learning_rate": 9.439744714406167e-05,
1618
+ "loss": 0.0001,
1619
+ "step": 230
1620
+ },
1621
+ {
1622
+ "epoch": 0.08943089430894309,
1623
+ "grad_norm": 0.025272773578763008,
1624
+ "learning_rate": 9.434849811968807e-05,
1625
+ "loss": 0.0001,
1626
+ "step": 231
1627
+ },
1628
+ {
1629
+ "epoch": 0.08981804103755324,
1630
+ "grad_norm": 0.0023280701134353876,
1631
+ "learning_rate": 9.429934899758948e-05,
1632
+ "loss": 0.0,
1633
+ "step": 232
1634
+ },
1635
+ {
1636
+ "epoch": 0.09020518776616337,
1637
+ "grad_norm": 0.04557230323553085,
1638
+ "learning_rate": 9.424999999952375e-05,
1639
+ "loss": 0.0003,
1640
+ "step": 233
1641
+ },
1642
+ {
1643
+ "epoch": 0.09059233449477352,
1644
+ "grad_norm": 0.3395751714706421,
1645
+ "learning_rate": 9.420045134815056e-05,
1646
+ "loss": 0.0009,
1647
+ "step": 234
1648
+ },
1649
+ {
1650
+ "epoch": 0.09097948122338366,
1651
+ "grad_norm": 0.3556441068649292,
1652
+ "learning_rate": 9.41507032670304e-05,
1653
+ "loss": 0.0203,
1654
+ "step": 235
1655
+ },
1656
+ {
1657
+ "epoch": 0.09136662795199381,
1658
+ "grad_norm": 0.021049408242106438,
1659
+ "learning_rate": 9.410075598062358e-05,
1660
+ "loss": 0.0001,
1661
+ "step": 236
1662
+ },
1663
+ {
1664
+ "epoch": 0.09175377468060394,
1665
+ "grad_norm": 0.0035629859194159508,
1666
+ "learning_rate": 9.405060971428923e-05,
1667
+ "loss": 0.0,
1668
+ "step": 237
1669
+ },
1670
+ {
1671
+ "epoch": 0.0921409214092141,
1672
+ "grad_norm": 1.088625431060791,
1673
+ "learning_rate": 9.400026469428424e-05,
1674
+ "loss": 0.003,
1675
+ "step": 238
1676
+ },
1677
+ {
1678
+ "epoch": 0.09252806813782423,
1679
+ "grad_norm": 0.34952932596206665,
1680
+ "learning_rate": 9.39497211477623e-05,
1681
+ "loss": 0.0006,
1682
+ "step": 239
1683
+ },
1684
+ {
1685
+ "epoch": 0.09291521486643438,
1686
+ "grad_norm": 0.01403273455798626,
1687
+ "learning_rate": 9.38989793027728e-05,
1688
+ "loss": 0.0002,
1689
+ "step": 240
1690
+ },
1691
+ {
1692
+ "epoch": 0.09330236159504453,
1693
+ "grad_norm": 0.0016716537065804005,
1694
+ "learning_rate": 9.384803938825988e-05,
1695
+ "loss": 0.0,
1696
+ "step": 241
1697
+ },
1698
+ {
1699
+ "epoch": 0.09368950832365466,
1700
+ "grad_norm": 0.006439753342419863,
1701
+ "learning_rate": 9.379690163406128e-05,
1702
+ "loss": 0.0,
1703
+ "step": 242
1704
+ },
1705
+ {
1706
+ "epoch": 0.09407665505226481,
1707
+ "grad_norm": 0.0021656707394868135,
1708
+ "learning_rate": 9.374556627090749e-05,
1709
+ "loss": 0.0,
1710
+ "step": 243
1711
+ },
1712
+ {
1713
+ "epoch": 0.09446380178087495,
1714
+ "grad_norm": 0.0023138655815273523,
1715
+ "learning_rate": 9.369403353042052e-05,
1716
+ "loss": 0.0,
1717
+ "step": 244
1718
+ },
1719
+ {
1720
+ "epoch": 0.0948509485094851,
1721
+ "grad_norm": 0.002230309648439288,
1722
+ "learning_rate": 9.364230364511296e-05,
1723
+ "loss": 0.0001,
1724
+ "step": 245
1725
+ },
1726
+ {
1727
+ "epoch": 0.09523809523809523,
1728
+ "grad_norm": 0.014607599936425686,
1729
+ "learning_rate": 9.35903768483869e-05,
1730
+ "loss": 0.0001,
1731
+ "step": 246
1732
+ },
1733
+ {
1734
+ "epoch": 0.09562524196670538,
1735
+ "grad_norm": 0.005560693796724081,
1736
+ "learning_rate": 9.353825337453291e-05,
1737
+ "loss": 0.0001,
1738
+ "step": 247
1739
+ },
1740
+ {
1741
+ "epoch": 0.09601238869531553,
1742
+ "grad_norm": 0.013218767009675503,
1743
+ "learning_rate": 9.348593345872891e-05,
1744
+ "loss": 0.0002,
1745
+ "step": 248
1746
+ },
1747
+ {
1748
+ "epoch": 0.09639953542392567,
1749
+ "grad_norm": 0.05328545346856117,
1750
+ "learning_rate": 9.343341733703919e-05,
1751
+ "loss": 0.0004,
1752
+ "step": 249
1753
+ },
1754
+ {
1755
+ "epoch": 0.09678668215253582,
1756
+ "grad_norm": 0.0031676662620157003,
1757
+ "learning_rate": 9.338070524641329e-05,
1758
+ "loss": 0.0001,
1759
+ "step": 250
1760
+ },
1761
+ {
1762
+ "epoch": 0.09717382888114595,
1763
+ "grad_norm": 0.050222184509038925,
1764
+ "learning_rate": 9.332779742468496e-05,
1765
+ "loss": 0.0157,
1766
+ "step": 251
1767
+ },
1768
+ {
1769
+ "epoch": 0.0975609756097561,
1770
+ "grad_norm": 0.028248561546206474,
1771
+ "learning_rate": 9.327469411057106e-05,
1772
+ "loss": 0.0007,
1773
+ "step": 252
1774
+ },
1775
+ {
1776
+ "epoch": 0.09794812233836624,
1777
+ "grad_norm": 0.03661990538239479,
1778
+ "learning_rate": 9.322139554367052e-05,
1779
+ "loss": 0.0005,
1780
+ "step": 253
1781
+ },
1782
+ {
1783
+ "epoch": 0.09833526906697639,
1784
+ "grad_norm": 0.04206279292702675,
1785
+ "learning_rate": 9.316790196446324e-05,
1786
+ "loss": 0.0013,
1787
+ "step": 254
1788
+ },
1789
+ {
1790
+ "epoch": 0.09872241579558652,
1791
+ "grad_norm": 0.11051138490438461,
1792
+ "learning_rate": 9.311421361430898e-05,
1793
+ "loss": 0.0047,
1794
+ "step": 255
1795
+ },
1796
+ {
1797
+ "epoch": 0.09910956252419667,
1798
+ "grad_norm": 0.08012690395116806,
1799
+ "learning_rate": 9.306033073544631e-05,
1800
+ "loss": 0.0006,
1801
+ "step": 256
1802
+ },
1803
+ {
1804
+ "epoch": 0.09949670925280682,
1805
+ "grad_norm": 0.05237819254398346,
1806
+ "learning_rate": 9.300625357099151e-05,
1807
+ "loss": 0.0008,
1808
+ "step": 257
1809
+ },
1810
+ {
1811
+ "epoch": 0.09988385598141696,
1812
+ "grad_norm": 0.014332195743918419,
1813
+ "learning_rate": 9.295198236493745e-05,
1814
+ "loss": 0.0002,
1815
+ "step": 258
1816
+ },
1817
+ {
1818
+ "epoch": 0.1002710027100271,
1819
+ "grad_norm": 0.05660046637058258,
1820
+ "learning_rate": 9.289751736215251e-05,
1821
+ "loss": 0.0004,
1822
+ "step": 259
1823
+ },
1824
+ {
1825
+ "epoch": 0.10065814943863724,
1826
+ "grad_norm": 0.09471816569566727,
1827
+ "learning_rate": 9.284285880837946e-05,
1828
+ "loss": 0.0009,
1829
+ "step": 260
1830
+ },
1831
+ {
1832
+ "epoch": 0.10104529616724739,
1833
+ "grad_norm": 0.0016173557378351688,
1834
+ "learning_rate": 9.27880069502344e-05,
1835
+ "loss": 0.0,
1836
+ "step": 261
1837
+ },
1838
+ {
1839
+ "epoch": 0.10143244289585752,
1840
+ "grad_norm": 0.1207282617688179,
1841
+ "learning_rate": 9.273296203520553e-05,
1842
+ "loss": 0.0009,
1843
+ "step": 262
1844
+ },
1845
+ {
1846
+ "epoch": 0.10181958962446767,
1847
+ "grad_norm": 0.0016727615147829056,
1848
+ "learning_rate": 9.267772431165218e-05,
1849
+ "loss": 0.0,
1850
+ "step": 263
1851
+ },
1852
+ {
1853
+ "epoch": 0.10220673635307782,
1854
+ "grad_norm": 0.010696031153202057,
1855
+ "learning_rate": 9.262229402880362e-05,
1856
+ "loss": 0.0001,
1857
+ "step": 264
1858
+ },
1859
+ {
1860
+ "epoch": 0.10259388308168796,
1861
+ "grad_norm": 0.003082268638536334,
1862
+ "learning_rate": 9.256667143675789e-05,
1863
+ "loss": 0.0001,
1864
+ "step": 265
1865
+ },
1866
+ {
1867
+ "epoch": 0.10298102981029811,
1868
+ "grad_norm": 0.019705908372998238,
1869
+ "learning_rate": 9.251085678648072e-05,
1870
+ "loss": 0.0001,
1871
+ "step": 266
1872
+ },
1873
+ {
1874
+ "epoch": 0.10336817653890824,
1875
+ "grad_norm": 0.0005683451890945435,
1876
+ "learning_rate": 9.245485032980445e-05,
1877
+ "loss": 0.0,
1878
+ "step": 267
1879
+ },
1880
+ {
1881
+ "epoch": 0.10375532326751839,
1882
+ "grad_norm": 0.0019504778319969773,
1883
+ "learning_rate": 9.239865231942678e-05,
1884
+ "loss": 0.0,
1885
+ "step": 268
1886
+ },
1887
+ {
1888
+ "epoch": 0.10414246999612853,
1889
+ "grad_norm": 0.002394254319369793,
1890
+ "learning_rate": 9.234226300890974e-05,
1891
+ "loss": 0.0,
1892
+ "step": 269
1893
+ },
1894
+ {
1895
+ "epoch": 0.10452961672473868,
1896
+ "grad_norm": 0.00082309142453596,
1897
+ "learning_rate": 9.228568265267845e-05,
1898
+ "loss": 0.0,
1899
+ "step": 270
1900
+ },
1901
+ {
1902
+ "epoch": 0.10491676345334881,
1903
+ "grad_norm": 0.002265011891722679,
1904
+ "learning_rate": 9.222891150602005e-05,
1905
+ "loss": 0.0001,
1906
+ "step": 271
1907
+ },
1908
+ {
1909
+ "epoch": 0.10530391018195896,
1910
+ "grad_norm": 0.0030987069476395845,
1911
+ "learning_rate": 9.217194982508247e-05,
1912
+ "loss": 0.0,
1913
+ "step": 272
1914
+ },
1915
+ {
1916
+ "epoch": 0.10569105691056911,
1917
+ "grad_norm": 0.001322443364188075,
1918
+ "learning_rate": 9.211479786687338e-05,
1919
+ "loss": 0.0,
1920
+ "step": 273
1921
+ },
1922
+ {
1923
+ "epoch": 0.10607820363917925,
1924
+ "grad_norm": 0.010089612565934658,
1925
+ "learning_rate": 9.205745588925891e-05,
1926
+ "loss": 0.0001,
1927
+ "step": 274
1928
+ },
1929
+ {
1930
+ "epoch": 0.1064653503677894,
1931
+ "grad_norm": 0.3834461569786072,
1932
+ "learning_rate": 9.199992415096261e-05,
1933
+ "loss": 0.0114,
1934
+ "step": 275
1935
+ },
1936
+ {
1937
+ "epoch": 0.10685249709639953,
1938
+ "grad_norm": 0.0012483131140470505,
1939
+ "learning_rate": 9.194220291156413e-05,
1940
+ "loss": 0.0,
1941
+ "step": 276
1942
+ },
1943
+ {
1944
+ "epoch": 0.10723964382500968,
1945
+ "grad_norm": 0.0014100170228630304,
1946
+ "learning_rate": 9.188429243149824e-05,
1947
+ "loss": 0.0,
1948
+ "step": 277
1949
+ },
1950
+ {
1951
+ "epoch": 0.10762679055361982,
1952
+ "grad_norm": 0.0015941811725497246,
1953
+ "learning_rate": 9.182619297205348e-05,
1954
+ "loss": 0.0,
1955
+ "step": 278
1956
+ },
1957
+ {
1958
+ "epoch": 0.10801393728222997,
1959
+ "grad_norm": 0.0005449766758829355,
1960
+ "learning_rate": 9.176790479537108e-05,
1961
+ "loss": 0.0,
1962
+ "step": 279
1963
+ },
1964
+ {
1965
+ "epoch": 0.10840108401084012,
1966
+ "grad_norm": 0.1997094601392746,
1967
+ "learning_rate": 9.170942816444375e-05,
1968
+ "loss": 0.0027,
1969
+ "step": 280
1970
+ },
1971
+ {
1972
+ "epoch": 0.10878823073945025,
1973
+ "grad_norm": 0.001990030286833644,
1974
+ "learning_rate": 9.165076334311446e-05,
1975
+ "loss": 0.0,
1976
+ "step": 281
1977
+ },
1978
+ {
1979
+ "epoch": 0.1091753774680604,
1980
+ "grad_norm": 0.009841017425060272,
1981
+ "learning_rate": 9.159191059607537e-05,
1982
+ "loss": 0.0001,
1983
+ "step": 282
1984
+ },
1985
+ {
1986
+ "epoch": 0.10956252419667054,
1987
+ "grad_norm": 0.0011333709117025137,
1988
+ "learning_rate": 9.153287018886644e-05,
1989
+ "loss": 0.0,
1990
+ "step": 283
1991
+ },
1992
+ {
1993
+ "epoch": 0.10994967092528068,
1994
+ "grad_norm": 0.0004827795783057809,
1995
+ "learning_rate": 9.147364238787443e-05,
1996
+ "loss": 0.0,
1997
+ "step": 284
1998
+ },
1999
+ {
2000
+ "epoch": 0.11033681765389082,
2001
+ "grad_norm": 0.0046328590251505375,
2002
+ "learning_rate": 9.141422746033156e-05,
2003
+ "loss": 0.0,
2004
+ "step": 285
2005
+ },
2006
+ {
2007
+ "epoch": 0.11072396438250097,
2008
+ "grad_norm": 0.00042733096051961184,
2009
+ "learning_rate": 9.135462567431438e-05,
2010
+ "loss": 0.0,
2011
+ "step": 286
2012
+ },
2013
+ {
2014
+ "epoch": 0.1111111111111111,
2015
+ "grad_norm": 0.023281529545783997,
2016
+ "learning_rate": 9.12948372987425e-05,
2017
+ "loss": 0.0001,
2018
+ "step": 287
2019
+ },
2020
+ {
2021
+ "epoch": 0.11149825783972125,
2022
+ "grad_norm": 0.0010597595246508718,
2023
+ "learning_rate": 9.123486260337744e-05,
2024
+ "loss": 0.0,
2025
+ "step": 288
2026
+ },
2027
+ {
2028
+ "epoch": 0.1118854045683314,
2029
+ "grad_norm": 0.006935764104127884,
2030
+ "learning_rate": 9.117470185882139e-05,
2031
+ "loss": 0.0001,
2032
+ "step": 289
2033
+ },
2034
+ {
2035
+ "epoch": 0.11227255129694154,
2036
+ "grad_norm": 0.011282574385404587,
2037
+ "learning_rate": 9.111435533651596e-05,
2038
+ "loss": 0.0001,
2039
+ "step": 290
2040
+ },
2041
+ {
2042
+ "epoch": 0.11265969802555169,
2043
+ "grad_norm": 0.006138740107417107,
2044
+ "learning_rate": 9.105382330874099e-05,
2045
+ "loss": 0.0001,
2046
+ "step": 291
2047
+ },
2048
+ {
2049
+ "epoch": 0.11304684475416182,
2050
+ "grad_norm": 0.0003823502629529685,
2051
+ "learning_rate": 9.099310604861329e-05,
2052
+ "loss": 0.0,
2053
+ "step": 292
2054
+ },
2055
+ {
2056
+ "epoch": 0.11343399148277197,
2057
+ "grad_norm": 0.009164854884147644,
2058
+ "learning_rate": 9.093220383008545e-05,
2059
+ "loss": 0.0001,
2060
+ "step": 293
2061
+ },
2062
+ {
2063
+ "epoch": 0.11382113821138211,
2064
+ "grad_norm": 0.005529541522264481,
2065
+ "learning_rate": 9.087111692794459e-05,
2066
+ "loss": 0.0001,
2067
+ "step": 294
2068
+ },
2069
+ {
2070
+ "epoch": 0.11420828493999226,
2071
+ "grad_norm": 0.04618334770202637,
2072
+ "learning_rate": 9.08098456178111e-05,
2073
+ "loss": 0.0009,
2074
+ "step": 295
2075
+ },
2076
+ {
2077
+ "epoch": 0.11459543166860241,
2078
+ "grad_norm": 0.005164325702935457,
2079
+ "learning_rate": 9.074839017613736e-05,
2080
+ "loss": 0.0001,
2081
+ "step": 296
2082
+ },
2083
+ {
2084
+ "epoch": 0.11498257839721254,
2085
+ "grad_norm": 0.005010255612432957,
2086
+ "learning_rate": 9.068675088020661e-05,
2087
+ "loss": 0.0001,
2088
+ "step": 297
2089
+ },
2090
+ {
2091
+ "epoch": 0.11536972512582269,
2092
+ "grad_norm": 0.0010323580354452133,
2093
+ "learning_rate": 9.062492800813162e-05,
2094
+ "loss": 0.0,
2095
+ "step": 298
2096
+ },
2097
+ {
2098
+ "epoch": 0.11575687185443283,
2099
+ "grad_norm": 0.0012561334297060966,
2100
+ "learning_rate": 9.056292183885343e-05,
2101
+ "loss": 0.0,
2102
+ "step": 299
2103
+ },
2104
+ {
2105
+ "epoch": 0.11614401858304298,
2106
+ "grad_norm": 0.02239901013672352,
2107
+ "learning_rate": 9.050073265214005e-05,
2108
+ "loss": 0.0003,
2109
+ "step": 300
2110
+ },
2111
+ {
2112
+ "epoch": 0.11653116531165311,
2113
+ "grad_norm": 0.03204142302274704,
2114
+ "learning_rate": 9.043836072858535e-05,
2115
+ "loss": 0.0118,
2116
+ "step": 301
2117
+ },
2118
+ {
2119
+ "epoch": 0.11691831204026326,
2120
+ "grad_norm": 0.01608111336827278,
2121
+ "learning_rate": 9.037580634960764e-05,
2122
+ "loss": 0.0005,
2123
+ "step": 302
2124
+ },
2125
+ {
2126
+ "epoch": 0.1173054587688734,
2127
+ "grad_norm": 0.006757182534784079,
2128
+ "learning_rate": 9.031306979744847e-05,
2129
+ "loss": 0.0001,
2130
+ "step": 303
2131
+ },
2132
+ {
2133
+ "epoch": 0.11769260549748355,
2134
+ "grad_norm": 0.12025570124387741,
2135
+ "learning_rate": 9.025015135517137e-05,
2136
+ "loss": 0.0013,
2137
+ "step": 304
2138
+ },
2139
+ {
2140
+ "epoch": 0.1180797522260937,
2141
+ "grad_norm": 0.03977954015135765,
2142
+ "learning_rate": 9.01870513066605e-05,
2143
+ "loss": 0.0009,
2144
+ "step": 305
2145
+ },
2146
+ {
2147
+ "epoch": 0.11846689895470383,
2148
+ "grad_norm": 0.0013618416851386428,
2149
+ "learning_rate": 9.012376993661944e-05,
2150
+ "loss": 0.0,
2151
+ "step": 306
2152
+ },
2153
+ {
2154
+ "epoch": 0.11885404568331398,
2155
+ "grad_norm": 0.018894262611865997,
2156
+ "learning_rate": 9.006030753056989e-05,
2157
+ "loss": 0.0006,
2158
+ "step": 307
2159
+ },
2160
+ {
2161
+ "epoch": 0.11924119241192412,
2162
+ "grad_norm": 0.12205176800489426,
2163
+ "learning_rate": 8.999666437485035e-05,
2164
+ "loss": 0.0008,
2165
+ "step": 308
2166
+ },
2167
+ {
2168
+ "epoch": 0.11962833914053426,
2169
+ "grad_norm": 0.0020962394773960114,
2170
+ "learning_rate": 8.993284075661487e-05,
2171
+ "loss": 0.0001,
2172
+ "step": 309
2173
+ },
2174
+ {
2175
+ "epoch": 0.1200154858691444,
2176
+ "grad_norm": 0.0007874541915953159,
2177
+ "learning_rate": 8.986883696383175e-05,
2178
+ "loss": 0.0,
2179
+ "step": 310
2180
+ },
2181
+ {
2182
+ "epoch": 0.12040263259775455,
2183
+ "grad_norm": 0.015855029225349426,
2184
+ "learning_rate": 8.980465328528219e-05,
2185
+ "loss": 0.0002,
2186
+ "step": 311
2187
+ },
2188
+ {
2189
+ "epoch": 0.1207897793263647,
2190
+ "grad_norm": 0.004300241824239492,
2191
+ "learning_rate": 8.974029001055906e-05,
2192
+ "loss": 0.0001,
2193
+ "step": 312
2194
+ },
2195
+ {
2196
+ "epoch": 0.12117692605497483,
2197
+ "grad_norm": 0.06699482351541519,
2198
+ "learning_rate": 8.967574743006551e-05,
2199
+ "loss": 0.0011,
2200
+ "step": 313
2201
+ },
2202
+ {
2203
+ "epoch": 0.12156407278358498,
2204
+ "grad_norm": 0.0414130873978138,
2205
+ "learning_rate": 8.961102583501377e-05,
2206
+ "loss": 0.0009,
2207
+ "step": 314
2208
+ },
2209
+ {
2210
+ "epoch": 0.12195121951219512,
2211
+ "grad_norm": 0.0015767719596624374,
2212
+ "learning_rate": 8.95461255174237e-05,
2213
+ "loss": 0.0,
2214
+ "step": 315
2215
+ },
2216
+ {
2217
+ "epoch": 0.12233836624080527,
2218
+ "grad_norm": 0.006629679352045059,
2219
+ "learning_rate": 8.948104677012161e-05,
2220
+ "loss": 0.0001,
2221
+ "step": 316
2222
+ },
2223
+ {
2224
+ "epoch": 0.1227255129694154,
2225
+ "grad_norm": 0.03726351261138916,
2226
+ "learning_rate": 8.941578988673887e-05,
2227
+ "loss": 0.0002,
2228
+ "step": 317
2229
+ },
2230
+ {
2231
+ "epoch": 0.12311265969802555,
2232
+ "grad_norm": 0.01188661903142929,
2233
+ "learning_rate": 8.935035516171051e-05,
2234
+ "loss": 0.0001,
2235
+ "step": 318
2236
+ },
2237
+ {
2238
+ "epoch": 0.12349980642663569,
2239
+ "grad_norm": 0.018168246373534203,
2240
+ "learning_rate": 8.928474289027407e-05,
2241
+ "loss": 0.0001,
2242
+ "step": 319
2243
+ },
2244
+ {
2245
+ "epoch": 0.12388695315524584,
2246
+ "grad_norm": 0.0020913630723953247,
2247
+ "learning_rate": 8.921895336846813e-05,
2248
+ "loss": 0.0,
2249
+ "step": 320
2250
+ },
2251
+ {
2252
+ "epoch": 0.12427409988385599,
2253
+ "grad_norm": 0.008128736168146133,
2254
+ "learning_rate": 8.915298689313097e-05,
2255
+ "loss": 0.0001,
2256
+ "step": 321
2257
+ },
2258
+ {
2259
+ "epoch": 0.12466124661246612,
2260
+ "grad_norm": 0.02947946824133396,
2261
+ "learning_rate": 8.908684376189935e-05,
2262
+ "loss": 0.0004,
2263
+ "step": 322
2264
+ },
2265
+ {
2266
+ "epoch": 0.12504839334107626,
2267
+ "grad_norm": 0.0005556530086323619,
2268
+ "learning_rate": 8.902052427320704e-05,
2269
+ "loss": 0.0,
2270
+ "step": 323
2271
+ },
2272
+ {
2273
+ "epoch": 0.1254355400696864,
2274
+ "grad_norm": 0.00042274571023881435,
2275
+ "learning_rate": 8.895402872628352e-05,
2276
+ "loss": 0.0,
2277
+ "step": 324
2278
+ },
2279
+ {
2280
+ "epoch": 0.12582268679829656,
2281
+ "grad_norm": 0.15616343915462494,
2282
+ "learning_rate": 8.888735742115268e-05,
2283
+ "loss": 0.0031,
2284
+ "step": 325
2285
+ },
2286
+ {
2287
+ "epoch": 0.1262098335269067,
2288
+ "grad_norm": 0.0006327281007543206,
2289
+ "learning_rate": 8.88205106586314e-05,
2290
+ "loss": 0.0,
2291
+ "step": 326
2292
+ },
2293
+ {
2294
+ "epoch": 0.12659698025551683,
2295
+ "grad_norm": 0.0013813385739922523,
2296
+ "learning_rate": 8.875348874032817e-05,
2297
+ "loss": 0.0,
2298
+ "step": 327
2299
+ },
2300
+ {
2301
+ "epoch": 0.12698412698412698,
2302
+ "grad_norm": 0.0075355893932282925,
2303
+ "learning_rate": 8.868629196864182e-05,
2304
+ "loss": 0.0,
2305
+ "step": 328
2306
+ },
2307
+ {
2308
+ "epoch": 0.12737127371273713,
2309
+ "grad_norm": 0.0004084401880390942,
2310
+ "learning_rate": 8.861892064676009e-05,
2311
+ "loss": 0.0,
2312
+ "step": 329
2313
+ },
2314
+ {
2315
+ "epoch": 0.12775842044134728,
2316
+ "grad_norm": 0.0006156496237963438,
2317
+ "learning_rate": 8.855137507865832e-05,
2318
+ "loss": 0.0,
2319
+ "step": 330
2320
+ },
2321
+ {
2322
+ "epoch": 0.12814556716995743,
2323
+ "grad_norm": 0.0027660855557769537,
2324
+ "learning_rate": 8.848365556909796e-05,
2325
+ "loss": 0.0,
2326
+ "step": 331
2327
+ },
2328
+ {
2329
+ "epoch": 0.12853271389856755,
2330
+ "grad_norm": 0.04597468674182892,
2331
+ "learning_rate": 8.841576242362533e-05,
2332
+ "loss": 0.0002,
2333
+ "step": 332
2334
+ },
2335
+ {
2336
+ "epoch": 0.1289198606271777,
2337
+ "grad_norm": 0.006770620588213205,
2338
+ "learning_rate": 8.834769594857019e-05,
2339
+ "loss": 0.0001,
2340
+ "step": 333
2341
+ },
2342
+ {
2343
+ "epoch": 0.12930700735578785,
2344
+ "grad_norm": 0.0005002229590900242,
2345
+ "learning_rate": 8.827945645104429e-05,
2346
+ "loss": 0.0,
2347
+ "step": 334
2348
+ },
2349
+ {
2350
+ "epoch": 0.129694154084398,
2351
+ "grad_norm": 0.0015748875448480248,
2352
+ "learning_rate": 8.821104423894016e-05,
2353
+ "loss": 0.0,
2354
+ "step": 335
2355
+ },
2356
+ {
2357
+ "epoch": 0.13008130081300814,
2358
+ "grad_norm": 0.020414279773831367,
2359
+ "learning_rate": 8.814245962092946e-05,
2360
+ "loss": 0.0003,
2361
+ "step": 336
2362
+ },
2363
+ {
2364
+ "epoch": 0.13046844754161827,
2365
+ "grad_norm": 0.024940207600593567,
2366
+ "learning_rate": 8.807370290646186e-05,
2367
+ "loss": 0.0001,
2368
+ "step": 337
2369
+ },
2370
+ {
2371
+ "epoch": 0.13085559427022841,
2372
+ "grad_norm": 0.0011114513035863638,
2373
+ "learning_rate": 8.800477440576347e-05,
2374
+ "loss": 0.0,
2375
+ "step": 338
2376
+ },
2377
+ {
2378
+ "epoch": 0.13124274099883856,
2379
+ "grad_norm": 0.006404312793165445,
2380
+ "learning_rate": 8.793567442983548e-05,
2381
+ "loss": 0.0001,
2382
+ "step": 339
2383
+ },
2384
+ {
2385
+ "epoch": 0.1316298877274487,
2386
+ "grad_norm": 0.0012291868915781379,
2387
+ "learning_rate": 8.786640329045278e-05,
2388
+ "loss": 0.0,
2389
+ "step": 340
2390
+ },
2391
+ {
2392
+ "epoch": 0.13201703445605883,
2393
+ "grad_norm": 0.027518250048160553,
2394
+ "learning_rate": 8.779696130016253e-05,
2395
+ "loss": 0.0002,
2396
+ "step": 341
2397
+ },
2398
+ {
2399
+ "epoch": 0.13240418118466898,
2400
+ "grad_norm": 0.000955001509282738,
2401
+ "learning_rate": 8.772734877228276e-05,
2402
+ "loss": 0.0,
2403
+ "step": 342
2404
+ },
2405
+ {
2406
+ "epoch": 0.13279132791327913,
2407
+ "grad_norm": 0.0012375194346532226,
2408
+ "learning_rate": 8.765756602090101e-05,
2409
+ "loss": 0.0,
2410
+ "step": 343
2411
+ },
2412
+ {
2413
+ "epoch": 0.13317847464188928,
2414
+ "grad_norm": 0.0009470246150158346,
2415
+ "learning_rate": 8.758761336087274e-05,
2416
+ "loss": 0.0,
2417
+ "step": 344
2418
+ },
2419
+ {
2420
+ "epoch": 0.13356562137049943,
2421
+ "grad_norm": 0.01968814805150032,
2422
+ "learning_rate": 8.751749110782012e-05,
2423
+ "loss": 0.0002,
2424
+ "step": 345
2425
+ },
2426
+ {
2427
+ "epoch": 0.13395276809910955,
2428
+ "grad_norm": 0.5433384776115417,
2429
+ "learning_rate": 8.74471995781305e-05,
2430
+ "loss": 0.0105,
2431
+ "step": 346
2432
+ },
2433
+ {
2434
+ "epoch": 0.1343399148277197,
2435
+ "grad_norm": 0.0011947732418775558,
2436
+ "learning_rate": 8.737673908895498e-05,
2437
+ "loss": 0.0,
2438
+ "step": 347
2439
+ },
2440
+ {
2441
+ "epoch": 0.13472706155632985,
2442
+ "grad_norm": 0.005630856845527887,
2443
+ "learning_rate": 8.7306109958207e-05,
2444
+ "loss": 0.0001,
2445
+ "step": 348
2446
+ },
2447
+ {
2448
+ "epoch": 0.13511420828494,
2449
+ "grad_norm": 0.00635663652792573,
2450
+ "learning_rate": 8.72353125045609e-05,
2451
+ "loss": 0.0001,
2452
+ "step": 349
2453
+ },
2454
+ {
2455
+ "epoch": 0.13550135501355012,
2456
+ "grad_norm": 0.8739410638809204,
2457
+ "learning_rate": 8.716434704745046e-05,
2458
+ "loss": 0.0276,
2459
+ "step": 350
2460
+ },
2461
+ {
2462
+ "epoch": 0.13588850174216027,
2463
+ "grad_norm": 0.05545734986662865,
2464
+ "learning_rate": 8.709321390706756e-05,
2465
+ "loss": 0.0078,
2466
+ "step": 351
2467
+ },
2468
+ {
2469
+ "epoch": 0.13627564847077042,
2470
+ "grad_norm": 0.027743853628635406,
2471
+ "learning_rate": 8.702191340436054e-05,
2472
+ "loss": 0.0007,
2473
+ "step": 352
2474
+ },
2475
+ {
2476
+ "epoch": 0.13666279519938057,
2477
+ "grad_norm": 0.10148515552282333,
2478
+ "learning_rate": 8.695044586103296e-05,
2479
+ "loss": 0.0048,
2480
+ "step": 353
2481
+ },
2482
+ {
2483
+ "epoch": 0.13704994192799072,
2484
+ "grad_norm": 0.031402137130498886,
2485
+ "learning_rate": 8.687881159954202e-05,
2486
+ "loss": 0.0008,
2487
+ "step": 354
2488
+ },
2489
+ {
2490
+ "epoch": 0.13743708865660084,
2491
+ "grad_norm": 0.055899184197187424,
2492
+ "learning_rate": 8.680701094309716e-05,
2493
+ "loss": 0.0008,
2494
+ "step": 355
2495
+ },
2496
+ {
2497
+ "epoch": 0.137824235385211,
2498
+ "grad_norm": 0.024489685893058777,
2499
+ "learning_rate": 8.673504421565856e-05,
2500
+ "loss": 0.0004,
2501
+ "step": 356
2502
+ },
2503
+ {
2504
+ "epoch": 0.13821138211382114,
2505
+ "grad_norm": 0.013303971849381924,
2506
+ "learning_rate": 8.666291174193573e-05,
2507
+ "loss": 0.0001,
2508
+ "step": 357
2509
+ },
2510
+ {
2511
+ "epoch": 0.1385985288424313,
2512
+ "grad_norm": 0.009390785358846188,
2513
+ "learning_rate": 8.659061384738598e-05,
2514
+ "loss": 0.0001,
2515
+ "step": 358
2516
+ },
2517
+ {
2518
+ "epoch": 0.1389856755710414,
2519
+ "grad_norm": 0.04934685677289963,
2520
+ "learning_rate": 8.651815085821303e-05,
2521
+ "loss": 0.0003,
2522
+ "step": 359
2523
+ },
2524
+ {
2525
+ "epoch": 0.13937282229965156,
2526
+ "grad_norm": 0.001061944873072207,
2527
+ "learning_rate": 8.644552310136546e-05,
2528
+ "loss": 0.0,
2529
+ "step": 360
2530
+ },
2531
+ {
2532
+ "epoch": 0.1397599690282617,
2533
+ "grad_norm": 0.005462823435664177,
2534
+ "learning_rate": 8.637273090453532e-05,
2535
+ "loss": 0.0001,
2536
+ "step": 361
2537
+ },
2538
+ {
2539
+ "epoch": 0.14014711575687186,
2540
+ "grad_norm": 0.0016542257508262992,
2541
+ "learning_rate": 8.629977459615655e-05,
2542
+ "loss": 0.0,
2543
+ "step": 362
2544
+ },
2545
+ {
2546
+ "epoch": 0.140534262485482,
2547
+ "grad_norm": 0.0004302252782508731,
2548
+ "learning_rate": 8.622665450540357e-05,
2549
+ "loss": 0.0,
2550
+ "step": 363
2551
+ },
2552
+ {
2553
+ "epoch": 0.14092140921409213,
2554
+ "grad_norm": 0.022549882531166077,
2555
+ "learning_rate": 8.615337096218979e-05,
2556
+ "loss": 0.0004,
2557
+ "step": 364
2558
+ },
2559
+ {
2560
+ "epoch": 0.14130855594270228,
2561
+ "grad_norm": 0.024535585194826126,
2562
+ "learning_rate": 8.60799242971661e-05,
2563
+ "loss": 0.0001,
2564
+ "step": 365
2565
+ },
2566
+ {
2567
+ "epoch": 0.14169570267131243,
2568
+ "grad_norm": 0.0006051576347090304,
2569
+ "learning_rate": 8.600631484171938e-05,
2570
+ "loss": 0.0,
2571
+ "step": 366
2572
+ },
2573
+ {
2574
+ "epoch": 0.14208284939992258,
2575
+ "grad_norm": 0.0036598185542970896,
2576
+ "learning_rate": 8.593254292797099e-05,
2577
+ "loss": 0.0,
2578
+ "step": 367
2579
+ },
2580
+ {
2581
+ "epoch": 0.14246999612853273,
2582
+ "grad_norm": 0.11391391605138779,
2583
+ "learning_rate": 8.585860888877537e-05,
2584
+ "loss": 0.0015,
2585
+ "step": 368
2586
+ },
2587
+ {
2588
+ "epoch": 0.14285714285714285,
2589
+ "grad_norm": 0.026237154379487038,
2590
+ "learning_rate": 8.578451305771836e-05,
2591
+ "loss": 0.0003,
2592
+ "step": 369
2593
+ },
2594
+ {
2595
+ "epoch": 0.143244289585753,
2596
+ "grad_norm": 0.005311033688485622,
2597
+ "learning_rate": 8.571025576911587e-05,
2598
+ "loss": 0.0001,
2599
+ "step": 370
2600
+ },
2601
+ {
2602
+ "epoch": 0.14363143631436315,
2603
+ "grad_norm": 0.0019114494789391756,
2604
+ "learning_rate": 8.563583735801224e-05,
2605
+ "loss": 0.0,
2606
+ "step": 371
2607
+ }
2608
+ ],
2609
+ "logging_steps": 1,
2610
+ "max_steps": 1484,
2611
+ "num_input_tokens_seen": 0,
2612
+ "num_train_epochs": 1,
2613
+ "save_steps": 371,
2614
+ "stateful_callbacks": {
2615
+ "TrainerControl": {
2616
+ "args": {
2617
+ "should_epoch_stop": false,
2618
+ "should_evaluate": false,
2619
+ "should_log": false,
2620
+ "should_save": true,
2621
+ "should_training_stop": false
2622
+ },
2623
+ "attributes": {}
2624
+ }
2625
+ },
2626
+ "total_flos": 1.056519826219991e+17,
2627
+ "train_batch_size": 4,
2628
+ "trial_name": null,
2629
+ "trial_params": null
2630
+ }
last-checkpoint/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c20d00c6758e48f2b59aabd29cffe7df593a84ae92889b9372e2a1d58302c9f
3
+ size 6776
last-checkpoint/vocab.json ADDED
The diff for this file is too large to render. See raw diff