Steve Chiou commited on
Commit
03180ed
1 Parent(s): 22c33bf

End of training

Browse files
Files changed (3) hide show
  1. all_results.json +8 -0
  2. test_results.json +8 -0
  3. trainer_state.json +2113 -0
all_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 49.0,
3
+ "eval_accuracy": 0.2647058823529412,
4
+ "eval_loss": 3.1971516609191895,
5
+ "eval_runtime": 19.408,
6
+ "eval_samples_per_second": 7.007,
7
+ "eval_steps_per_second": 1.185
8
+ }
test_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 49.0,
3
+ "eval_accuracy": 0.2647058823529412,
4
+ "eval_loss": 3.1971516609191895,
5
+ "eval_runtime": 19.408,
6
+ "eval_samples_per_second": 7.007,
7
+ "eval_steps_per_second": 1.185
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,2113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.2647058823529412,
3
+ "best_model_checkpoint": "videomae-large-finetuned-kinetics-finetuned-engine-subset-R2-K400-20230418_3/checkpoint-550",
4
+ "epoch": 49.00185185185185,
5
+ "global_step": 2700,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.0,
12
+ "learning_rate": 1.8518518518518519e-06,
13
+ "loss": 2.5889,
14
+ "step": 10
15
+ },
16
+ {
17
+ "epoch": 0.01,
18
+ "learning_rate": 3.7037037037037037e-06,
19
+ "loss": 2.6177,
20
+ "step": 20
21
+ },
22
+ {
23
+ "epoch": 0.01,
24
+ "learning_rate": 5.555555555555556e-06,
25
+ "loss": 2.6425,
26
+ "step": 30
27
+ },
28
+ {
29
+ "epoch": 0.01,
30
+ "learning_rate": 7.4074074074074075e-06,
31
+ "loss": 2.5758,
32
+ "step": 40
33
+ },
34
+ {
35
+ "epoch": 0.02,
36
+ "learning_rate": 9.259259259259259e-06,
37
+ "loss": 2.5562,
38
+ "step": 50
39
+ },
40
+ {
41
+ "epoch": 0.02,
42
+ "eval_accuracy": 0.022058823529411766,
43
+ "eval_loss": 2.5746004581451416,
44
+ "eval_runtime": 18.5226,
45
+ "eval_samples_per_second": 7.342,
46
+ "eval_steps_per_second": 1.242,
47
+ "step": 55
48
+ },
49
+ {
50
+ "epoch": 1.0,
51
+ "learning_rate": 1.1111111111111112e-05,
52
+ "loss": 2.5636,
53
+ "step": 60
54
+ },
55
+ {
56
+ "epoch": 1.01,
57
+ "learning_rate": 1.2962962962962962e-05,
58
+ "loss": 2.4418,
59
+ "step": 70
60
+ },
61
+ {
62
+ "epoch": 1.01,
63
+ "learning_rate": 1.4814814814814815e-05,
64
+ "loss": 2.5013,
65
+ "step": 80
66
+ },
67
+ {
68
+ "epoch": 1.01,
69
+ "learning_rate": 1.6666666666666667e-05,
70
+ "loss": 2.4885,
71
+ "step": 90
72
+ },
73
+ {
74
+ "epoch": 1.02,
75
+ "learning_rate": 1.8518518518518518e-05,
76
+ "loss": 2.5236,
77
+ "step": 100
78
+ },
79
+ {
80
+ "epoch": 1.02,
81
+ "learning_rate": 2.037037037037037e-05,
82
+ "loss": 2.4543,
83
+ "step": 110
84
+ },
85
+ {
86
+ "epoch": 1.02,
87
+ "eval_accuracy": 0.09558823529411764,
88
+ "eval_loss": 2.5524215698242188,
89
+ "eval_runtime": 18.7327,
90
+ "eval_samples_per_second": 7.26,
91
+ "eval_steps_per_second": 1.228,
92
+ "step": 110
93
+ },
94
+ {
95
+ "epoch": 2.0,
96
+ "learning_rate": 2.2222222222222223e-05,
97
+ "loss": 2.283,
98
+ "step": 120
99
+ },
100
+ {
101
+ "epoch": 2.01,
102
+ "learning_rate": 2.4074074074074074e-05,
103
+ "loss": 2.3757,
104
+ "step": 130
105
+ },
106
+ {
107
+ "epoch": 2.01,
108
+ "learning_rate": 2.5925925925925925e-05,
109
+ "loss": 2.2946,
110
+ "step": 140
111
+ },
112
+ {
113
+ "epoch": 2.01,
114
+ "learning_rate": 2.777777777777778e-05,
115
+ "loss": 2.3668,
116
+ "step": 150
117
+ },
118
+ {
119
+ "epoch": 2.02,
120
+ "learning_rate": 2.962962962962963e-05,
121
+ "loss": 2.1443,
122
+ "step": 160
123
+ },
124
+ {
125
+ "epoch": 2.02,
126
+ "eval_accuracy": 0.11029411764705882,
127
+ "eval_loss": 2.5213658809661865,
128
+ "eval_runtime": 19.2865,
129
+ "eval_samples_per_second": 7.052,
130
+ "eval_steps_per_second": 1.193,
131
+ "step": 165
132
+ },
133
+ {
134
+ "epoch": 3.0,
135
+ "learning_rate": 3.148148148148148e-05,
136
+ "loss": 2.0635,
137
+ "step": 170
138
+ },
139
+ {
140
+ "epoch": 3.01,
141
+ "learning_rate": 3.3333333333333335e-05,
142
+ "loss": 2.063,
143
+ "step": 180
144
+ },
145
+ {
146
+ "epoch": 3.01,
147
+ "learning_rate": 3.518518518518519e-05,
148
+ "loss": 2.0232,
149
+ "step": 190
150
+ },
151
+ {
152
+ "epoch": 3.01,
153
+ "learning_rate": 3.7037037037037037e-05,
154
+ "loss": 1.8032,
155
+ "step": 200
156
+ },
157
+ {
158
+ "epoch": 3.02,
159
+ "learning_rate": 3.888888888888889e-05,
160
+ "loss": 1.669,
161
+ "step": 210
162
+ },
163
+ {
164
+ "epoch": 3.02,
165
+ "learning_rate": 4.074074074074074e-05,
166
+ "loss": 1.6604,
167
+ "step": 220
168
+ },
169
+ {
170
+ "epoch": 3.02,
171
+ "eval_accuracy": 0.13970588235294118,
172
+ "eval_loss": 2.6414613723754883,
173
+ "eval_runtime": 19.2083,
174
+ "eval_samples_per_second": 7.08,
175
+ "eval_steps_per_second": 1.197,
176
+ "step": 220
177
+ },
178
+ {
179
+ "epoch": 4.0,
180
+ "learning_rate": 4.259259259259259e-05,
181
+ "loss": 1.3638,
182
+ "step": 230
183
+ },
184
+ {
185
+ "epoch": 4.01,
186
+ "learning_rate": 4.4444444444444447e-05,
187
+ "loss": 1.3303,
188
+ "step": 240
189
+ },
190
+ {
191
+ "epoch": 4.01,
192
+ "learning_rate": 4.62962962962963e-05,
193
+ "loss": 1.6113,
194
+ "step": 250
195
+ },
196
+ {
197
+ "epoch": 4.01,
198
+ "learning_rate": 4.814814814814815e-05,
199
+ "loss": 1.3732,
200
+ "step": 260
201
+ },
202
+ {
203
+ "epoch": 4.02,
204
+ "learning_rate": 5e-05,
205
+ "loss": 1.5847,
206
+ "step": 270
207
+ },
208
+ {
209
+ "epoch": 4.02,
210
+ "eval_accuracy": 0.07352941176470588,
211
+ "eval_loss": 2.9843006134033203,
212
+ "eval_runtime": 19.283,
213
+ "eval_samples_per_second": 7.053,
214
+ "eval_steps_per_second": 1.193,
215
+ "step": 275
216
+ },
217
+ {
218
+ "epoch": 5.0,
219
+ "learning_rate": 4.9794238683127575e-05,
220
+ "loss": 1.404,
221
+ "step": 280
222
+ },
223
+ {
224
+ "epoch": 5.01,
225
+ "learning_rate": 4.958847736625515e-05,
226
+ "loss": 1.2842,
227
+ "step": 290
228
+ },
229
+ {
230
+ "epoch": 5.01,
231
+ "learning_rate": 4.938271604938271e-05,
232
+ "loss": 1.4568,
233
+ "step": 300
234
+ },
235
+ {
236
+ "epoch": 5.01,
237
+ "learning_rate": 4.9176954732510286e-05,
238
+ "loss": 1.1628,
239
+ "step": 310
240
+ },
241
+ {
242
+ "epoch": 5.02,
243
+ "learning_rate": 4.8971193415637865e-05,
244
+ "loss": 1.3066,
245
+ "step": 320
246
+ },
247
+ {
248
+ "epoch": 5.02,
249
+ "learning_rate": 4.876543209876544e-05,
250
+ "loss": 1.4657,
251
+ "step": 330
252
+ },
253
+ {
254
+ "epoch": 5.02,
255
+ "eval_accuracy": 0.14705882352941177,
256
+ "eval_loss": 2.747610092163086,
257
+ "eval_runtime": 18.9644,
258
+ "eval_samples_per_second": 7.171,
259
+ "eval_steps_per_second": 1.213,
260
+ "step": 330
261
+ },
262
+ {
263
+ "epoch": 6.0,
264
+ "learning_rate": 4.855967078189301e-05,
265
+ "loss": 1.1392,
266
+ "step": 340
267
+ },
268
+ {
269
+ "epoch": 6.01,
270
+ "learning_rate": 4.835390946502058e-05,
271
+ "loss": 1.0831,
272
+ "step": 350
273
+ },
274
+ {
275
+ "epoch": 6.01,
276
+ "learning_rate": 4.814814814814815e-05,
277
+ "loss": 1.1938,
278
+ "step": 360
279
+ },
280
+ {
281
+ "epoch": 6.01,
282
+ "learning_rate": 4.794238683127572e-05,
283
+ "loss": 1.1915,
284
+ "step": 370
285
+ },
286
+ {
287
+ "epoch": 6.02,
288
+ "learning_rate": 4.773662551440329e-05,
289
+ "loss": 1.0823,
290
+ "step": 380
291
+ },
292
+ {
293
+ "epoch": 6.02,
294
+ "eval_accuracy": 0.14705882352941177,
295
+ "eval_loss": 3.0872228145599365,
296
+ "eval_runtime": 19.2681,
297
+ "eval_samples_per_second": 7.058,
298
+ "eval_steps_per_second": 1.194,
299
+ "step": 385
300
+ },
301
+ {
302
+ "epoch": 7.0,
303
+ "learning_rate": 4.7530864197530866e-05,
304
+ "loss": 1.3142,
305
+ "step": 390
306
+ },
307
+ {
308
+ "epoch": 7.01,
309
+ "learning_rate": 4.732510288065844e-05,
310
+ "loss": 0.8276,
311
+ "step": 400
312
+ },
313
+ {
314
+ "epoch": 7.01,
315
+ "learning_rate": 4.711934156378601e-05,
316
+ "loss": 1.2421,
317
+ "step": 410
318
+ },
319
+ {
320
+ "epoch": 7.01,
321
+ "learning_rate": 4.691358024691358e-05,
322
+ "loss": 0.7453,
323
+ "step": 420
324
+ },
325
+ {
326
+ "epoch": 7.02,
327
+ "learning_rate": 4.6707818930041156e-05,
328
+ "loss": 0.8762,
329
+ "step": 430
330
+ },
331
+ {
332
+ "epoch": 7.02,
333
+ "learning_rate": 4.650205761316873e-05,
334
+ "loss": 1.0672,
335
+ "step": 440
336
+ },
337
+ {
338
+ "epoch": 7.02,
339
+ "eval_accuracy": 0.22058823529411764,
340
+ "eval_loss": 2.9539241790771484,
341
+ "eval_runtime": 19.7255,
342
+ "eval_samples_per_second": 6.895,
343
+ "eval_steps_per_second": 1.166,
344
+ "step": 440
345
+ },
346
+ {
347
+ "epoch": 8.0,
348
+ "learning_rate": 4.62962962962963e-05,
349
+ "loss": 0.7333,
350
+ "step": 450
351
+ },
352
+ {
353
+ "epoch": 8.01,
354
+ "learning_rate": 4.609053497942387e-05,
355
+ "loss": 0.7281,
356
+ "step": 460
357
+ },
358
+ {
359
+ "epoch": 8.01,
360
+ "learning_rate": 4.5884773662551446e-05,
361
+ "loss": 0.7749,
362
+ "step": 470
363
+ },
364
+ {
365
+ "epoch": 8.01,
366
+ "learning_rate": 4.567901234567901e-05,
367
+ "loss": 1.0116,
368
+ "step": 480
369
+ },
370
+ {
371
+ "epoch": 8.02,
372
+ "learning_rate": 4.5473251028806584e-05,
373
+ "loss": 0.7241,
374
+ "step": 490
375
+ },
376
+ {
377
+ "epoch": 8.02,
378
+ "eval_accuracy": 0.11029411764705882,
379
+ "eval_loss": 3.536442995071411,
380
+ "eval_runtime": 19.1835,
381
+ "eval_samples_per_second": 7.089,
382
+ "eval_steps_per_second": 1.199,
383
+ "step": 495
384
+ },
385
+ {
386
+ "epoch": 9.0,
387
+ "learning_rate": 4.5267489711934157e-05,
388
+ "loss": 0.7966,
389
+ "step": 500
390
+ },
391
+ {
392
+ "epoch": 9.01,
393
+ "learning_rate": 4.506172839506173e-05,
394
+ "loss": 0.6068,
395
+ "step": 510
396
+ },
397
+ {
398
+ "epoch": 9.01,
399
+ "learning_rate": 4.48559670781893e-05,
400
+ "loss": 0.5489,
401
+ "step": 520
402
+ },
403
+ {
404
+ "epoch": 9.01,
405
+ "learning_rate": 4.4650205761316874e-05,
406
+ "loss": 0.6817,
407
+ "step": 530
408
+ },
409
+ {
410
+ "epoch": 9.02,
411
+ "learning_rate": 4.4444444444444447e-05,
412
+ "loss": 0.6598,
413
+ "step": 540
414
+ },
415
+ {
416
+ "epoch": 9.02,
417
+ "learning_rate": 4.423868312757202e-05,
418
+ "loss": 0.6532,
419
+ "step": 550
420
+ },
421
+ {
422
+ "epoch": 9.02,
423
+ "eval_accuracy": 0.2647058823529412,
424
+ "eval_loss": 3.1971516609191895,
425
+ "eval_runtime": 19.3537,
426
+ "eval_samples_per_second": 7.027,
427
+ "eval_steps_per_second": 1.188,
428
+ "step": 550
429
+ },
430
+ {
431
+ "epoch": 10.0,
432
+ "learning_rate": 4.403292181069959e-05,
433
+ "loss": 0.3489,
434
+ "step": 560
435
+ },
436
+ {
437
+ "epoch": 10.01,
438
+ "learning_rate": 4.3827160493827164e-05,
439
+ "loss": 0.3966,
440
+ "step": 570
441
+ },
442
+ {
443
+ "epoch": 10.01,
444
+ "learning_rate": 4.3621399176954737e-05,
445
+ "loss": 0.4513,
446
+ "step": 580
447
+ },
448
+ {
449
+ "epoch": 10.01,
450
+ "learning_rate": 4.341563786008231e-05,
451
+ "loss": 0.69,
452
+ "step": 590
453
+ },
454
+ {
455
+ "epoch": 10.02,
456
+ "learning_rate": 4.3209876543209875e-05,
457
+ "loss": 0.6476,
458
+ "step": 600
459
+ },
460
+ {
461
+ "epoch": 10.02,
462
+ "eval_accuracy": 0.07352941176470588,
463
+ "eval_loss": 4.128897666931152,
464
+ "eval_runtime": 18.8991,
465
+ "eval_samples_per_second": 7.196,
466
+ "eval_steps_per_second": 1.217,
467
+ "step": 605
468
+ },
469
+ {
470
+ "epoch": 11.0,
471
+ "learning_rate": 4.300411522633745e-05,
472
+ "loss": 0.5848,
473
+ "step": 610
474
+ },
475
+ {
476
+ "epoch": 11.01,
477
+ "learning_rate": 4.279835390946502e-05,
478
+ "loss": 0.5367,
479
+ "step": 620
480
+ },
481
+ {
482
+ "epoch": 11.01,
483
+ "learning_rate": 4.259259259259259e-05,
484
+ "loss": 0.5262,
485
+ "step": 630
486
+ },
487
+ {
488
+ "epoch": 11.01,
489
+ "learning_rate": 4.2386831275720165e-05,
490
+ "loss": 0.6052,
491
+ "step": 640
492
+ },
493
+ {
494
+ "epoch": 11.02,
495
+ "learning_rate": 4.2181069958847744e-05,
496
+ "loss": 0.5266,
497
+ "step": 650
498
+ },
499
+ {
500
+ "epoch": 11.02,
501
+ "learning_rate": 4.197530864197531e-05,
502
+ "loss": 0.3725,
503
+ "step": 660
504
+ },
505
+ {
506
+ "epoch": 11.02,
507
+ "eval_accuracy": 0.058823529411764705,
508
+ "eval_loss": 4.470974922180176,
509
+ "eval_runtime": 19.5333,
510
+ "eval_samples_per_second": 6.962,
511
+ "eval_steps_per_second": 1.177,
512
+ "step": 660
513
+ },
514
+ {
515
+ "epoch": 12.0,
516
+ "learning_rate": 4.176954732510288e-05,
517
+ "loss": 0.5395,
518
+ "step": 670
519
+ },
520
+ {
521
+ "epoch": 12.01,
522
+ "learning_rate": 4.1563786008230455e-05,
523
+ "loss": 0.3467,
524
+ "step": 680
525
+ },
526
+ {
527
+ "epoch": 12.01,
528
+ "learning_rate": 4.135802469135803e-05,
529
+ "loss": 0.4811,
530
+ "step": 690
531
+ },
532
+ {
533
+ "epoch": 12.01,
534
+ "learning_rate": 4.11522633744856e-05,
535
+ "loss": 0.2319,
536
+ "step": 700
537
+ },
538
+ {
539
+ "epoch": 12.02,
540
+ "learning_rate": 4.094650205761317e-05,
541
+ "loss": 0.7363,
542
+ "step": 710
543
+ },
544
+ {
545
+ "epoch": 12.02,
546
+ "eval_accuracy": 0.0661764705882353,
547
+ "eval_loss": 4.924136161804199,
548
+ "eval_runtime": 18.8618,
549
+ "eval_samples_per_second": 7.21,
550
+ "eval_steps_per_second": 1.219,
551
+ "step": 715
552
+ },
553
+ {
554
+ "epoch": 13.0,
555
+ "learning_rate": 4.074074074074074e-05,
556
+ "loss": 0.3512,
557
+ "step": 720
558
+ },
559
+ {
560
+ "epoch": 13.01,
561
+ "learning_rate": 4.053497942386831e-05,
562
+ "loss": 0.4679,
563
+ "step": 730
564
+ },
565
+ {
566
+ "epoch": 13.01,
567
+ "learning_rate": 4.032921810699588e-05,
568
+ "loss": 0.2977,
569
+ "step": 740
570
+ },
571
+ {
572
+ "epoch": 13.01,
573
+ "learning_rate": 4.012345679012346e-05,
574
+ "loss": 0.4135,
575
+ "step": 750
576
+ },
577
+ {
578
+ "epoch": 13.02,
579
+ "learning_rate": 3.9917695473251035e-05,
580
+ "loss": 0.5098,
581
+ "step": 760
582
+ },
583
+ {
584
+ "epoch": 13.02,
585
+ "learning_rate": 3.971193415637861e-05,
586
+ "loss": 0.3136,
587
+ "step": 770
588
+ },
589
+ {
590
+ "epoch": 13.02,
591
+ "eval_accuracy": 0.11764705882352941,
592
+ "eval_loss": 4.821662425994873,
593
+ "eval_runtime": 19.3838,
594
+ "eval_samples_per_second": 7.016,
595
+ "eval_steps_per_second": 1.187,
596
+ "step": 770
597
+ },
598
+ {
599
+ "epoch": 14.0,
600
+ "learning_rate": 3.950617283950617e-05,
601
+ "loss": 0.2163,
602
+ "step": 780
603
+ },
604
+ {
605
+ "epoch": 14.01,
606
+ "learning_rate": 3.9300411522633746e-05,
607
+ "loss": 0.4752,
608
+ "step": 790
609
+ },
610
+ {
611
+ "epoch": 14.01,
612
+ "learning_rate": 3.909465020576132e-05,
613
+ "loss": 0.5568,
614
+ "step": 800
615
+ },
616
+ {
617
+ "epoch": 14.01,
618
+ "learning_rate": 3.888888888888889e-05,
619
+ "loss": 0.3797,
620
+ "step": 810
621
+ },
622
+ {
623
+ "epoch": 14.02,
624
+ "learning_rate": 3.868312757201646e-05,
625
+ "loss": 0.3154,
626
+ "step": 820
627
+ },
628
+ {
629
+ "epoch": 14.02,
630
+ "eval_accuracy": 0.18382352941176472,
631
+ "eval_loss": 4.271665573120117,
632
+ "eval_runtime": 19.5325,
633
+ "eval_samples_per_second": 6.963,
634
+ "eval_steps_per_second": 1.178,
635
+ "step": 825
636
+ },
637
+ {
638
+ "epoch": 15.0,
639
+ "learning_rate": 3.8477366255144036e-05,
640
+ "loss": 0.3158,
641
+ "step": 830
642
+ },
643
+ {
644
+ "epoch": 15.01,
645
+ "learning_rate": 3.82716049382716e-05,
646
+ "loss": 0.3185,
647
+ "step": 840
648
+ },
649
+ {
650
+ "epoch": 15.01,
651
+ "learning_rate": 3.806584362139918e-05,
652
+ "loss": 0.3665,
653
+ "step": 850
654
+ },
655
+ {
656
+ "epoch": 15.01,
657
+ "learning_rate": 3.786008230452675e-05,
658
+ "loss": 0.246,
659
+ "step": 860
660
+ },
661
+ {
662
+ "epoch": 15.02,
663
+ "learning_rate": 3.7654320987654326e-05,
664
+ "loss": 0.5252,
665
+ "step": 870
666
+ },
667
+ {
668
+ "epoch": 15.02,
669
+ "learning_rate": 3.74485596707819e-05,
670
+ "loss": 0.309,
671
+ "step": 880
672
+ },
673
+ {
674
+ "epoch": 15.02,
675
+ "eval_accuracy": 0.058823529411764705,
676
+ "eval_loss": 4.946552276611328,
677
+ "eval_runtime": 18.5475,
678
+ "eval_samples_per_second": 7.333,
679
+ "eval_steps_per_second": 1.24,
680
+ "step": 880
681
+ },
682
+ {
683
+ "epoch": 16.0,
684
+ "learning_rate": 3.724279835390947e-05,
685
+ "loss": 0.294,
686
+ "step": 890
687
+ },
688
+ {
689
+ "epoch": 16.01,
690
+ "learning_rate": 3.7037037037037037e-05,
691
+ "loss": 0.4016,
692
+ "step": 900
693
+ },
694
+ {
695
+ "epoch": 16.01,
696
+ "learning_rate": 3.683127572016461e-05,
697
+ "loss": 0.2915,
698
+ "step": 910
699
+ },
700
+ {
701
+ "epoch": 16.01,
702
+ "learning_rate": 3.662551440329218e-05,
703
+ "loss": 0.2268,
704
+ "step": 920
705
+ },
706
+ {
707
+ "epoch": 16.02,
708
+ "learning_rate": 3.6419753086419754e-05,
709
+ "loss": 0.3094,
710
+ "step": 930
711
+ },
712
+ {
713
+ "epoch": 16.02,
714
+ "eval_accuracy": 0.014705882352941176,
715
+ "eval_loss": 5.539356708526611,
716
+ "eval_runtime": 18.4844,
717
+ "eval_samples_per_second": 7.358,
718
+ "eval_steps_per_second": 1.244,
719
+ "step": 935
720
+ },
721
+ {
722
+ "epoch": 17.0,
723
+ "learning_rate": 3.6213991769547327e-05,
724
+ "loss": 0.4337,
725
+ "step": 940
726
+ },
727
+ {
728
+ "epoch": 17.01,
729
+ "learning_rate": 3.60082304526749e-05,
730
+ "loss": 0.4705,
731
+ "step": 950
732
+ },
733
+ {
734
+ "epoch": 17.01,
735
+ "learning_rate": 3.580246913580247e-05,
736
+ "loss": 0.3836,
737
+ "step": 960
738
+ },
739
+ {
740
+ "epoch": 17.01,
741
+ "learning_rate": 3.5596707818930044e-05,
742
+ "loss": 0.2243,
743
+ "step": 970
744
+ },
745
+ {
746
+ "epoch": 17.02,
747
+ "learning_rate": 3.539094650205762e-05,
748
+ "loss": 0.29,
749
+ "step": 980
750
+ },
751
+ {
752
+ "epoch": 17.02,
753
+ "learning_rate": 3.518518518518519e-05,
754
+ "loss": 0.3333,
755
+ "step": 990
756
+ },
757
+ {
758
+ "epoch": 17.02,
759
+ "eval_accuracy": 0.09558823529411764,
760
+ "eval_loss": 5.0939555168151855,
761
+ "eval_runtime": 19.0139,
762
+ "eval_samples_per_second": 7.153,
763
+ "eval_steps_per_second": 1.21,
764
+ "step": 990
765
+ },
766
+ {
767
+ "epoch": 18.0,
768
+ "learning_rate": 3.497942386831276e-05,
769
+ "loss": 0.1621,
770
+ "step": 1000
771
+ },
772
+ {
773
+ "epoch": 18.01,
774
+ "learning_rate": 3.4773662551440334e-05,
775
+ "loss": 0.2036,
776
+ "step": 1010
777
+ },
778
+ {
779
+ "epoch": 18.01,
780
+ "learning_rate": 3.45679012345679e-05,
781
+ "loss": 0.1649,
782
+ "step": 1020
783
+ },
784
+ {
785
+ "epoch": 18.01,
786
+ "learning_rate": 3.436213991769547e-05,
787
+ "loss": 0.2498,
788
+ "step": 1030
789
+ },
790
+ {
791
+ "epoch": 18.02,
792
+ "learning_rate": 3.4156378600823045e-05,
793
+ "loss": 0.2299,
794
+ "step": 1040
795
+ },
796
+ {
797
+ "epoch": 18.02,
798
+ "eval_accuracy": 0.007352941176470588,
799
+ "eval_loss": 6.314783096313477,
800
+ "eval_runtime": 18.7617,
801
+ "eval_samples_per_second": 7.249,
802
+ "eval_steps_per_second": 1.226,
803
+ "step": 1045
804
+ },
805
+ {
806
+ "epoch": 19.0,
807
+ "learning_rate": 3.395061728395062e-05,
808
+ "loss": 0.3375,
809
+ "step": 1050
810
+ },
811
+ {
812
+ "epoch": 19.01,
813
+ "learning_rate": 3.374485596707819e-05,
814
+ "loss": 0.376,
815
+ "step": 1060
816
+ },
817
+ {
818
+ "epoch": 19.01,
819
+ "learning_rate": 3.353909465020576e-05,
820
+ "loss": 0.2132,
821
+ "step": 1070
822
+ },
823
+ {
824
+ "epoch": 19.01,
825
+ "learning_rate": 3.3333333333333335e-05,
826
+ "loss": 0.2873,
827
+ "step": 1080
828
+ },
829
+ {
830
+ "epoch": 19.02,
831
+ "learning_rate": 3.312757201646091e-05,
832
+ "loss": 0.1696,
833
+ "step": 1090
834
+ },
835
+ {
836
+ "epoch": 19.02,
837
+ "learning_rate": 3.292181069958848e-05,
838
+ "loss": 0.2257,
839
+ "step": 1100
840
+ },
841
+ {
842
+ "epoch": 19.02,
843
+ "eval_accuracy": 0.058823529411764705,
844
+ "eval_loss": 5.386910915374756,
845
+ "eval_runtime": 19.037,
846
+ "eval_samples_per_second": 7.144,
847
+ "eval_steps_per_second": 1.208,
848
+ "step": 1100
849
+ },
850
+ {
851
+ "epoch": 20.0,
852
+ "learning_rate": 3.271604938271605e-05,
853
+ "loss": 0.262,
854
+ "step": 1110
855
+ },
856
+ {
857
+ "epoch": 20.01,
858
+ "learning_rate": 3.2510288065843625e-05,
859
+ "loss": 0.2932,
860
+ "step": 1120
861
+ },
862
+ {
863
+ "epoch": 20.01,
864
+ "learning_rate": 3.230452674897119e-05,
865
+ "loss": 0.17,
866
+ "step": 1130
867
+ },
868
+ {
869
+ "epoch": 20.01,
870
+ "learning_rate": 3.209876543209876e-05,
871
+ "loss": 0.2872,
872
+ "step": 1140
873
+ },
874
+ {
875
+ "epoch": 20.02,
876
+ "learning_rate": 3.1893004115226336e-05,
877
+ "loss": 0.255,
878
+ "step": 1150
879
+ },
880
+ {
881
+ "epoch": 20.02,
882
+ "eval_accuracy": 0.014705882352941176,
883
+ "eval_loss": 6.413440704345703,
884
+ "eval_runtime": 19.1203,
885
+ "eval_samples_per_second": 7.113,
886
+ "eval_steps_per_second": 1.203,
887
+ "step": 1155
888
+ },
889
+ {
890
+ "epoch": 21.0,
891
+ "learning_rate": 3.168724279835391e-05,
892
+ "loss": 0.173,
893
+ "step": 1160
894
+ },
895
+ {
896
+ "epoch": 21.01,
897
+ "learning_rate": 3.148148148148148e-05,
898
+ "loss": 0.2732,
899
+ "step": 1170
900
+ },
901
+ {
902
+ "epoch": 21.01,
903
+ "learning_rate": 3.127572016460906e-05,
904
+ "loss": 0.175,
905
+ "step": 1180
906
+ },
907
+ {
908
+ "epoch": 21.01,
909
+ "learning_rate": 3.1069958847736626e-05,
910
+ "loss": 0.2022,
911
+ "step": 1190
912
+ },
913
+ {
914
+ "epoch": 21.02,
915
+ "learning_rate": 3.08641975308642e-05,
916
+ "loss": 0.2273,
917
+ "step": 1200
918
+ },
919
+ {
920
+ "epoch": 21.02,
921
+ "learning_rate": 3.065843621399177e-05,
922
+ "loss": 0.2335,
923
+ "step": 1210
924
+ },
925
+ {
926
+ "epoch": 21.02,
927
+ "eval_accuracy": 0.04411764705882353,
928
+ "eval_loss": 6.141349792480469,
929
+ "eval_runtime": 19.4239,
930
+ "eval_samples_per_second": 7.002,
931
+ "eval_steps_per_second": 1.184,
932
+ "step": 1210
933
+ },
934
+ {
935
+ "epoch": 22.0,
936
+ "learning_rate": 3.0452674897119343e-05,
937
+ "loss": 0.223,
938
+ "step": 1220
939
+ },
940
+ {
941
+ "epoch": 22.01,
942
+ "learning_rate": 3.0246913580246916e-05,
943
+ "loss": 0.226,
944
+ "step": 1230
945
+ },
946
+ {
947
+ "epoch": 22.01,
948
+ "learning_rate": 3.0041152263374488e-05,
949
+ "loss": 0.3511,
950
+ "step": 1240
951
+ },
952
+ {
953
+ "epoch": 22.01,
954
+ "learning_rate": 2.9835390946502057e-05,
955
+ "loss": 0.1201,
956
+ "step": 1250
957
+ },
958
+ {
959
+ "epoch": 22.02,
960
+ "learning_rate": 2.962962962962963e-05,
961
+ "loss": 0.3507,
962
+ "step": 1260
963
+ },
964
+ {
965
+ "epoch": 22.02,
966
+ "eval_accuracy": 0.007352941176470588,
967
+ "eval_loss": 6.291131973266602,
968
+ "eval_runtime": 18.6286,
969
+ "eval_samples_per_second": 7.301,
970
+ "eval_steps_per_second": 1.235,
971
+ "step": 1265
972
+ },
973
+ {
974
+ "epoch": 23.0,
975
+ "learning_rate": 2.9423868312757202e-05,
976
+ "loss": 0.3065,
977
+ "step": 1270
978
+ },
979
+ {
980
+ "epoch": 23.01,
981
+ "learning_rate": 2.9218106995884775e-05,
982
+ "loss": 0.119,
983
+ "step": 1280
984
+ },
985
+ {
986
+ "epoch": 23.01,
987
+ "learning_rate": 2.9012345679012347e-05,
988
+ "loss": 0.31,
989
+ "step": 1290
990
+ },
991
+ {
992
+ "epoch": 23.01,
993
+ "learning_rate": 2.880658436213992e-05,
994
+ "loss": 0.3629,
995
+ "step": 1300
996
+ },
997
+ {
998
+ "epoch": 23.02,
999
+ "learning_rate": 2.860082304526749e-05,
1000
+ "loss": 0.1736,
1001
+ "step": 1310
1002
+ },
1003
+ {
1004
+ "epoch": 23.02,
1005
+ "learning_rate": 2.839506172839506e-05,
1006
+ "loss": 0.1463,
1007
+ "step": 1320
1008
+ },
1009
+ {
1010
+ "epoch": 23.02,
1011
+ "eval_accuracy": 0.007352941176470588,
1012
+ "eval_loss": 6.527339935302734,
1013
+ "eval_runtime": 19.3595,
1014
+ "eval_samples_per_second": 7.025,
1015
+ "eval_steps_per_second": 1.188,
1016
+ "step": 1320
1017
+ },
1018
+ {
1019
+ "epoch": 24.0,
1020
+ "learning_rate": 2.8189300411522634e-05,
1021
+ "loss": 0.1214,
1022
+ "step": 1330
1023
+ },
1024
+ {
1025
+ "epoch": 24.01,
1026
+ "learning_rate": 2.7983539094650207e-05,
1027
+ "loss": 0.2213,
1028
+ "step": 1340
1029
+ },
1030
+ {
1031
+ "epoch": 24.01,
1032
+ "learning_rate": 2.777777777777778e-05,
1033
+ "loss": 0.1491,
1034
+ "step": 1350
1035
+ },
1036
+ {
1037
+ "epoch": 24.01,
1038
+ "learning_rate": 2.757201646090535e-05,
1039
+ "loss": 0.1312,
1040
+ "step": 1360
1041
+ },
1042
+ {
1043
+ "epoch": 24.02,
1044
+ "learning_rate": 2.736625514403292e-05,
1045
+ "loss": 0.193,
1046
+ "step": 1370
1047
+ },
1048
+ {
1049
+ "epoch": 24.02,
1050
+ "eval_accuracy": 0.007352941176470588,
1051
+ "eval_loss": 6.6533203125,
1052
+ "eval_runtime": 19.6174,
1053
+ "eval_samples_per_second": 6.933,
1054
+ "eval_steps_per_second": 1.172,
1055
+ "step": 1375
1056
+ },
1057
+ {
1058
+ "epoch": 25.0,
1059
+ "learning_rate": 2.7160493827160493e-05,
1060
+ "loss": 0.2329,
1061
+ "step": 1380
1062
+ },
1063
+ {
1064
+ "epoch": 25.01,
1065
+ "learning_rate": 2.6954732510288066e-05,
1066
+ "loss": 0.2651,
1067
+ "step": 1390
1068
+ },
1069
+ {
1070
+ "epoch": 25.01,
1071
+ "learning_rate": 2.6748971193415638e-05,
1072
+ "loss": 0.2483,
1073
+ "step": 1400
1074
+ },
1075
+ {
1076
+ "epoch": 25.01,
1077
+ "learning_rate": 2.654320987654321e-05,
1078
+ "loss": 0.0754,
1079
+ "step": 1410
1080
+ },
1081
+ {
1082
+ "epoch": 25.02,
1083
+ "learning_rate": 2.6337448559670787e-05,
1084
+ "loss": 0.1554,
1085
+ "step": 1420
1086
+ },
1087
+ {
1088
+ "epoch": 25.02,
1089
+ "learning_rate": 2.6131687242798352e-05,
1090
+ "loss": 0.1167,
1091
+ "step": 1430
1092
+ },
1093
+ {
1094
+ "epoch": 25.02,
1095
+ "eval_accuracy": 0.0,
1096
+ "eval_loss": 6.809352874755859,
1097
+ "eval_runtime": 18.9052,
1098
+ "eval_samples_per_second": 7.194,
1099
+ "eval_steps_per_second": 1.217,
1100
+ "step": 1430
1101
+ },
1102
+ {
1103
+ "epoch": 26.0,
1104
+ "learning_rate": 2.5925925925925925e-05,
1105
+ "loss": 0.1468,
1106
+ "step": 1440
1107
+ },
1108
+ {
1109
+ "epoch": 26.01,
1110
+ "learning_rate": 2.5720164609053497e-05,
1111
+ "loss": 0.1028,
1112
+ "step": 1450
1113
+ },
1114
+ {
1115
+ "epoch": 26.01,
1116
+ "learning_rate": 2.551440329218107e-05,
1117
+ "loss": 0.2864,
1118
+ "step": 1460
1119
+ },
1120
+ {
1121
+ "epoch": 26.01,
1122
+ "learning_rate": 2.5308641975308646e-05,
1123
+ "loss": 0.1794,
1124
+ "step": 1470
1125
+ },
1126
+ {
1127
+ "epoch": 26.02,
1128
+ "learning_rate": 2.510288065843622e-05,
1129
+ "loss": 0.1168,
1130
+ "step": 1480
1131
+ },
1132
+ {
1133
+ "epoch": 26.02,
1134
+ "eval_accuracy": 0.0,
1135
+ "eval_loss": 6.763158321380615,
1136
+ "eval_runtime": 19.2445,
1137
+ "eval_samples_per_second": 7.067,
1138
+ "eval_steps_per_second": 1.195,
1139
+ "step": 1485
1140
+ },
1141
+ {
1142
+ "epoch": 27.0,
1143
+ "learning_rate": 2.4897119341563787e-05,
1144
+ "loss": 0.153,
1145
+ "step": 1490
1146
+ },
1147
+ {
1148
+ "epoch": 27.01,
1149
+ "learning_rate": 2.4691358024691357e-05,
1150
+ "loss": 0.1269,
1151
+ "step": 1500
1152
+ },
1153
+ {
1154
+ "epoch": 27.01,
1155
+ "learning_rate": 2.4485596707818932e-05,
1156
+ "loss": 0.1475,
1157
+ "step": 1510
1158
+ },
1159
+ {
1160
+ "epoch": 27.01,
1161
+ "learning_rate": 2.4279835390946505e-05,
1162
+ "loss": 0.3628,
1163
+ "step": 1520
1164
+ },
1165
+ {
1166
+ "epoch": 27.02,
1167
+ "learning_rate": 2.4074074074074074e-05,
1168
+ "loss": 0.1292,
1169
+ "step": 1530
1170
+ },
1171
+ {
1172
+ "epoch": 27.02,
1173
+ "learning_rate": 2.3868312757201647e-05,
1174
+ "loss": 0.0511,
1175
+ "step": 1540
1176
+ },
1177
+ {
1178
+ "epoch": 27.02,
1179
+ "eval_accuracy": 0.007352941176470588,
1180
+ "eval_loss": 7.004645824432373,
1181
+ "eval_runtime": 18.9657,
1182
+ "eval_samples_per_second": 7.171,
1183
+ "eval_steps_per_second": 1.213,
1184
+ "step": 1540
1185
+ },
1186
+ {
1187
+ "epoch": 28.0,
1188
+ "learning_rate": 2.366255144032922e-05,
1189
+ "loss": 0.1885,
1190
+ "step": 1550
1191
+ },
1192
+ {
1193
+ "epoch": 28.01,
1194
+ "learning_rate": 2.345679012345679e-05,
1195
+ "loss": 0.1131,
1196
+ "step": 1560
1197
+ },
1198
+ {
1199
+ "epoch": 28.01,
1200
+ "learning_rate": 2.3251028806584364e-05,
1201
+ "loss": 0.1701,
1202
+ "step": 1570
1203
+ },
1204
+ {
1205
+ "epoch": 28.01,
1206
+ "learning_rate": 2.3045267489711937e-05,
1207
+ "loss": 0.0717,
1208
+ "step": 1580
1209
+ },
1210
+ {
1211
+ "epoch": 28.02,
1212
+ "learning_rate": 2.2839506172839506e-05,
1213
+ "loss": 0.1336,
1214
+ "step": 1590
1215
+ },
1216
+ {
1217
+ "epoch": 28.02,
1218
+ "eval_accuracy": 0.0,
1219
+ "eval_loss": 7.287693023681641,
1220
+ "eval_runtime": 18.4974,
1221
+ "eval_samples_per_second": 7.352,
1222
+ "eval_steps_per_second": 1.243,
1223
+ "step": 1595
1224
+ },
1225
+ {
1226
+ "epoch": 29.0,
1227
+ "learning_rate": 2.2633744855967078e-05,
1228
+ "loss": 0.3002,
1229
+ "step": 1600
1230
+ },
1231
+ {
1232
+ "epoch": 29.01,
1233
+ "learning_rate": 2.242798353909465e-05,
1234
+ "loss": 0.1882,
1235
+ "step": 1610
1236
+ },
1237
+ {
1238
+ "epoch": 29.01,
1239
+ "learning_rate": 2.2222222222222223e-05,
1240
+ "loss": 0.1417,
1241
+ "step": 1620
1242
+ },
1243
+ {
1244
+ "epoch": 29.01,
1245
+ "learning_rate": 2.2016460905349796e-05,
1246
+ "loss": 0.053,
1247
+ "step": 1630
1248
+ },
1249
+ {
1250
+ "epoch": 29.02,
1251
+ "learning_rate": 2.1810699588477368e-05,
1252
+ "loss": 0.1451,
1253
+ "step": 1640
1254
+ },
1255
+ {
1256
+ "epoch": 29.02,
1257
+ "learning_rate": 2.1604938271604937e-05,
1258
+ "loss": 0.1518,
1259
+ "step": 1650
1260
+ },
1261
+ {
1262
+ "epoch": 29.02,
1263
+ "eval_accuracy": 0.0,
1264
+ "eval_loss": 7.310234069824219,
1265
+ "eval_runtime": 18.7122,
1266
+ "eval_samples_per_second": 7.268,
1267
+ "eval_steps_per_second": 1.229,
1268
+ "step": 1650
1269
+ },
1270
+ {
1271
+ "epoch": 30.0,
1272
+ "learning_rate": 2.139917695473251e-05,
1273
+ "loss": 0.0757,
1274
+ "step": 1660
1275
+ },
1276
+ {
1277
+ "epoch": 30.01,
1278
+ "learning_rate": 2.1193415637860082e-05,
1279
+ "loss": 0.119,
1280
+ "step": 1670
1281
+ },
1282
+ {
1283
+ "epoch": 30.01,
1284
+ "learning_rate": 2.0987654320987655e-05,
1285
+ "loss": 0.2,
1286
+ "step": 1680
1287
+ },
1288
+ {
1289
+ "epoch": 30.01,
1290
+ "learning_rate": 2.0781893004115227e-05,
1291
+ "loss": 0.1005,
1292
+ "step": 1690
1293
+ },
1294
+ {
1295
+ "epoch": 30.02,
1296
+ "learning_rate": 2.05761316872428e-05,
1297
+ "loss": 0.1972,
1298
+ "step": 1700
1299
+ },
1300
+ {
1301
+ "epoch": 30.02,
1302
+ "eval_accuracy": 0.0,
1303
+ "eval_loss": 7.163204669952393,
1304
+ "eval_runtime": 18.8868,
1305
+ "eval_samples_per_second": 7.201,
1306
+ "eval_steps_per_second": 1.218,
1307
+ "step": 1705
1308
+ },
1309
+ {
1310
+ "epoch": 31.0,
1311
+ "learning_rate": 2.037037037037037e-05,
1312
+ "loss": 0.3282,
1313
+ "step": 1710
1314
+ },
1315
+ {
1316
+ "epoch": 31.01,
1317
+ "learning_rate": 2.016460905349794e-05,
1318
+ "loss": 0.1741,
1319
+ "step": 1720
1320
+ },
1321
+ {
1322
+ "epoch": 31.01,
1323
+ "learning_rate": 1.9958847736625517e-05,
1324
+ "loss": 0.1258,
1325
+ "step": 1730
1326
+ },
1327
+ {
1328
+ "epoch": 31.01,
1329
+ "learning_rate": 1.9753086419753087e-05,
1330
+ "loss": 0.1061,
1331
+ "step": 1740
1332
+ },
1333
+ {
1334
+ "epoch": 31.02,
1335
+ "learning_rate": 1.954732510288066e-05,
1336
+ "loss": 0.1131,
1337
+ "step": 1750
1338
+ },
1339
+ {
1340
+ "epoch": 31.02,
1341
+ "learning_rate": 1.934156378600823e-05,
1342
+ "loss": 0.0605,
1343
+ "step": 1760
1344
+ },
1345
+ {
1346
+ "epoch": 31.02,
1347
+ "eval_accuracy": 0.0,
1348
+ "eval_loss": 7.296962738037109,
1349
+ "eval_runtime": 19.2119,
1350
+ "eval_samples_per_second": 7.079,
1351
+ "eval_steps_per_second": 1.197,
1352
+ "step": 1760
1353
+ },
1354
+ {
1355
+ "epoch": 32.0,
1356
+ "learning_rate": 1.91358024691358e-05,
1357
+ "loss": 0.1463,
1358
+ "step": 1770
1359
+ },
1360
+ {
1361
+ "epoch": 32.01,
1362
+ "learning_rate": 1.8930041152263377e-05,
1363
+ "loss": 0.1264,
1364
+ "step": 1780
1365
+ },
1366
+ {
1367
+ "epoch": 32.01,
1368
+ "learning_rate": 1.872427983539095e-05,
1369
+ "loss": 0.1558,
1370
+ "step": 1790
1371
+ },
1372
+ {
1373
+ "epoch": 32.01,
1374
+ "learning_rate": 1.8518518518518518e-05,
1375
+ "loss": 0.2069,
1376
+ "step": 1800
1377
+ },
1378
+ {
1379
+ "epoch": 32.02,
1380
+ "learning_rate": 1.831275720164609e-05,
1381
+ "loss": 0.1633,
1382
+ "step": 1810
1383
+ },
1384
+ {
1385
+ "epoch": 32.02,
1386
+ "eval_accuracy": 0.0,
1387
+ "eval_loss": 7.34273099899292,
1388
+ "eval_runtime": 19.2376,
1389
+ "eval_samples_per_second": 7.069,
1390
+ "eval_steps_per_second": 1.196,
1391
+ "step": 1815
1392
+ },
1393
+ {
1394
+ "epoch": 33.0,
1395
+ "learning_rate": 1.8106995884773663e-05,
1396
+ "loss": 0.1313,
1397
+ "step": 1820
1398
+ },
1399
+ {
1400
+ "epoch": 33.01,
1401
+ "learning_rate": 1.7901234567901236e-05,
1402
+ "loss": 0.1187,
1403
+ "step": 1830
1404
+ },
1405
+ {
1406
+ "epoch": 33.01,
1407
+ "learning_rate": 1.769547325102881e-05,
1408
+ "loss": 0.1455,
1409
+ "step": 1840
1410
+ },
1411
+ {
1412
+ "epoch": 33.01,
1413
+ "learning_rate": 1.748971193415638e-05,
1414
+ "loss": 0.0554,
1415
+ "step": 1850
1416
+ },
1417
+ {
1418
+ "epoch": 33.02,
1419
+ "learning_rate": 1.728395061728395e-05,
1420
+ "loss": 0.1677,
1421
+ "step": 1860
1422
+ },
1423
+ {
1424
+ "epoch": 33.02,
1425
+ "learning_rate": 1.7078189300411522e-05,
1426
+ "loss": 0.1902,
1427
+ "step": 1870
1428
+ },
1429
+ {
1430
+ "epoch": 33.02,
1431
+ "eval_accuracy": 0.0,
1432
+ "eval_loss": 7.409451484680176,
1433
+ "eval_runtime": 19.5055,
1434
+ "eval_samples_per_second": 6.972,
1435
+ "eval_steps_per_second": 1.179,
1436
+ "step": 1870
1437
+ },
1438
+ {
1439
+ "epoch": 34.0,
1440
+ "learning_rate": 1.6872427983539095e-05,
1441
+ "loss": 0.2543,
1442
+ "step": 1880
1443
+ },
1444
+ {
1445
+ "epoch": 34.01,
1446
+ "learning_rate": 1.6666666666666667e-05,
1447
+ "loss": 0.1069,
1448
+ "step": 1890
1449
+ },
1450
+ {
1451
+ "epoch": 34.01,
1452
+ "learning_rate": 1.646090534979424e-05,
1453
+ "loss": 0.1131,
1454
+ "step": 1900
1455
+ },
1456
+ {
1457
+ "epoch": 34.01,
1458
+ "learning_rate": 1.6255144032921812e-05,
1459
+ "loss": 0.0825,
1460
+ "step": 1910
1461
+ },
1462
+ {
1463
+ "epoch": 34.02,
1464
+ "learning_rate": 1.604938271604938e-05,
1465
+ "loss": 0.132,
1466
+ "step": 1920
1467
+ },
1468
+ {
1469
+ "epoch": 34.02,
1470
+ "eval_accuracy": 0.0,
1471
+ "eval_loss": 7.31688928604126,
1472
+ "eval_runtime": 19.5592,
1473
+ "eval_samples_per_second": 6.953,
1474
+ "eval_steps_per_second": 1.176,
1475
+ "step": 1925
1476
+ },
1477
+ {
1478
+ "epoch": 35.0,
1479
+ "learning_rate": 1.5843621399176954e-05,
1480
+ "loss": 0.168,
1481
+ "step": 1930
1482
+ },
1483
+ {
1484
+ "epoch": 35.01,
1485
+ "learning_rate": 1.563786008230453e-05,
1486
+ "loss": 0.1214,
1487
+ "step": 1940
1488
+ },
1489
+ {
1490
+ "epoch": 35.01,
1491
+ "learning_rate": 1.54320987654321e-05,
1492
+ "loss": 0.0863,
1493
+ "step": 1950
1494
+ },
1495
+ {
1496
+ "epoch": 35.01,
1497
+ "learning_rate": 1.5226337448559672e-05,
1498
+ "loss": 0.1013,
1499
+ "step": 1960
1500
+ },
1501
+ {
1502
+ "epoch": 35.02,
1503
+ "learning_rate": 1.5020576131687244e-05,
1504
+ "loss": 0.0962,
1505
+ "step": 1970
1506
+ },
1507
+ {
1508
+ "epoch": 35.02,
1509
+ "learning_rate": 1.4814814814814815e-05,
1510
+ "loss": 0.1226,
1511
+ "step": 1980
1512
+ },
1513
+ {
1514
+ "epoch": 35.02,
1515
+ "eval_accuracy": 0.007352941176470588,
1516
+ "eval_loss": 7.419619560241699,
1517
+ "eval_runtime": 19.4051,
1518
+ "eval_samples_per_second": 7.008,
1519
+ "eval_steps_per_second": 1.185,
1520
+ "step": 1980
1521
+ },
1522
+ {
1523
+ "epoch": 36.0,
1524
+ "learning_rate": 1.4609053497942387e-05,
1525
+ "loss": 0.0864,
1526
+ "step": 1990
1527
+ },
1528
+ {
1529
+ "epoch": 36.01,
1530
+ "learning_rate": 1.440329218106996e-05,
1531
+ "loss": 0.1085,
1532
+ "step": 2000
1533
+ },
1534
+ {
1535
+ "epoch": 36.01,
1536
+ "learning_rate": 1.419753086419753e-05,
1537
+ "loss": 0.105,
1538
+ "step": 2010
1539
+ },
1540
+ {
1541
+ "epoch": 36.01,
1542
+ "learning_rate": 1.3991769547325103e-05,
1543
+ "loss": 0.1557,
1544
+ "step": 2020
1545
+ },
1546
+ {
1547
+ "epoch": 36.02,
1548
+ "learning_rate": 1.3786008230452676e-05,
1549
+ "loss": 0.115,
1550
+ "step": 2030
1551
+ },
1552
+ {
1553
+ "epoch": 36.02,
1554
+ "eval_accuracy": 0.007352941176470588,
1555
+ "eval_loss": 7.324816703796387,
1556
+ "eval_runtime": 19.4998,
1557
+ "eval_samples_per_second": 6.974,
1558
+ "eval_steps_per_second": 1.18,
1559
+ "step": 2035
1560
+ },
1561
+ {
1562
+ "epoch": 37.0,
1563
+ "learning_rate": 1.3580246913580247e-05,
1564
+ "loss": 0.1213,
1565
+ "step": 2040
1566
+ },
1567
+ {
1568
+ "epoch": 37.01,
1569
+ "learning_rate": 1.3374485596707819e-05,
1570
+ "loss": 0.1438,
1571
+ "step": 2050
1572
+ },
1573
+ {
1574
+ "epoch": 37.01,
1575
+ "learning_rate": 1.3168724279835393e-05,
1576
+ "loss": 0.0898,
1577
+ "step": 2060
1578
+ },
1579
+ {
1580
+ "epoch": 37.01,
1581
+ "learning_rate": 1.2962962962962962e-05,
1582
+ "loss": 0.0357,
1583
+ "step": 2070
1584
+ },
1585
+ {
1586
+ "epoch": 37.02,
1587
+ "learning_rate": 1.2757201646090535e-05,
1588
+ "loss": 0.1411,
1589
+ "step": 2080
1590
+ },
1591
+ {
1592
+ "epoch": 37.02,
1593
+ "learning_rate": 1.255144032921811e-05,
1594
+ "loss": 0.1348,
1595
+ "step": 2090
1596
+ },
1597
+ {
1598
+ "epoch": 37.02,
1599
+ "eval_accuracy": 0.0,
1600
+ "eval_loss": 7.131798267364502,
1601
+ "eval_runtime": 19.3599,
1602
+ "eval_samples_per_second": 7.025,
1603
+ "eval_steps_per_second": 1.188,
1604
+ "step": 2090
1605
+ },
1606
+ {
1607
+ "epoch": 38.0,
1608
+ "learning_rate": 1.2345679012345678e-05,
1609
+ "loss": 0.079,
1610
+ "step": 2100
1611
+ },
1612
+ {
1613
+ "epoch": 38.01,
1614
+ "learning_rate": 1.2139917695473252e-05,
1615
+ "loss": 0.1512,
1616
+ "step": 2110
1617
+ },
1618
+ {
1619
+ "epoch": 38.01,
1620
+ "learning_rate": 1.1934156378600823e-05,
1621
+ "loss": 0.0962,
1622
+ "step": 2120
1623
+ },
1624
+ {
1625
+ "epoch": 38.01,
1626
+ "learning_rate": 1.1728395061728396e-05,
1627
+ "loss": 0.1232,
1628
+ "step": 2130
1629
+ },
1630
+ {
1631
+ "epoch": 38.02,
1632
+ "learning_rate": 1.1522633744855968e-05,
1633
+ "loss": 0.1684,
1634
+ "step": 2140
1635
+ },
1636
+ {
1637
+ "epoch": 38.02,
1638
+ "eval_accuracy": 0.0,
1639
+ "eval_loss": 7.648235321044922,
1640
+ "eval_runtime": 19.5601,
1641
+ "eval_samples_per_second": 6.953,
1642
+ "eval_steps_per_second": 1.176,
1643
+ "step": 2145
1644
+ },
1645
+ {
1646
+ "epoch": 39.0,
1647
+ "learning_rate": 1.1316872427983539e-05,
1648
+ "loss": 0.1614,
1649
+ "step": 2150
1650
+ },
1651
+ {
1652
+ "epoch": 39.01,
1653
+ "learning_rate": 1.1111111111111112e-05,
1654
+ "loss": 0.0955,
1655
+ "step": 2160
1656
+ },
1657
+ {
1658
+ "epoch": 39.01,
1659
+ "learning_rate": 1.0905349794238684e-05,
1660
+ "loss": 0.1675,
1661
+ "step": 2170
1662
+ },
1663
+ {
1664
+ "epoch": 39.01,
1665
+ "learning_rate": 1.0699588477366255e-05,
1666
+ "loss": 0.1518,
1667
+ "step": 2180
1668
+ },
1669
+ {
1670
+ "epoch": 39.02,
1671
+ "learning_rate": 1.0493827160493827e-05,
1672
+ "loss": 0.1098,
1673
+ "step": 2190
1674
+ },
1675
+ {
1676
+ "epoch": 39.02,
1677
+ "learning_rate": 1.02880658436214e-05,
1678
+ "loss": 0.0722,
1679
+ "step": 2200
1680
+ },
1681
+ {
1682
+ "epoch": 39.02,
1683
+ "eval_accuracy": 0.007352941176470588,
1684
+ "eval_loss": 7.594442844390869,
1685
+ "eval_runtime": 19.5713,
1686
+ "eval_samples_per_second": 6.949,
1687
+ "eval_steps_per_second": 1.175,
1688
+ "step": 2200
1689
+ },
1690
+ {
1691
+ "epoch": 40.0,
1692
+ "learning_rate": 1.008230452674897e-05,
1693
+ "loss": 0.1132,
1694
+ "step": 2210
1695
+ },
1696
+ {
1697
+ "epoch": 40.01,
1698
+ "learning_rate": 9.876543209876543e-06,
1699
+ "loss": 0.127,
1700
+ "step": 2220
1701
+ },
1702
+ {
1703
+ "epoch": 40.01,
1704
+ "learning_rate": 9.670781893004116e-06,
1705
+ "loss": 0.0605,
1706
+ "step": 2230
1707
+ },
1708
+ {
1709
+ "epoch": 40.01,
1710
+ "learning_rate": 9.465020576131688e-06,
1711
+ "loss": 0.1263,
1712
+ "step": 2240
1713
+ },
1714
+ {
1715
+ "epoch": 40.02,
1716
+ "learning_rate": 9.259259259259259e-06,
1717
+ "loss": 0.1155,
1718
+ "step": 2250
1719
+ },
1720
+ {
1721
+ "epoch": 40.02,
1722
+ "eval_accuracy": 0.0,
1723
+ "eval_loss": 7.561499118804932,
1724
+ "eval_runtime": 19.559,
1725
+ "eval_samples_per_second": 6.953,
1726
+ "eval_steps_per_second": 1.176,
1727
+ "step": 2255
1728
+ },
1729
+ {
1730
+ "epoch": 41.0,
1731
+ "learning_rate": 9.053497942386832e-06,
1732
+ "loss": 0.1481,
1733
+ "step": 2260
1734
+ },
1735
+ {
1736
+ "epoch": 41.01,
1737
+ "learning_rate": 8.847736625514404e-06,
1738
+ "loss": 0.1293,
1739
+ "step": 2270
1740
+ },
1741
+ {
1742
+ "epoch": 41.01,
1743
+ "learning_rate": 8.641975308641975e-06,
1744
+ "loss": 0.102,
1745
+ "step": 2280
1746
+ },
1747
+ {
1748
+ "epoch": 41.01,
1749
+ "learning_rate": 8.436213991769547e-06,
1750
+ "loss": 0.1447,
1751
+ "step": 2290
1752
+ },
1753
+ {
1754
+ "epoch": 41.02,
1755
+ "learning_rate": 8.23045267489712e-06,
1756
+ "loss": 0.0593,
1757
+ "step": 2300
1758
+ },
1759
+ {
1760
+ "epoch": 41.02,
1761
+ "learning_rate": 8.02469135802469e-06,
1762
+ "loss": 0.1425,
1763
+ "step": 2310
1764
+ },
1765
+ {
1766
+ "epoch": 41.02,
1767
+ "eval_accuracy": 0.007352941176470588,
1768
+ "eval_loss": 7.645389556884766,
1769
+ "eval_runtime": 19.1466,
1770
+ "eval_samples_per_second": 7.103,
1771
+ "eval_steps_per_second": 1.201,
1772
+ "step": 2310
1773
+ },
1774
+ {
1775
+ "epoch": 42.0,
1776
+ "learning_rate": 7.818930041152265e-06,
1777
+ "loss": 0.0842,
1778
+ "step": 2320
1779
+ },
1780
+ {
1781
+ "epoch": 42.01,
1782
+ "learning_rate": 7.613168724279836e-06,
1783
+ "loss": 0.0962,
1784
+ "step": 2330
1785
+ },
1786
+ {
1787
+ "epoch": 42.01,
1788
+ "learning_rate": 7.4074074074074075e-06,
1789
+ "loss": 0.1109,
1790
+ "step": 2340
1791
+ },
1792
+ {
1793
+ "epoch": 42.01,
1794
+ "learning_rate": 7.20164609053498e-06,
1795
+ "loss": 0.0989,
1796
+ "step": 2350
1797
+ },
1798
+ {
1799
+ "epoch": 42.02,
1800
+ "learning_rate": 6.995884773662552e-06,
1801
+ "loss": 0.1552,
1802
+ "step": 2360
1803
+ },
1804
+ {
1805
+ "epoch": 42.02,
1806
+ "eval_accuracy": 0.007352941176470588,
1807
+ "eval_loss": 7.477428436279297,
1808
+ "eval_runtime": 19.4448,
1809
+ "eval_samples_per_second": 6.994,
1810
+ "eval_steps_per_second": 1.183,
1811
+ "step": 2365
1812
+ },
1813
+ {
1814
+ "epoch": 43.0,
1815
+ "learning_rate": 6.790123456790123e-06,
1816
+ "loss": 0.1492,
1817
+ "step": 2370
1818
+ },
1819
+ {
1820
+ "epoch": 43.01,
1821
+ "learning_rate": 6.584362139917697e-06,
1822
+ "loss": 0.095,
1823
+ "step": 2380
1824
+ },
1825
+ {
1826
+ "epoch": 43.01,
1827
+ "learning_rate": 6.3786008230452675e-06,
1828
+ "loss": 0.0934,
1829
+ "step": 2390
1830
+ },
1831
+ {
1832
+ "epoch": 43.01,
1833
+ "learning_rate": 6.172839506172839e-06,
1834
+ "loss": 0.1175,
1835
+ "step": 2400
1836
+ },
1837
+ {
1838
+ "epoch": 43.02,
1839
+ "learning_rate": 5.967078189300412e-06,
1840
+ "loss": 0.1298,
1841
+ "step": 2410
1842
+ },
1843
+ {
1844
+ "epoch": 43.02,
1845
+ "learning_rate": 5.761316872427984e-06,
1846
+ "loss": 0.1078,
1847
+ "step": 2420
1848
+ },
1849
+ {
1850
+ "epoch": 43.02,
1851
+ "eval_accuracy": 0.007352941176470588,
1852
+ "eval_loss": 7.3990559577941895,
1853
+ "eval_runtime": 19.5393,
1854
+ "eval_samples_per_second": 6.96,
1855
+ "eval_steps_per_second": 1.177,
1856
+ "step": 2420
1857
+ },
1858
+ {
1859
+ "epoch": 44.0,
1860
+ "learning_rate": 5.555555555555556e-06,
1861
+ "loss": 0.1088,
1862
+ "step": 2430
1863
+ },
1864
+ {
1865
+ "epoch": 44.01,
1866
+ "learning_rate": 5.3497942386831275e-06,
1867
+ "loss": 0.1179,
1868
+ "step": 2440
1869
+ },
1870
+ {
1871
+ "epoch": 44.01,
1872
+ "learning_rate": 5.1440329218107e-06,
1873
+ "loss": 0.1019,
1874
+ "step": 2450
1875
+ },
1876
+ {
1877
+ "epoch": 44.01,
1878
+ "learning_rate": 4.938271604938272e-06,
1879
+ "loss": 0.0844,
1880
+ "step": 2460
1881
+ },
1882
+ {
1883
+ "epoch": 44.02,
1884
+ "learning_rate": 4.732510288065844e-06,
1885
+ "loss": 0.1169,
1886
+ "step": 2470
1887
+ },
1888
+ {
1889
+ "epoch": 44.02,
1890
+ "eval_accuracy": 0.0,
1891
+ "eval_loss": 7.32404899597168,
1892
+ "eval_runtime": 19.4463,
1893
+ "eval_samples_per_second": 6.994,
1894
+ "eval_steps_per_second": 1.183,
1895
+ "step": 2475
1896
+ },
1897
+ {
1898
+ "epoch": 45.0,
1899
+ "learning_rate": 4.526748971193416e-06,
1900
+ "loss": 0.1361,
1901
+ "step": 2480
1902
+ },
1903
+ {
1904
+ "epoch": 45.01,
1905
+ "learning_rate": 4.3209876543209875e-06,
1906
+ "loss": 0.1422,
1907
+ "step": 2490
1908
+ },
1909
+ {
1910
+ "epoch": 45.01,
1911
+ "learning_rate": 4.11522633744856e-06,
1912
+ "loss": 0.0732,
1913
+ "step": 2500
1914
+ },
1915
+ {
1916
+ "epoch": 45.01,
1917
+ "learning_rate": 3.9094650205761325e-06,
1918
+ "loss": 0.0721,
1919
+ "step": 2510
1920
+ },
1921
+ {
1922
+ "epoch": 45.02,
1923
+ "learning_rate": 3.7037037037037037e-06,
1924
+ "loss": 0.1091,
1925
+ "step": 2520
1926
+ },
1927
+ {
1928
+ "epoch": 45.02,
1929
+ "learning_rate": 3.497942386831276e-06,
1930
+ "loss": 0.1438,
1931
+ "step": 2530
1932
+ },
1933
+ {
1934
+ "epoch": 45.02,
1935
+ "eval_accuracy": 0.0,
1936
+ "eval_loss": 7.413323402404785,
1937
+ "eval_runtime": 19.5353,
1938
+ "eval_samples_per_second": 6.962,
1939
+ "eval_steps_per_second": 1.177,
1940
+ "step": 2530
1941
+ },
1942
+ {
1943
+ "epoch": 46.0,
1944
+ "learning_rate": 3.2921810699588483e-06,
1945
+ "loss": 0.0717,
1946
+ "step": 2540
1947
+ },
1948
+ {
1949
+ "epoch": 46.01,
1950
+ "learning_rate": 3.0864197530864196e-06,
1951
+ "loss": 0.1297,
1952
+ "step": 2550
1953
+ },
1954
+ {
1955
+ "epoch": 46.01,
1956
+ "learning_rate": 2.880658436213992e-06,
1957
+ "loss": 0.1206,
1958
+ "step": 2560
1959
+ },
1960
+ {
1961
+ "epoch": 46.01,
1962
+ "learning_rate": 2.6748971193415637e-06,
1963
+ "loss": 0.1094,
1964
+ "step": 2570
1965
+ },
1966
+ {
1967
+ "epoch": 46.02,
1968
+ "learning_rate": 2.469135802469136e-06,
1969
+ "loss": 0.1227,
1970
+ "step": 2580
1971
+ },
1972
+ {
1973
+ "epoch": 46.02,
1974
+ "eval_accuracy": 0.0,
1975
+ "eval_loss": 7.459200859069824,
1976
+ "eval_runtime": 19.303,
1977
+ "eval_samples_per_second": 7.046,
1978
+ "eval_steps_per_second": 1.192,
1979
+ "step": 2585
1980
+ },
1981
+ {
1982
+ "epoch": 47.0,
1983
+ "learning_rate": 2.263374485596708e-06,
1984
+ "loss": 0.1153,
1985
+ "step": 2590
1986
+ },
1987
+ {
1988
+ "epoch": 47.01,
1989
+ "learning_rate": 2.05761316872428e-06,
1990
+ "loss": 0.176,
1991
+ "step": 2600
1992
+ },
1993
+ {
1994
+ "epoch": 47.01,
1995
+ "learning_rate": 1.8518518518518519e-06,
1996
+ "loss": 0.1049,
1997
+ "step": 2610
1998
+ },
1999
+ {
2000
+ "epoch": 47.01,
2001
+ "learning_rate": 1.6460905349794242e-06,
2002
+ "loss": 0.1194,
2003
+ "step": 2620
2004
+ },
2005
+ {
2006
+ "epoch": 47.02,
2007
+ "learning_rate": 1.440329218106996e-06,
2008
+ "loss": 0.0728,
2009
+ "step": 2630
2010
+ },
2011
+ {
2012
+ "epoch": 47.02,
2013
+ "learning_rate": 1.234567901234568e-06,
2014
+ "loss": 0.0716,
2015
+ "step": 2640
2016
+ },
2017
+ {
2018
+ "epoch": 47.02,
2019
+ "eval_accuracy": 0.0,
2020
+ "eval_loss": 7.55896520614624,
2021
+ "eval_runtime": 19.0159,
2022
+ "eval_samples_per_second": 7.152,
2023
+ "eval_steps_per_second": 1.21,
2024
+ "step": 2640
2025
+ },
2026
+ {
2027
+ "epoch": 48.0,
2028
+ "learning_rate": 1.02880658436214e-06,
2029
+ "loss": 0.0481,
2030
+ "step": 2650
2031
+ },
2032
+ {
2033
+ "epoch": 48.01,
2034
+ "learning_rate": 8.230452674897121e-07,
2035
+ "loss": 0.1184,
2036
+ "step": 2660
2037
+ },
2038
+ {
2039
+ "epoch": 48.01,
2040
+ "learning_rate": 6.17283950617284e-07,
2041
+ "loss": 0.1099,
2042
+ "step": 2670
2043
+ },
2044
+ {
2045
+ "epoch": 48.01,
2046
+ "learning_rate": 4.1152263374485604e-07,
2047
+ "loss": 0.116,
2048
+ "step": 2680
2049
+ },
2050
+ {
2051
+ "epoch": 48.02,
2052
+ "learning_rate": 2.0576131687242802e-07,
2053
+ "loss": 0.2077,
2054
+ "step": 2690
2055
+ },
2056
+ {
2057
+ "epoch": 48.02,
2058
+ "eval_accuracy": 0.0,
2059
+ "eval_loss": 7.570817947387695,
2060
+ "eval_runtime": 18.7229,
2061
+ "eval_samples_per_second": 7.264,
2062
+ "eval_steps_per_second": 1.228,
2063
+ "step": 2695
2064
+ },
2065
+ {
2066
+ "epoch": 49.0,
2067
+ "learning_rate": 0.0,
2068
+ "loss": 0.0731,
2069
+ "step": 2700
2070
+ },
2071
+ {
2072
+ "epoch": 49.0,
2073
+ "eval_accuracy": 0.0,
2074
+ "eval_loss": 7.571016311645508,
2075
+ "eval_runtime": 18.9447,
2076
+ "eval_samples_per_second": 7.179,
2077
+ "eval_steps_per_second": 1.214,
2078
+ "step": 2700
2079
+ },
2080
+ {
2081
+ "epoch": 49.0,
2082
+ "step": 2700,
2083
+ "total_flos": 2.0005037147340177e+19,
2084
+ "train_loss": 0.48081808435696144,
2085
+ "train_runtime": 9221.8295,
2086
+ "train_samples_per_second": 1.757,
2087
+ "train_steps_per_second": 0.293
2088
+ },
2089
+ {
2090
+ "epoch": 49.0,
2091
+ "eval_accuracy": 0.2647058823529412,
2092
+ "eval_loss": 3.1971516609191895,
2093
+ "eval_runtime": 19.2309,
2094
+ "eval_samples_per_second": 7.072,
2095
+ "eval_steps_per_second": 1.196,
2096
+ "step": 2700
2097
+ },
2098
+ {
2099
+ "epoch": 49.0,
2100
+ "eval_accuracy": 0.2647058823529412,
2101
+ "eval_loss": 3.1971516609191895,
2102
+ "eval_runtime": 19.408,
2103
+ "eval_samples_per_second": 7.007,
2104
+ "eval_steps_per_second": 1.185,
2105
+ "step": 2700
2106
+ }
2107
+ ],
2108
+ "max_steps": 2700,
2109
+ "num_train_epochs": 9223372036854775807,
2110
+ "total_flos": 2.0005037147340177e+19,
2111
+ "trial_name": null,
2112
+ "trial_params": null
2113
+ }