-
Notifications
You must be signed in to change notification settings - Fork 0
/
output_a.txt
3542 lines (3542 loc) · 153 KB
/
output_a.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
V jump indeces: [0, 399, 899, 1399, 1899, 2399, 2899, 3399, 3899, 4399, 4899, 5399, 5899, 6399, 6899, 7399, 7899, 8399, 8899, 9399, 10399, 10799]
Number of B-spline coeffs per segment: 13
lambda = 1
Costs at truth:
True theta: [-8.394975558691987, -2.6606896297423726, -10.27455123392696, -2.907355162936578]
Lambda: 1.000
Inner cost: 0.00000773 Data cost: 0.00000195 Gradient matching cost: 0.00000578
Iteration: 0
Best parameters: [-8.01728593 -4.02675722 -6.27736347 -3.73132148]
Best objective: 5.938154937157547e-05
Mean objective: 23.324929265120197
Inner objective at best sample: 0.03334216234200168
Gradient objective at best sample: 0.033282780792630105
Time elapsed: 192.66202187538147
Iteration: 1
Best parameters: [-9.0793557 -6.47011393 -6.41032862 -4.04781087]
Best objective: 2.2752878768766547e-05
Mean objective: 1.4750552404149733
Inner objective at best sample: 0.018735774074698005
Gradient objective at best sample: 0.018713021195929238
Time elapsed: 223.1052474975586
Iteration: 2
Best parameters: [-7.67433625 -2.68718742 -6.15832599 -4.95202719]
Best objective: 4.7559678381717455e-05
Mean objective: 0.5037991638322499
Inner objective at best sample: 0.01779305425223902
Gradient objective at best sample: 0.017745494573857303
Time elapsed: 313.44798374176025
Iteration: 3
Best parameters: [-8.92205421 -5.52995911 -6.22911414 -4.5294092 ]
Best objective: 1.9762920713503995e-05
Mean objective: 0.3045198753126778
Inner objective at best sample: 0.020904143897219687
Gradient objective at best sample: 0.020884380976506182
Time elapsed: 290.2217993736267
Iteration: 4
Best parameters: [-9.99513427 -7.12965497 -7.59560226 -3.68783697]
Best objective: 5.4122082411194615e-06
Mean objective: 0.059143834743042425
Inner objective at best sample: 0.004223648469316249
Gradient objective at best sample: 0.00421823626107513
Time elapsed: 349.63948011398315
Iteration: 5
Best parameters: [-10.00532499 -4.15267665 -6.33882371 -5.14006186]
Best objective: 2.4445939246390598e-05
Mean objective: 0.0358422329996278
Inner objective at best sample: 0.016647163564262896
Gradient objective at best sample: 0.016622717625016506
Time elapsed: 298.8356719017029
Iteration: 6
Best parameters: [-7.95384213 -6.96157108 -6.57584288 -3.26394534]
Best objective: 4.2961715916147495e-05
Mean objective: 2.883062613282285
Inner objective at best sample: 0.05869823478466808
Gradient objective at best sample: 0.058655273068751936
Time elapsed: 360.82188963890076
Iteration: 7
Best parameters: [-11.07694156 -6.08804626 -7.74375672 -3.73796127]
Best objective: 4.827562122113244e-06
Mean objective: 0.026751806343646944
Inner objective at best sample: 0.003605546502426721
Gradient objective at best sample: 0.0036007189403046078
Time elapsed: 341.129469871521
Iteration: 8
Best parameters: [-10.74753226 -3.28862732 -7.13404296 -4.20718846]
Best objective: 1.2328767265790156e-05
Mean objective: 0.0017919749927850423
Inner objective at best sample: 0.00563670317321984
Gradient objective at best sample: 0.0056243744059540505
Time elapsed: 265.98190999031067
Iteration: 9
Best parameters: [-10.68994367 -5.91209751 -8.42862091 -3.43899273]
Best objective: 8.029262205297663e-06
Mean objective: 0.005388634886986969
Inner objective at best sample: 0.002708585609429495
Gradient objective at best sample: 0.0027005563472241975
Time elapsed: 214.54243159294128
Iteration: 10
Best parameters: [-11.44787567 -2.501886 -6.79639877 -4.44535822]
Best objective: 8.744105830081306e-06
Mean objective: 4.460766629605986
Inner objective at best sample: 0.008264408409920475
Gradient objective at best sample: 0.008255664304090395
Time elapsed: 306.6562864780426
Iteration: 11
Best parameters: [-9.85436507 -5.7661521 -7.11222404 -3.95236582]
Best objective: 8.47097232033906e-06
Mean objective: 0.00014476464539051913
Inner objective at best sample: 0.006409214996427651
Gradient objective at best sample: 0.006400744024107312
Time elapsed: 354.2984573841095
Iteration: 12
Best parameters: [-10.49033601 -4.48580484 -7.10749577 -4.18370743]
Best objective: 1.071801203057405e-05
Mean objective: 9.632278923698942e-05
Inner objective at best sample: 0.0059067475969105145
Gradient objective at best sample: 0.00589602958487994
Time elapsed: 362.4634099006653
Iteration: 13
Best parameters: [-10.63229451 -4.85284473 -6.76727881 -4.44021704]
Best objective: 9.779200070203584e-06
Mean objective: 0.00014710918117567104
Inner objective at best sample: 0.008957947739154693
Gradient objective at best sample: 0.00894816853908449
Time elapsed: 353.41549158096313
Iteration: 14
Best parameters: [-10.89018093 -4.7245142 -6.81970973 -4.47692949]
Best objective: 1.541363644008569e-05
Mean objective: 0.00016880758487084095
Inner objective at best sample: 0.008288798382535628
Gradient objective at best sample: 0.008273384746095543
Time elapsed: 347.0564880371094
Iteration: 15
Best parameters: [-11.34931579 -4.17483947 -7.39766719 -3.92747318]
Best objective: 4.9093055456058656e-06
Mean objective: 2.9109117782082216e-05
Inner objective at best sample: 0.0046405400691430735
Gradient objective at best sample: 0.004635630763597467
Time elapsed: 296.7724983692169
Iteration: 16
Best parameters: [-11.07071035 -3.94518654 -7.19401033 -4.10756626]
Best objective: 6.453990477363372e-06
Mean objective: 0.007053820979694818
Inner objective at best sample: 0.005447027632107714
Gradient objective at best sample: 0.005440573641630351
Time elapsed: 317.4463527202606
Iteration: 17
Best parameters: [-10.15121305 -4.6787426 -7.16452597 -4.06868012]
Best objective: 5.901655404323061e-06
Mean objective: 1.5977159903787138e-05
Inner objective at best sample: 0.0056447034221555024
Gradient objective at best sample: 0.00563880176675118
Time elapsed: 332.12873697280884
Iteration: 18
Best parameters: [-10.79477915 -4.56203154 -7.68149272 -3.73896454]
Best objective: 4.732395011576219e-06
Mean objective: 1.6527690939255317e-05
Inner objective at best sample: 0.0038150770686261495
Gradient objective at best sample: 0.003810344673614573
Time elapsed: 319.01706051826477
Iteration: 19
Best parameters: [-11.23890341 -3.57000033 -7.60690048 -3.81926196]
Best objective: 4.058422614361008e-06
Mean objective: 1.1687674026828034e-05
Inner objective at best sample: 0.003906230588288321
Gradient objective at best sample: 0.00390217216567396
Time elapsed: 365.6814606189728
Iteration: 20
Best parameters: [-10.23997774 -5.51071852 -7.60780215 -3.77053479]
Best objective: 4.337839626086789e-06
Mean objective: 8.152044183291729e-06
Inner objective at best sample: 0.003944118964979119
Gradient objective at best sample: 0.0039397811253530325
Time elapsed: 373.0546143054962
Iteration: 21
Best parameters: [-10.28565863 -5.49645231 -7.70803658 -3.71407574]
Best objective: 3.886426071173796e-06
Mean objective: 7.038954295833414e-06
Inner objective at best sample: 0.00370975808161718
Gradient objective at best sample: 0.0037058716555460063
Time elapsed: 366.63659620285034
Iteration: 22
Best parameters: [-10.42067937 -3.80653425 -7.78113318 -3.71386947]
Best objective: 3.6886017166831096e-06
Mean objective: 1.9969875856302014e-05
Inner objective at best sample: 0.003463264648048436
Gradient objective at best sample: 0.003459576046331753
Time elapsed: 346.66494250297546
Iteration: 23
Best parameters: [-11.51438911 -2.51525946 -8.08202845 -3.57789164]
Best objective: 3.2100069827576107e-06
Mean objective: 1.1474966638821527e-05
Inner objective at best sample: 0.0027916982265524847
Gradient objective at best sample: 0.002788488219569727
Time elapsed: 342.8797113895416
Iteration: 24
Best parameters: [-11.58552139 -2.29928952 -8.09298151 -3.57833131]
Best objective: 2.8524203053164132e-06
Mean objective: 0.21301805288804823
Inner objective at best sample: 0.00248176645556019
Gradient objective at best sample: 0.0024789140352548737
Time elapsed: 296.614159822464
Iteration: 25
Best parameters: [-11.30434674 -3.09894117 -7.88906025 -3.66836042]
Best objective: 3.582683856464032e-06
Mean objective: 7.169332403270654e-06
Inner objective at best sample: 0.0032751419148616488
Gradient objective at best sample: 0.003271559231005185
Time elapsed: 321.8732521533966
Iteration: 26
Best parameters: [-12.1380886 -1.8166635 -8.1712226 -3.52672871]
Best objective: 1.809302387817927e-06
Mean objective: 5.867413689313693e-06
Inner objective at best sample: 0.0007679943367578848
Gradient objective at best sample: 0.000766185034370067
Time elapsed: 319.49722266197205
Iteration: 27
Best parameters: [-11.67296249 -1.94676353 -8.0861157 -3.59532235]
Best objective: 1.7083072365480814e-06
Mean objective: 5.6216531763230764e-06
Inner objective at best sample: 0.0010004134812227063
Gradient objective at best sample: 0.0009987051739861583
Time elapsed: 365.305171251297
Iteration: 28
Best parameters: [-11.23332079 -1.93683531 -7.94756469 -3.65563753]
Best objective: 8.904818588195399e-07
Mean objective: 0.0027885305970017336
Inner objective at best sample: 0.0009132164078998273
Gradient objective at best sample: 0.0009123259260410077
Time elapsed: 359.8656384944916
Iteration: 29
Best parameters: [-11.46256718 -1.90906881 -8.02086433 -3.60215547]
Best objective: 9.761555195477175e-07
Mean objective: 0.3834122445915242
Inner objective at best sample: 0.0008600200254716087
Gradient objective at best sample: 0.000859043869952061
Time elapsed: 352.17483472824097
Iteration: 30
Best parameters: [-11.22447308 -2.07570155 -7.8036167 -3.72034603]
Best objective: 1.7262989144603344e-06
Mean objective: 1.4286275277925078
Inner objective at best sample: 0.0016603858146840484
Gradient objective at best sample: 0.001658659515769588
Time elapsed: 367.46178221702576
Iteration: 31
Best parameters: [-11.67773263 -1.88593213 -8.15814155 -3.55588796]
Best objective: 7.128680103865099e-07
Mean objective: 7.009597920034277e-05
Inner objective at best sample: 0.0007000049154457093
Gradient objective at best sample: 0.0006992920474353228
Time elapsed: 387.23468685150146
Iteration: 32
Best parameters: [-11.38548313 -1.96220134 -8.02852505 -3.60596487]
Best objective: 8.332364459001803e-07
Mean objective: 0.11131614420993344
Inner objective at best sample: 0.0009069964696127644
Gradient objective at best sample: 0.0009061632331668643
Time elapsed: 328.42478370666504
Iteration: 33
Best parameters: [-11.05581522 -1.97435961 -7.88917435 -3.67033834]
Best objective: 7.582453622176083e-07
Mean objective: 0.8508303464093055
Inner objective at best sample: 0.0009945859714385657
Gradient objective at best sample: 0.0009938277260763482
Time elapsed: 246.87539196014404
Iteration: 34
Best parameters: [-10.61525206 -2.06595935 -7.76848473 -3.72729633]
Best objective: 9.618541242326442e-07
Mean objective: 0.7909277509738459
Inner objective at best sample: 0.0011571741473660217
Gradient objective at best sample: 0.0011562122932417891
Time elapsed: 362.1260919570923
Iteration: 35
Best parameters: [-11.81980911 -1.88600347 -8.15488345 -3.55035113]
Best objective: 7.638200142591266e-07
Mean objective: 7.720522117304566e-06
Inner objective at best sample: 0.000782672688236129
Gradient objective at best sample: 0.0007819088682218698
Time elapsed: 382.99017095565796
Iteration: 36
Best parameters: [-11.50397024 -1.87051119 -8.06977932 -3.58858816]
Best objective: 8.795620185643858e-07
Mean objective: 2.8003514568577028e-05
Inner objective at best sample: 0.0009227215498428237
Gradient objective at best sample: 0.0009218419878242593
Time elapsed: 360.15180468559265
Iteration: 37
Best parameters: [-11.45686456 -1.91739866 -8.00634374 -3.61745576]
Best objective: 6.610624010878907e-07
Mean objective: 9.343107284442254e-06
Inner objective at best sample: 0.0008544883259156723
Gradient objective at best sample: 0.0008538272635145844
Time elapsed: 368.7266318798065
Iteration: 38
Best parameters: [-11.28109399 -1.9397003 -8.04413217 -3.59818202]
Best objective: 6.630652634347751e-07
Mean objective: 1.7056748187067414e-06
Inner objective at best sample: 0.0008097284454818333
Gradient objective at best sample: 0.0008090653802183985
Time elapsed: 367.37759494781494
Iteration: 39
Best parameters: [-11.46479511 -1.95839242 -8.09890462 -3.57545692]
Best objective: 8.627255743894893e-07
Mean objective: 2.527257297043309e-06
Inner objective at best sample: 0.0008737397864114072
Gradient objective at best sample: 0.0008728770608370178
Time elapsed: 375.6847286224365
Iteration: 40
Best parameters: [-11.14268594 -1.96622482 -8.00564491 -3.62200802]
Best objective: 6.455816033899372e-07
Mean objective: 2.2280842658572095e-06
Inner objective at best sample: 0.0008314396203747806
Gradient objective at best sample: 0.0008307940387713907
Time elapsed: 355.7519359588623
Iteration: 41
Best parameters: [-11.21627678 -1.95866249 -8.07496402 -3.58296276]
Best objective: 6.875436070990741e-07
Mean objective: 1.3953367662520696e-06
Inner objective at best sample: 0.0007757440103060517
Gradient objective at best sample: 0.0007750564666989526
Time elapsed: 279.42583894729614
Iteration: 42
Best parameters: [-11.35551714 -1.93061824 -8.11298553 -3.57035674]
Best objective: 5.992942051166181e-07
Mean objective: 9.893922608102112e-07
Inner objective at best sample: 0.0007344219428628999
Gradient objective at best sample: 0.0007338226486577833
Time elapsed: 272.64727759361267
Iteration: 43
Best parameters: [-11.18029315 -1.95621577 -8.11866153 -3.56697889]
Best objective: 5.95275789725584e-07
Mean objective: 9.003146284623635e-07
Inner objective at best sample: 0.0007257922755768373
Gradient objective at best sample: 0.0007251969997871117
Time elapsed: 391.8696210384369
Iteration: 44
Best parameters: [-11.4369889 -1.902392 -8.04952084 -3.60003181]
Best objective: 6.482781783047343e-07
Mean objective: 9.192456332351993e-07
Inner objective at best sample: 0.0008208892402150333
Gradient objective at best sample: 0.0008202409620367286
Time elapsed: 377.7055423259735
Iteration: 45
Best parameters: [-11.34211768 -1.92528838 -8.13128746 -3.56147533]
Best objective: 6.025458131131502e-07
Mean objective: 7.035525947267104e-07
Inner objective at best sample: 0.0007250279513900341
Gradient objective at best sample: 0.0007244254055769209
Time elapsed: 382.1000199317932
Iteration: 46
Best parameters: [-11.21100691 -1.94883729 -8.03342796 -3.6061363 ]
Best objective: 6.231488954966039e-07
Mean objective: 6.628060869013328e-07
Inner objective at best sample: 0.0008143448100522538
Gradient objective at best sample: 0.0008137216611567573
Time elapsed: 369.2865014076233
Iteration: 47
Best parameters: [-11.46814246 -1.90351611 -8.15280423 -3.55192483]
Best objective: 6.041291374709165e-07
Mean objective: 6.399932151280883e-07
Inner objective at best sample: 0.0007119545974201464
Gradient objective at best sample: 0.0007113504682826756
Time elapsed: 369.1521246433258
Iteration: 48
Best parameters: [-11.48467725 -1.90357654 -8.1725823 -3.54426307]
Best objective: 5.886627731246596e-07
Mean objective: 6.183877539375401e-07
Inner objective at best sample: 0.0006891716404426865
Gradient objective at best sample: 0.0006885829776695619
Time elapsed: 332.7122266292572
Iteration: 49
Best parameters: [-11.38131313 -1.93058533 -8.20805143 -3.52763915]
Best objective: 5.877730085073914e-07
Mean objective: 6.193214751648606e-07
Inner objective at best sample: 0.000653439331334763
Gradient objective at best sample: 0.0006528515583262556
Time elapsed: 228.45251941680908
Iteration: 50
Best parameters: [-11.38174437 -1.92792231 -8.21021364 -3.52761232]
Best objective: 5.754669820345361e-07
Mean objective: 6.30020639097126e-07
Inner objective at best sample: 0.0006495250161870354
Gradient objective at best sample: 0.0006489495492050008
Time elapsed: 243.5266592502594
Iteration: 51
Best parameters: [-11.05119709 -1.98116964 -8.13816555 -3.5599346 ]
Best objective: 5.762180800105623e-07
Mean objective: 6.645361850554594e-07
Inner objective at best sample: 0.0006964232744525988
Gradient objective at best sample: 0.0006958470563725882
Time elapsed: 345.0413751602173
Iteration: 52
Best parameters: [-11.24211085 -1.9435054 -8.32395145 -3.47978425]
Best objective: 5.555058502897714e-07
Mean objective: 6.831002519045942e-07
Inner objective at best sample: 0.0005658623032189439
Gradient objective at best sample: 0.0005653067973686541
Time elapsed: 370.3704745769501
Iteration: 53
Best parameters: [-10.94728605 -2.00701879 -8.34160075 -3.47434866]
Best objective: 5.245426985076529e-07
Mean objective: 6.777155540051084e-07
Inner objective at best sample: 0.0005289435128193902
Gradient objective at best sample: 0.0005284189701208825
Time elapsed: 365.59319734573364
Iteration: 54
Best parameters: [-9.59506095 -2.26523114 -8.27968829 -3.49820477]
Best objective: 5.113480231507684e-07
Mean objective: 8.249557195828848e-07
Inner objective at best sample: 0.0005245299639411442
Gradient objective at best sample: 0.0005240186159179934
Time elapsed: 327.279128074646
Iteration: 55
Best parameters: [-9.34509392 -2.34096471 -8.23981426 -3.51585774]
Best objective: 4.486455505607417e-07
Mean objective: 7.749285592473195e-07
Inner objective at best sample: 0.0005042509960115294
Gradient objective at best sample: 0.0005038023504609686
Time elapsed: 313.29384756088257
Iteration: 56
Best parameters: [-9.41235237 -2.32028503 -8.40256894 -3.44921608]
Best objective: 4.388268494669034e-07
Mean objective: 1.5142992888851528e-06
Inner objective at best sample: 0.0004088589006318696
Gradient objective at best sample: 0.0004084200737824027
Time elapsed: 266.820351600647
Iteration: 57
Best parameters: [-8.69840452 -2.50712925 -8.32951218 -3.4776738 ]
Best objective: 4.444364061142953e-07
Mean objective: 1.1044325217330103e-06
Inner objective at best sample: 0.00042587310826847183
Gradient objective at best sample: 0.0004254286718623575
Time elapsed: 248.38907957077026
Iteration: 58
Best parameters: [-9.36616518 -2.34310806 -8.39354958 -3.45363948]
Best objective: 4.152845818614917e-07
Mean objective: 1.436764689139347e-06
Inner objective at best sample: 0.00039486153857311616
Gradient objective at best sample: 0.0003944462539912547
Time elapsed: 304.5841019153595
Iteration: 59
Best parameters: [-9.14187184 -2.40891724 -8.3973664 -3.45256607]
Best objective: 3.9953564696705934e-07
Mean objective: 1.310376622006061e-06
Inner objective at best sample: 0.00037047070817266246
Gradient objective at best sample: 0.0003700711725256954
Time elapsed: 374.7977521419525
Iteration: 60
Best parameters: [-9.14168572 -2.39511095 -8.36321243 -3.46744615]
Best objective: 4.33831195628176e-07
Mean objective: 7.03892709700412e-07
Inner objective at best sample: 0.0004008127409865837
Gradient objective at best sample: 0.0004003789097909555
Time elapsed: 378.20725536346436
Iteration: 61
Best parameters: [-9.2888261 -2.37589432 -8.2508932 -3.51026457]
Best objective: 4.384838867632318e-07
Mean objective: 6.064871241796872e-07
Inner objective at best sample: 0.00048159762167304757
Gradient objective at best sample: 0.00048115913778628433
Time elapsed: 378.8333168029785
Iteration: 62
Best parameters: [-9.32883787 -2.35734229 -8.36791919 -3.46290512]
Best objective: 4.1439657053634757e-07
Mean objective: 5.301953023587311e-07
Inner objective at best sample: 0.00040606670633892177
Gradient objective at best sample: 0.0004056523097683854
Time elapsed: 350.10874462127686
Iteration: 63
Best parameters: [-9.24266965 -2.37104594 -8.39599018 -3.45205902]
Best objective: 4.1184413086909626e-07
Mean objective: 5.054567209686569e-07
Inner objective at best sample: 0.00038934215140134896
Gradient objective at best sample: 0.00038893030727047984
Time elapsed: 298.82192039489746
Iteration: 64
Best parameters: [-9.11422021 -2.41254631 -8.43041597 -3.43899168]
Best objective: 3.910570580492302e-07
Mean objective: 4.5841795815179545e-07
Inner objective at best sample: 0.0003529800815221299
Gradient objective at best sample: 0.00035258902446408066
Time elapsed: 334.3854601383209
Iteration: 65
Best parameters: [-9.13006303 -2.41700336 -8.45824912 -3.42663919]
Best objective: 3.9459265465145244e-07
Mean objective: 4.5061801714022927e-07
Inner objective at best sample: 0.00033827026061597173
Gradient objective at best sample: 0.0003378756679613203
Time elapsed: 331.08675503730774
Iteration: 66
Best parameters: [-9.05095972 -2.43175025 -8.43970341 -3.43531567]
Best objective: 3.846892451492078e-07
Mean objective: 4.587698865891467e-07
Inner objective at best sample: 0.0003421549116171252
Gradient objective at best sample: 0.000341770222371976
Time elapsed: 299.5066361427307
Iteration: 67
Best parameters: [-8.93301299 -2.46642424 -8.47111322 -3.42190812]
Best objective: 3.770973014093719e-07
Mean objective: 4.2681286991902384e-07
Inner objective at best sample: 0.0003186368057105252
Gradient objective at best sample: 0.00031825970840911586
Time elapsed: 379.55973982810974
Iteration: 68
Best parameters: [-8.77748026 -2.5241984 -8.53080107 -3.40058852]
Best objective: 3.5926157804997416e-07
Mean objective: 4.152223614149227e-07
Inner objective at best sample: 0.0002724236529570946
Gradient objective at best sample: 0.0002720643913790446
Time elapsed: 346.05991554260254
Iteration: 69
Best parameters: [-8.78561552 -2.51598309 -8.51744255 -3.40595098]
Best objective: 3.614216510527208e-07
Mean objective: 0.003086398180108256
Inner objective at best sample: 0.0002798584480177166
Gradient objective at best sample: 0.00027949702636666387
Time elapsed: 328.6451578140259
Iteration: 70
Best parameters: [-8.77002206 -2.5239393 -8.4999385 -3.41277632]
Best objective: 3.655453624261144e-07
Mean objective: 5.063869550566048e-07
Inner objective at best sample: 0.00028596553287143876
Gradient objective at best sample: 0.00028559998750901265
Time elapsed: 315.66321206092834
Iteration: 71
Best parameters: [-8.44706946 -2.61868677 -8.53983475 -3.39645369]
Best objective: 3.429325782206768e-07
Mean objective: 0.003893535302011098
Inner objective at best sample: 0.0002560144334927917
Gradient objective at best sample: 0.000255671500914571
Time elapsed: 353.84295558929443
Iteration: 72
Best parameters: [-8.20176684 -2.69904841 -8.59124783 -3.37686838]
Best objective: 3.441695195945938e-07
Mean objective: 3.7413757029904055e-07
Inner objective at best sample: 0.00023665637853468132
Gradient objective at best sample: 0.00023631220901508673
Time elapsed: 345.9033226966858
Iteration: 73
Best parameters: [-8.27429769 -2.66737132 -8.63444602 -3.36119285]
Best objective: 3.4817805699159445e-07
Mean objective: 4.0338013411211885e-07
Inner objective at best sample: 0.00022654777375120754
Gradient objective at best sample: 0.00022619959569421594
Time elapsed: 353.44170022010803
Iteration: 74
Best parameters: [-8.19209072 -2.72574801 -8.62816029 -3.36158313]
Best objective: 3.320120743556093e-07
Mean objective: 0.0035125657611720777
Inner objective at best sample: 0.00021090949378270915
Gradient objective at best sample: 0.00021057748170835353
Time elapsed: 306.90068197250366
Iteration: 75
Best parameters: [-8.51312009 -2.61013495 -8.63645521 -3.36004881]
Best objective: 3.3817018275537645e-07
Mean objective: 4.029058116079035e-07
Inner objective at best sample: 0.00021467074515989302
Gradient objective at best sample: 0.00021433257497713765
Time elapsed: 343.74467253685
Iteration: 76
Best parameters: [-8.3768521 -2.66043233 -8.70019015 -3.33684774]
Best objective: 3.309421303805712e-07
Mean objective: 3.6581781336759614e-07
Inner objective at best sample: 0.00018640106010343166
Gradient objective at best sample: 0.0001860701179730511
Time elapsed: 308.44148230552673
Iteration: 77
Best parameters: [-8.12516857 -2.74805669 -8.73582493 -3.32275544]
Best objective: 3.2904557869144485e-07
Mean objective: 4.189135111814262e-07
Inner objective at best sample: 0.00017676670892131536
Gradient objective at best sample: 0.00017643766334262393
Time elapsed: 349.30508255958557
Iteration: 78
Best parameters: [-8.21969701 -2.71787316 -8.71321385 -3.3320098 ]
Best objective: 3.260099807027627e-07
Mean objective: 3.565903937329152e-07
Inner objective at best sample: 0.00017941520065829807
Gradient objective at best sample: 0.0001790891906775953
Time elapsed: 367.29116463661194
Iteration: 79
Best parameters: [-8.20965589 -2.70705252 -8.71986558 -3.33036317]
Best objective: 3.2704147899165685e-07
Mean objective: 3.4464363043256356e-07
Inner objective at best sample: 0.00018217965593628834
Gradient objective at best sample: 0.00018185261445729668
Time elapsed: 369.3282392024994
No changes in20iterations. Terminating
Total time taken: 26555.545516490936
===========================================================================================================
lambda = 10
Costs at truth:
True theta: [-8.394975558691987, -2.6606896297423726, -10.27455123392696, -2.907355162936578]
Lambda: 10.000
Inner cost: 0.00005348 Data cost: 0.00000665 Gradient matching cost: 0.00000468
Iteration: 0
Best parameters: [-8.22627385 -7.6117376 -5.95642366 -3.92239889]
Best objective: 0.0018637423849390982
Mean objective: 98.22343850658272
Inner objective at best sample: 0.49001224517810954
Gradient objective at best sample: 0.04881485027931705
Time elapsed: 372.39956283569336
Iteration: 1
Best parameters: [-10.29880395 -5.58469595 -6.0163522 -8.67870053]
Best objective: 0.00407389739458931
Mean objective: 143.75767630374907
Inner objective at best sample: 0.30472327164885205
Gradient objective at best sample: 0.030064937425426274
Time elapsed: 323.94543385505676
Iteration: 2
Best parameters: [-13.05933375 -2.65372453 -6.53790847 -3.25145362]
Best objective: 0.0024550662003899656
Mean objective: 212.18155316782935
Inner objective at best sample: 0.6990728070413922
Gradient objective at best sample: 0.06966177408410022
Time elapsed: 252.68173170089722
Iteration: 3
Best parameters: [-9.67218873 -9.62905913 -6.03674522 -4.13944444]
Best objective: 0.0020985550767641625
Mean objective: 145.44824848354983
Inner objective at best sample: 0.36374413738772504
Gradient objective at best sample: 0.036164558231096086
Time elapsed: 159.26432394981384
Iteration: 4
Best parameters: [-8.89870972 -3.79146356 -4.94572759 -7.72016666]
Best objective: 0.03493364406615862
Mean objective: 252.31012409487084
Inner objective at best sample: 2.262518183710447
Gradient objective at best sample: 0.2227584539644288
Time elapsed: 273.93321418762207
Iteration: 5
Best parameters: [-9.32297437 -7.87291618 -6.300531 -6.63563857]
Best objective: 0.007230019851599231
Mean objective: 2.999552450805771
Inner objective at best sample: 0.21797717659458565
Gradient objective at best sample: 0.021074715674298642
Time elapsed: 280.0724091529846
Iteration: 6
Best parameters: [ -7.8693059 -14.17134437 -5.30733876 -8.76132944]
Best objective: 0.018249562912686163
Mean objective: 4.001634681143473
Inner objective at best sample: 1.1186333086000717
Gradient objective at best sample: 0.11003837456873855
Time elapsed: 320.90939354896545
Iteration: 7
Best parameters: [ -9.64057248 -15.03329024 -6.09175884 -6.54206861]
Best objective: 0.004117886056530368
Mean objective: 39.552683860267805
Inner objective at best sample: 0.2671434698970014
Gradient objective at best sample: 0.026302558384047103
Time elapsed: 348.57128262519836
Iteration: 8
Best parameters: [ -9.89452161 -11.36936948 -5.65721099 -9.88069255]
Best objective: 0.007173805291559947
Mean objective: 1.7036933013322708
Inner objective at best sample: 0.5815580654041872
Gradient objective at best sample: 0.05743842601126272
Time elapsed: 329.60557222366333
Iteration: 9
Best parameters: [ -9.92146487 -10.44868614 -5.61350527 -9.04190436]
Best objective: 0.007808491751564061
Mean objective: 0.3337036875054352
Inner objective at best sample: 0.6312077355647304
Gradient objective at best sample: 0.062339924381316636
Time elapsed: 295.2136571407318
Iteration: 10
Best parameters: [ -8.84101951 -11.3868936 -6.25443172 -4.44112808]
Best objective: 0.001390508603826036
Mean objective: 0.023100537918296013
Inner objective at best sample: 0.20468066296419535
Gradient objective at best sample: 0.02032901543603693
Time elapsed: 257.74951338768005
Iteration: 11
Best parameters: [-8.76791854 -9.23332611 -5.75662662 -3.82774132]
Best objective: 0.0031815901171931196
Mean objective: 0.020585165190666332
Inner objective at best sample: 0.8387530677778708
Gradient objective at best sample: 0.08355714776606778
Time elapsed: 268.35323190689087
Iteration: 12
Best parameters: [-9.85717297 -5.13384501 -6.72560622 -4.49155871]
Best objective: 0.0007536381181715221
Mean objective: 0.008697527139562226
Inner objective at best sample: 0.09392626712470219
Gradient objective at best sample: 0.009317262900653068
Time elapsed: 350.42270493507385
Iteration: 13
Best parameters: [-9.11615905 -9.36230859 -6.36994212 -3.86029652]
Best objective: 0.0010953945712632047
Mean objective: 0.009426368799612358
Inner objective at best sample: 0.2422085255159371
Gradient objective at best sample: 0.02411131309446739
Time elapsed: 331.2483022212982
Iteration: 14
Best parameters: [-9.85544742 -6.56596131 -7.11392212 -3.84462762]
Best objective: 0.00045986590006527654
Mean objective: 0.061312549599911385
Inner objective at best sample: 0.069884092386567
Gradient objective at best sample: 0.006942422648650172
Time elapsed: 342.7361752986908
Iteration: 15
Best parameters: [ -8.60262498 -11.69223343 -6.40862134 -3.4845967 ]
Best objective: 0.0013072640137655879
Mean objective: 0.009051437090974529
Inner objective at best sample: 0.42928471961194714
Gradient objective at best sample: 0.042797745559818155
Time elapsed: 326.8419210910797
Iteration: 16
Best parameters: [-8.34970562 -9.86743657 -6.98291053 -3.61380599]
Best objective: 0.00038172767672840953
Mean objective: 0.13437182484088755
Inner objective at best sample: 0.10348108929491637
Gradient objective at best sample: 0.010309936161818797
Time elapsed: 352.0650691986084
Iteration: 17
Best parameters: [-9.26686158 -6.06588325 -7.84999225 -3.50844587]
Best objective: 0.00018976141881065238
Mean objective: 1.3873080126285284
Inner objective at best sample: 0.03626975746012435
Gradient objective at best sample: 0.0036079996041313697
Time elapsed: 345.49795508384705
Iteration: 18
Best parameters: [-10.36102685 -11.89010951 -7.15280118 -3.96492668]
Best objective: 0.0003632127063237943
Mean objective: 0.023511420479952888
Inner objective at best sample: 0.06098094328851644
Gradient objective at best sample: 0.006061773058219265
Time elapsed: 329.6093828678131
Iteration: 19
Best parameters: [-10.92756659 -9.98810797 -7.36171522 -3.78293432]
Best objective: 0.00045187781204014086
Mean objective: 0.49352496678432306
Inner objective at best sample: 0.05442702553312123
Gradient objective at best sample: 0.005397514772108109
Time elapsed: 216.16582417488098
Iteration: 20
Best parameters: [-10.55356724 -11.28802306 -8.43093808 -3.41744653]
Best objective: 0.00018955915843387697
Mean objective: 2.273453647959381
Inner objective at best sample: 0.02700002603345277
Gradient objective at best sample: 0.0026810466875018895
Time elapsed: 137.30763721466064
Iteration: 21
Best parameters: [-9.84364685 -6.87608333 -7.59379048 -3.38762588]
Best objective: 0.0006381642733556344
Mean objective: 0.008693856052205186
Inner objective at best sample: 0.06669726658257458
Gradient objective at best sample: 0.006605910230921894
Time elapsed: 308.6713628768921
Iteration: 22
Best parameters: [-9.94401746 -9.00169581 -7.10115932 -3.84183957]
Best objective: 0.0004741296032160651
Mean objective: 0.005619508514486735
Inner objective at best sample: 0.07161448925154273
Gradient objective at best sample: 0.007114035964832667
Time elapsed: 347.75361251831055
Iteration: 23
Best parameters: [-9.67195171 -8.32343492 -7.22361134 -3.77345129]
Best objective: 0.00036212733514166123
Mean objective: 0.04446904006788914
Inner objective at best sample: 0.062439629255485615
Gradient objective at best sample: 0.006207750192034395
Time elapsed: 345.1124470233917
Iteration: 24
Best parameters: [-10.29762274 -11.95563246 -7.50668644 -3.75333229]
Best objective: 0.00026156822805921897
Mean objective: 0.0007228551585550289
Inner objective at best sample: 0.04482111414696194
Gradient objective at best sample: 0.004455954591890272
Time elapsed: 386.7966613769531
Iteration: 25
Best parameters: [-10.3244719 -13.58111837 -7.6655011 -3.71462773]
Best objective: 0.00021941476397167176
Mean objective: 0.0005430448594013609
Inner objective at best sample: 0.038611312666965
Gradient objective at best sample: 0.0038391897902993327
Time elapsed: 374.71208930015564
Iteration: 26
Best parameters: [-10.42872135 -13.92896805 -7.70561168 -3.71469386]
Best objective: 0.00022046044989413135
Mean objective: 0.0007256514428699691
Inner objective at best sample: 0.03722634898459247
Gradient objective at best sample: 0.0037005888534698333
Time elapsed: 378.643572807312
Iteration: 27
Best parameters: [-9.91938677 -9.39385034 -7.61995603 -3.69734381]
Best objective: 0.00022235287721502543
Mean objective: 0.0005757451775058578
Inner objective at best sample: 0.04035982637403608
Gradient objective at best sample: 0.004013747349682106
Time elapsed: 344.4500617980957
Iteration: 28
Best parameters: [-10.37576866 -14.59491188 -8.58741304 -3.30732701]
Best objective: 0.0001716402973107748
Mean objective: 0.0004066191849644176
Inner objective at best sample: 0.02698947258336338
Gradient objective at best sample: 0.0026817832286052607
Time elapsed: 295.61712551116943
Iteration: 29
Best parameters: [-10.97767729 -15.40235632 -9.60608646 -3.04182688]
Best objective: 0.00014767135133165094
Mean objective: 0.0007640831427694816
Inner objective at best sample: 0.023339299393624512
Gradient objective at best sample: 0.002319162804229286
Time elapsed: 236.44610285758972
Iteration: 30
Best parameters: [-10.46022486 -15.94078628 -8.92596344 -3.22624455]
Best objective: 0.00015497659300862729
Mean objective: 0.0005665510173455828
Inner objective at best sample: 0.02460742679734991
Gradient objective at best sample: 0.0024452450204341283
Time elapsed: 308.8720338344574
Iteration: 31
Best parameters: [ -9.30828499 -11.96694902 -8.65369035 -3.1740342 ]
Best objective: 0.00016979038598320467
Mean objective: 0.0006580464331392033
Inner objective at best sample: 0.027916686480543178
Gradient objective at best sample: 0.0027746896094559973
Time elapsed: 340.3488550186157
Iteration: 32
Best parameters: [ -9.67613144 -11.50326493 -8.97329976 -3.1443622 ]
Best objective: 0.0001522378735009628
Mean objective: 0.0004092826427679061
Inner objective at best sample: 0.02479801741614225
Gradient objective at best sample: 0.002464577954264129
Time elapsed: 367.0282292366028
Iteration: 33
Best parameters: [ -9.22234302 -12.37305301 -8.74977183 -3.15196749]
Best objective: 0.00015252388346743888
Mean objective: 0.0004171196405425199
Inner objective at best sample: 0.02656879371367238
Gradient objective at best sample: 0.0026416269830204938
Time elapsed: 353.95666432380676
Iteration: 34
Best parameters: [ -9.61447753 -11.39121573 -8.6156735 -3.2436672 ]
Best objective: 0.00016010708811045775
Mean objective: 0.0002633123176843235
Inner objective at best sample: 0.02689662673057419
Gradient objective at best sample: 0.0026736519642463737
Time elapsed: 357.99242424964905
Iteration: 35
Best parameters: [ -9.97652078 -12.20197419 -8.88571985 -3.21458935]
Best objective: 0.0001554412229401007
Mean objective: 0.00021683124936092306
Inner objective at best sample: 0.024640692245948326
Gradient objective at best sample: 0.0024485251023008228
Time elapsed: 314.5043671131134
Iteration: 36
Best parameters: [-9.50908718 -9.41994548 -8.67495449 -3.21609273]
Best objective: 0.0001562514062424567
Mean objective: 0.00018341848527578388
Inner objective at best sample: 0.02649024164709898
Gradient objective at best sample: 0.0026333990240856526
Time elapsed: 368.9594876766205
Iteration: 37
Best parameters: [ -9.1397714 -11.16447494 -8.65708396 -3.18455759]
Best objective: 0.00015269238902823203
Mean objective: 0.0001771824725129144
Inner objective at best sample: 0.02675123017345607
Gradient objective at best sample: 0.0026598537784427835
Time elapsed: 333.1290109157562
Iteration: 38
Best parameters: [ -9.54640705 -12.03181582 -8.70525397 -3.22095639]
Best objective: 0.0001528662058561425
Mean objective: 0.00016267441006384559
Inner objective at best sample: 0.025923042620914064
Gradient objective at best sample: 0.002577017641505792
Time elapsed: 368.30185747146606
Iteration: 39
Best parameters: [ -9.39763582 -11.30611771 -8.87969814 -3.15340636]
Best objective: 0.0001493008985681629
Mean objective: 0.000160960081312948
Inner objective at best sample: 0.025005150121790422
Gradient objective at best sample: 0.002485584922322226
Time elapsed: 328.44156980514526
Iteration: 40
Best parameters: [ -9.2412638 -12.57765738 -9.04298502 -3.08576346]
Best objective: 0.00014636179216562028
Mean objective: 0.00016686560732094498
Inner objective at best sample: 0.024437408651470587
Gradient objective at best sample: 0.002429104685930497
Time elapsed: 415.4730658531189
Iteration: 41
Best parameters: [ -8.97470645 -11.48881154 -9.19028183 -2.99479702]
Best objective: 0.0001437983461381431
Mean objective: 0.00015955105187236528
Inner objective at best sample: 0.024710122862734097
Gradient objective at best sample: 0.0024566324516595954
Time elapsed: 200.79804611206055
Iteration: 42
Best parameters: [ -8.67895322 -12.18778637 -9.67413135 -2.8272091 ]
Best objective: 0.00013910874840256113
Mean objective: 0.00016343239580328756
Inner objective at best sample: 0.024040467343552065
Gradient objective at best sample: 0.0023901358595149504
Time elapsed: 182.7451572418213
Iteration: 43
Best parameters: [ -8.67395174 -10.2199847 -9.57618989 -2.85408216]
Best objective: 0.00013894012009590685
Mean objective: 0.0001613262558237131
Inner objective at best sample: 0.024121377395553336
Gradient objective at best sample: 0.002398243727545743
Time elapsed: 223.20170736312866
Iteration: 44
Best parameters: [ -8.34665175 -14.38296558 -9.81104072 -2.73833188]
Best objective: 0.00013688891026985328
Mean objective: 0.0001730919618951612
Inner objective at best sample: 0.025853377523029963
Gradient objective at best sample: 0.0025716488612760107
Time elapsed: 291.94825863838196
Iteration: 45
Best parameters: [ -8.26839456 -12.0763257 -10.04601469 -2.67761349]
Best objective: 0.00013601065761846575
Mean objective: 0.00015414910385364302
Inner objective at best sample: 0.025656537231084117
Gradient objective at best sample: 0.002552052657346565
Time elapsed: 245.00952768325806
Iteration: 46
Best parameters: [ -7.85831247 -8.34434012 -10.10613005 -2.61176936]
Best objective: 0.00013638289815191398
Mean objective: 0.00016265583451953417
Inner objective at best sample: 0.029960850258295164
Gradient objective at best sample: 0.0029824467360143247
Time elapsed: 257.1099283695221
Iteration: 47
Best parameters: [ -7.87525298 -15.34401926 -10.2804436 -2.57480271]
Best objective: 0.0001350720988705983
Mean objective: 0.00021044143541261461
Inner objective at best sample: 0.02974426446380071
Gradient objective at best sample: 0.002960919236493011
Time elapsed: 278.2157094478607
Iteration: 48
Best parameters: [ -8.03130074 -7.07763837 -10.42902293 -2.57801212]
Best objective: 0.00013453662807715088
Mean objective: 0.00015367732748735216
Inner objective at best sample: 0.02586110300757968
Gradient objective at best sample: 0.002572656637950253
Time elapsed: 354.4631907939911
Iteration: 49
Best parameters: [ -7.77234545 -12.93082599 -10.45047491 -2.53441206]
Best objective: 0.00013457113439608969
Mean objective: 0.0001714177787953203
Inner objective at best sample: 0.030193708073420394
Gradient objective at best sample: 0.0030059136939024306
Time elapsed: 364.7402470111847
Iteration: 50
Best parameters: [ -7.93443644 -9.38251446 -10.37656711 -2.57439023]
Best objective: 0.00013392557736356268
Mean objective: 0.0001720103666854439
Inner objective at best sample: 0.027268417573418677
Gradient objective at best sample: 0.0027134491996055115
Time elapsed: 365.9275529384613
Iteration: 51
Best parameters: [ -8.04840222 -14.2272197 -10.29400452 -2.60666104]
Best objective: 0.00013463041673948063
Mean objective: 0.00014386245002049689
Inner objective at best sample: 0.02609690116075333
Gradient objective at best sample: 0.002596227074401385
Time elapsed: 350.3952000141144
Iteration: 52
Best parameters: [ -8.22535865 -11.866082 -10.24731604 -2.6402144 ]
Best objective: 0.0001343606266042608
Mean objective: 0.00013990841080511297
Inner objective at best sample: 0.02468769249151063
Gradient objective at best sample: 0.002455333186490637
Time elapsed: 319.31110286712646
Iteration: 53
Best parameters: [ -8.07495073 -12.09253193 -10.3855847 -2.5921571 ]
Best objective: 0.0001335825282499461
Mean objective: 0.00013613806287394564
Inner objective at best sample: 0.025617664712256613
Gradient objective at best sample: 0.0025484082184006667
Time elapsed: 306.1929066181183
Iteration: 54
Best parameters: [ -7.88577763 -12.04325032 -10.52703915 -2.53939848]
Best objective: 0.00013320546430905289
Mean objective: 0.00013636849878968758
Inner objective at best sample: 0.02753298683602018
Gradient objective at best sample: 0.0027399781371711127
Time elapsed: 355.9437646865845
Iteration: 55
Best parameters: [ -7.95048472 -10.68157158 -10.63080364 -2.53173801]
Best objective: 0.000132467920128546
Mean objective: 0.00013455434970955295
Inner objective at best sample: 0.026119436609308225
Gradient objective at best sample: 0.0025986968689179677
Time elapsed: 359.28114581108093
Iteration: 56
Best parameters: [ -8.06063745 -11.50407826 -10.56118397 -2.55842109]
Best objective: 0.00013287039076447288
Mean objective: 0.00013589371571165378
Inner objective at best sample: 0.025209730728327162
Gradient objective at best sample: 0.002507686033756269
Time elapsed: 337.2537889480591
Iteration: 57
Best parameters: [ -8.00225265 -12.21381048 -10.61984548 -2.53978707]
Best objective: 0.0001326340171037374
Mean objective: 0.00013400234345759066
Inner objective at best sample: 0.025656913391490458
Gradient objective at best sample: 0.002552427937438672
Time elapsed: 359.06032514572144
Iteration: 58
Best parameters: [ -7.96023772 -10.2601141 -10.73791522 -2.5159563 ]
Best objective: 0.000132032558293007
Mean objective: 0.00013329713033816587
Inner objective at best sample: 0.02554067391345512
Gradient objective at best sample: 0.0025408641355162114
Time elapsed: 359.8373918533325
Iteration: 59
Best parameters: [ -7.8755182 -12.18655373 -10.96174632 -2.46833262]
Best objective: 0.00013139128072881375
Mean objective: 0.00013349788129021355
Inner objective at best sample: 0.02579484978076236
Gradient objective at best sample: 0.0025663458500033544
Time elapsed: 352.6491131782532
Iteration: 60
Best parameters: [ -7.99137323 -15.42403848 -11.04340883 -2.47729843]
Best objective: 0.00013138515197661231
Mean objective: 0.00013816493453122893
Inner objective at best sample: 0.023802802678372953