

训练日志

$ python train_resnet.py 
resnet-50: 8.223 GFlops - 97.492 MB
resnet-34: 7.348 GFlops - 83.180 MB
resnet-18: 3.641 GFlops - 44.607 MB
{'train': <torch.utils.data.dataloader.DataLoader object at 0x7f15bbef99d0>, 'test': <torch.utils.data.dataloader.DataLoader object at 0x7f15bac9afd0>}
{'train': 40058, 'test': 12032}
resnet-50 - Epoch 1/100
----------
lr: [0.0002]
train Loss: 2.4752 Top-1 Acc: 4.8644 Top-5 Acc: 29.1611
test Loss: 2.4580 Top-1 Acc: 4.1501 Top-5 Acc: 35.7653
resnet-50 - Epoch 2/100
----------
lr: [0.0004]
train Loss: 1.7950 Top-1 Acc: 35.7960 Top-5 Acc: 69.6722
test Loss: 1.4343 Top-1 Acc: 48.1781 Top-5 Acc: 82.5324
resnet-50 - Epoch 3/100
----------
lr: [0.0006]
train Loss: 1.5582 Top-1 Acc: 42.2065 Top-5 Acc: 78.5267
test Loss: 1.3762 Top-1 Acc: 48.8504 Top-5 Acc: 83.3707
resnet-50 - Epoch 4/100
----------
lr: [0.0008]
train Loss: 1.3753 Top-1 Acc: 48.2533 Top-5 Acc: 84.1672
test Loss: 1.1072 Top-1 Acc: 57.3871 Top-5 Acc: 90.3345
resnet-50 - Epoch 5/100
----------
lr: [0.001]
train Loss: 1.2725 Top-1 Acc: 51.5140 Top-5 Acc: 86.9042
test Loss: 1.1662 Top-1 Acc: 55.2498 Top-5 Acc: 89.2679
resnet-50 - Epoch 6/100
----------
lr: [0.001]
train Loss: 1.2029 Top-1 Acc: 54.1300 Top-5 Acc: 88.4375
test Loss: 1.0271 Top-1 Acc: 60.4582 Top-5 Acc: 91.8700
resnet-50 - Epoch 7/100
----------
lr: [0.000998278903745945]
train Loss: 1.1258 Top-1 Acc: 57.0070 Top-5 Acc: 90.0525
test Loss: 1.0416 Top-1 Acc: 60.5038 Top-5 Acc: 90.9985
resnet-50 - Epoch 8/100
----------
lr: [0.0009965601596710891]
train Loss: 1.0840 Top-1 Acc: 58.5369 Top-5 Acc: 90.5974
test Loss: 1.0204 Top-1 Acc: 61.3754 Top-5 Acc: 92.9781
resnet-50 - Epoch 9/100
----------
lr: [0.000994353645620711]
train Loss: 1.0470 Top-1 Acc: 59.9623 Top-5 Acc: 91.4920
test Loss: 1.1140 Top-1 Acc: 57.2958 Top-5 Acc: 91.3928
resnet-50 - Epoch 10/100
----------
lr: [0.0009916617739430225]
train Loss: 1.0216 Top-1 Acc: 60.9508 Top-5 Acc: 91.9084
test Loss: 0.9819 Top-1 Acc: 61.4251 Top-5 Acc: 93.3765
resnet-50 - Epoch 11/100
----------
lr: [0.00098848748771634]
train Loss: 0.9949 Top-1 Acc: 61.8091 Top-5 Acc: 92.2331
test Loss: 0.9123 Top-1 Acc: 65.5088 Top-5 Acc: 94.3932
resnet-50 - Epoch 12/100
----------
lr: [0.0009848342575303802]
train Loss: 0.9768 Top-1 Acc: 62.4321 Top-5 Acc: 92.5097
test Loss: 0.8982 Top-1 Acc: 66.2143 Top-5 Acc: 95.0365
resnet-50 - Epoch 13/100
----------
lr: [0.0009807060776907206]
train Loss: 0.9601 Top-1 Acc: 63.2077 Top-5 Acc: 92.9015
test Loss: 0.8924 Top-1 Acc: 67.4012 Top-5 Acc: 94.3103
resnet-50 - Epoch 14/100
----------
lr: [0.000976107461850577]
train Loss: 0.9405 Top-1 Acc: 63.9274 Top-5 Acc: 93.1325
test Loss: 0.7690 Top-1 Acc: 70.0407 Top-5 Acc: 95.9288
resnet-50 - Epoch 15/100
----------
lr: [0.0009710434380746693]
train Loss: 0.9284 Top-1 Acc: 64.4840 Top-5 Acc: 93.2557
test Loss: 0.8700 Top-1 Acc: 67.0028 Top-5 Acc: 93.9990
resnet-50 - Epoch 16/100
----------
lr: [0.0009655195433405745]
train Loss: 0.9078 Top-1 Acc: 65.1218 Top-5 Acc: 93.6195
test Loss: 0.7194 Top-1 Acc: 72.6967 Top-5 Acc: 96.4226
resnet-50 - Epoch 17/100
----------
lr: [0.0009595418174835732]
train Loss: 0.8871 Top-1 Acc: 65.9001 Top-5 Acc: 93.9409
test Loss: 0.7631 Top-1 Acc: 71.2193 Top-5 Acc: 95.8168
resnet-50 - Epoch 18/100
----------
lr: [0.0009531167965916136]
train Loss: 0.8733 Top-1 Acc: 66.3449 Top-5 Acc: 94.1669
test Loss: 0.8799 Top-1 Acc: 67.4054 Top-5 Acc: 94.9078
resnet-50 - Epoch 19/100
----------
lr: [0.0009462515058576077]
train Loss: 0.8517 Top-1 Acc: 67.2512 Top-5 Acc: 94.4102
test Loss: 0.8869 Top-1 Acc: 66.5588 Top-5 Acc: 94.9245
resnet-50 - Epoch 20/100
----------
lr: [0.0009389534518968771]
train Loss: 0.8428 Top-1 Acc: 67.5533 Top-5 Acc: 94.5921
test Loss: 0.7241 Top-1 Acc: 73.8629 Top-5 Acc: 96.4890
resnet-50 - Epoch 21/100
----------
lr: [0.000931230614538144]
train Loss: 0.8279 Top-1 Acc: 68.2387 Top-5 Acc: 94.5948
test Loss: 0.8042 Top-1 Acc: 69.3933 Top-5 Acc: 95.2731
resnet-50 - Epoch 22/100
----------
lr: [0.0009230914380970417]
train Loss: 0.8082 Top-1 Acc: 68.8853 Top-5 Acc: 95.0382
test Loss: 0.6456 Top-1 Acc: 76.2824 Top-5 Acc: 96.9621
resnet-50 - Epoch 23/100
----------
lr: [0.0009145448221416838]
train Loss: 0.7931 Top-1 Acc: 69.6258 Top-5 Acc: 95.1330
test Loss: 0.6904 Top-1 Acc: 74.1576 Top-5 Acc: 96.4434
resnet-50 - Epoch 24/100
----------
lr: [0.000905600111760385]
train Loss: 0.7806 Top-1 Acc: 69.9565 Top-5 Acc: 95.3199
test Loss: 0.7305 Top-1 Acc: 72.6967 Top-5 Acc: 96.3314
resnet-50 - Epoch 25/100
----------
lr: [0.0008962670873421745]
train Loss: 0.7651 Top-1 Acc: 70.8056 Top-5 Acc: 95.3465
test Loss: 0.5768 Top-1 Acc: 79.0256 Top-5 Acc: 97.3855
resnet-50 - Epoch 26/100
----------
lr: [0.0008865559538812679]
train Loss: 0.7509 Top-1 Acc: 70.9226 Top-5 Acc: 95.6963
test Loss: 0.6505 Top-1 Acc: 75.1536 Top-5 Acc: 97.0078
resnet-50 - Epoch 27/100
----------
lr: [0.000876477329817195]
train Loss: 0.7388 Top-1 Acc: 71.5687 Top-5 Acc: 95.6953
test Loss: 0.6873 Top-1 Acc: 75.5437 Top-5 Acc: 96.5388
resnet-50 - Epoch 28/100
----------
lr: [0.0008660422354227753]
train Loss: 0.7305 Top-1 Acc: 71.9068 Top-5 Acc: 95.8399
test Loss: 0.5820 Top-1 Acc: 77.9092 Top-5 Acc: 97.6220
resnet-50 - Epoch 29/100
----------
lr: [0.0008552620807526363]
train Loss: 0.7172 Top-1 Acc: 72.6257 Top-5 Acc: 95.8333
test Loss: 0.5987 Top-1 Acc: 78.6022 Top-5 Acc: 97.4021
resnet-50 - Epoch 30/100
----------
lr: [0.0008441486531654493]
train Loss: 0.7078 Top-1 Acc: 72.7790 Top-5 Acc: 96.1107
test Loss: 0.5668 Top-1 Acc: 80.0009 Top-5 Acc: 97.6344
resnet-50 - Epoch 31/100
----------
lr: [0.0008327141044335113]
train Loss: 0.6970 Top-1 Acc: 73.2450 Top-5 Acc: 96.2012
test Loss: 0.5598 Top-1 Acc: 80.1668 Top-5 Acc: 97.6469
resnet-50 - Epoch 32/100
----------
lr: [0.000820970937453775]
train Loss: 0.6847 Top-1 Acc: 73.7588 Top-5 Acc: 96.3091
test Loss: 0.6150 Top-1 Acc: 77.4153 Top-5 Acc: 97.1946
resnet-50 - Epoch 33/100
----------
lr: [0.0008089319925748344]
train Loss: 0.6815 Top-1 Acc: 73.9047 Top-5 Acc: 96.1598
test Loss: 0.5338 Top-1 Acc: 80.8267 Top-5 Acc: 98.0909
resnet-50 - Epoch 34/100
----------
lr: [0.0007966104335548217]
train Loss: 0.6695 Top-1 Acc: 74.0987 Top-5 Acc: 96.3915
test Loss: 0.5730 Top-1 Acc: 79.9842 Top-5 Acc: 97.4269
resnet-50 - Epoch 35/100
----------
lr: [0.0007840197331655513]
train Loss: 0.6603 Top-1 Acc: 74.6525 Top-5 Acc: 96.6340
test Loss: 0.5517 Top-1 Acc: 78.5815 Top-5 Acc: 97.2858
resnet-50 - Epoch 36/100
----------
lr: [0.0007711736584586432]
train Loss: 0.6542 Top-1 Acc: 74.9331 Top-5 Acc: 96.6357
test Loss: 0.5598 Top-1 Acc: 79.3825 Top-5 Acc: 97.5017
resnet-50 - Epoch 37/100
----------
lr: [0.0007580862557097296]
train Loss: 0.6421 Top-1 Acc: 75.3178 Top-5 Acc: 96.6897
test Loss: 0.5116 Top-1 Acc: 81.9140 Top-5 Acc: 98.1408
resnet-50 - Epoch 38/100
----------
lr: [0.0007447718350571855]
train Loss: 0.6361 Top-1 Acc: 75.7091 Top-5 Acc: 96.8800
test Loss: 0.4831 Top-1 Acc: 82.4577 Top-5 Acc: 98.2445
resnet-50 - Epoch 39/100
----------
lr: [0.0007312449548521687]
train Loss: 0.6278 Top-1 Acc: 76.1327 Top-5 Acc: 96.8326
test Loss: 0.5228 Top-1 Acc: 81.0176 Top-5 Acc: 97.8378
resnet-50 - Epoch 40/100
----------
lr: [0.0007175204057370693]
train Loss: 0.6205 Top-1 Acc: 76.3259 Top-5 Acc: 97.0409
test Loss: 0.7594 Top-1 Acc: 71.5388 Top-5 Acc: 94.2688
resnet-50 - Epoch 41/100
----------
lr: [0.0007036131944697442]
train Loss: 0.6145 Top-1 Acc: 76.4825 Top-5 Acc: 97.0502
test Loss: 0.4697 Top-1 Acc: 83.3416 Top-5 Acc: 98.3068
resnet-50 - Epoch 42/100
----------
lr: [0.0006895385275112213]
train Loss: 0.6022 Top-1 Acc: 77.0672 Top-5 Acc: 97.1765
test Loss: 0.5193 Top-1 Acc: 81.0508 Top-5 Acc: 97.9831
resnet-50 - Epoch 43/100
----------
lr: [0.0006753117943947742]
train Loss: 0.5970 Top-1 Acc: 76.8803 Top-5 Acc: 97.2653
test Loss: 0.6230 Top-1 Acc: 77.3573 Top-5 Acc: 97.2028
resnet-50 - Epoch 44/100
----------
lr: [0.0006609485508945376]
train Loss: 0.5914 Top-1 Acc: 77.3878 Top-5 Acc: 97.2712
test Loss: 0.4581 Top-1 Acc: 83.8687 Top-5 Acc: 98.4645
resnet-50 - Epoch 45/100
----------
lr: [0.0006464645020120294]
train Loss: 0.5846 Top-1 Acc: 77.8223 Top-5 Acc: 97.2762
test Loss: 0.4702 Top-1 Acc: 82.3207 Top-5 Acc: 98.5350
resnet-50 - Epoch 46/100
----------
lr: [0.0006318754847991442]
train Loss: 0.5803 Top-1 Acc: 77.8804 Top-5 Acc: 97.3318
test Loss: 0.4783 Top-1 Acc: 82.5863 Top-5 Acc: 97.9001
resnet-50 - Epoch 47/100
----------
lr: [0.0006171974510363578]
train Loss: 0.5699 Top-1 Acc: 78.2351 Top-5 Acc: 97.4754
test Loss: 0.4406 Top-1 Acc: 84.7153 Top-5 Acc: 98.5599
resnet-50 - Epoch 48/100
----------
lr: [0.0006024464497850381]
train Loss: 0.5608 Top-1 Acc: 78.6910 Top-5 Acc: 97.5237
test Loss: 0.4888 Top-1 Acc: 82.0717 Top-5 Acc: 97.9664
resnet-50 - Epoch 49/100
----------
lr: [0.000587638609832873]
train Loss: 0.5556 Top-1 Acc: 78.9311 Top-5 Acc: 97.4688
test Loss: 0.4638 Top-1 Acc: 83.1134 Top-5 Acc: 98.1656
resnet-50 - Epoch 50/100
----------
lr: [0.0005727901220515562]
train Loss: 0.5554 Top-1 Acc: 78.7085 Top-5 Acc: 97.5552
test Loss: 0.5011 Top-1 Acc: 82.0427 Top-5 Acc: 98.0993
resnet-50 - Epoch 51/100
----------
lr: [0.0005579172216859389]
train Loss: 0.5422 Top-1 Acc: 79.3532 Top-5 Acc: 97.7355
test Loss: 0.4112 Top-1 Acc: 85.0348 Top-5 Acc: 98.8048
resnet-50 - Epoch 52/100
----------
lr: [0.0005430361705939213]
train Loss: 0.5354 Top-1 Acc: 79.4713 Top-5 Acc: 97.7372
test Loss: 0.4348 Top-1 Acc: 84.2588 Top-5 Acc: 98.6803
resnet-50 - Epoch 53/100
----------
lr: [0.0005281632394564116]
train Loss: 0.5352 Top-1 Acc: 79.7212 Top-5 Acc: 97.7729
test Loss: 0.5426 Top-1 Acc: 80.7686 Top-5 Acc: 97.8710
resnet-50 - Epoch 54/100
----------
lr: [0.0005133146899766715]
train Loss: 0.5267 Top-1 Acc: 80.0649 Top-5 Acc: 97.7878
test Loss: 0.4821 Top-1 Acc: 82.4037 Top-5 Acc: 98.1075
resnet-50 - Epoch 55/100
----------
lr: [0.0004985067570883801]
train Loss: 0.5200 Top-1 Acc: 80.1930 Top-5 Acc: 97.9341
test Loss: 0.4565 Top-1 Acc: 83.8355 Top-5 Acc: 98.5890
resnet-50 - Epoch 56/100
----------
lr: [0.00048375563119170404]
train Loss: 0.5185 Top-1 Acc: 80.2298 Top-5 Acc: 97.8867
test Loss: 0.3975 Top-1 Acc: 85.5577 Top-5 Acc: 98.8048
resnet-50 - Epoch 57/100
----------
lr: [0.00046907744043659587]
train Loss: 0.5052 Top-1 Acc: 80.9513 Top-5 Acc: 97.9316
test Loss: 0.4105 Top-1 Acc: 86.0641 Top-5 Acc: 98.8545
resnet-50 - Epoch 58/100
----------
lr: [0.0004544882330724729]
train Loss: 0.5052 Top-1 Acc: 80.6897 Top-5 Acc: 97.9573
test Loss: 0.4182 Top-1 Acc: 84.9187 Top-5 Acc: 98.7549
resnet-50 - Epoch 59/100
----------
lr: [0.0004400039598832889]
train Loss: 0.4935 Top-1 Acc: 81.3087 Top-5 Acc: 98.0645
test Loss: 0.4075 Top-1 Acc: 85.7736 Top-5 Acc: 98.4520
resnet-50 - Epoch 60/100
----------
lr: [0.0004256404567268918]
train Loss: 0.4877 Top-1 Acc: 81.3635 Top-5 Acc: 98.1484
test Loss: 0.3890 Top-1 Acc: 85.5163 Top-5 Acc: 98.8961
resnet-50 - Epoch 61/100
----------
lr: [0.00041141342719735894]
train Loss: 0.4775 Top-1 Acc: 81.9815 Top-5 Acc: 98.1990
test Loss: 0.3907 Top-1 Acc: 86.2343 Top-5 Acc: 98.8379
resnet-50 - Epoch 62/100
----------
lr: [0.00039733842542880027]
train Loss: 0.4752 Top-1 Acc: 81.9382 Top-5 Acc: 98.2937
test Loss: 0.3811 Top-1 Acc: 86.7945 Top-5 Acc: 99.0081
resnet-50 - Epoch 63/100
----------
lr: [0.000383430839058869]
train Loss: 0.4677 Top-1 Acc: 82.3185 Top-5 Acc: 98.1791
test Loss: 0.3769 Top-1 Acc: 86.2384 Top-5 Acc: 98.8504
resnet-50 - Epoch 64/100
----------
lr: [0.0003697058723699185]
train Loss: 0.4656 Top-1 Acc: 82.4214 Top-5 Acc: 98.2995
test Loss: 0.3834 Top-1 Acc: 86.1637 Top-5 Acc: 98.8130
resnet-50 - Epoch 65/100
----------
lr: [0.0003561785296253988]
train Loss: 0.4558 Top-1 Acc: 82.9302 Top-5 Acc: 98.3602
test Loss: 0.3597 Top-1 Acc: 87.7822 Top-5 Acc: 99.1035
resnet-50 - Epoch 66/100
----------
lr: [0.00034286359861869595]
train Loss: 0.4506 Top-1 Acc: 82.9975 Top-5 Acc: 98.4076
test Loss: 0.3528 Top-1 Acc: 87.4544 Top-5 Acc: 99.0372
resnet-50 - Epoch 67/100
----------
lr: [0.0003297756344511347]
train Loss: 0.4489 Top-1 Acc: 83.1085 Top-5 Acc: 98.3054
test Loss: 0.3501 Top-1 Acc: 87.8735 Top-5 Acc: 99.1077
resnet-50 - Epoch 68/100
----------
lr: [0.00031692894355531755]
train Loss: 0.4390 Top-1 Acc: 83.6868 Top-5 Acc: 98.3443
test Loss: 0.3560 Top-1 Acc: 87.5083 Top-5 Acc: 99.0621
resnet-50 - Epoch 69/100
----------
lr: [0.00030433756797932856]
train Loss: 0.4344 Top-1 Acc: 83.7177 Top-5 Acc: 98.5454
test Loss: 0.3455 Top-1 Acc: 87.8445 Top-5 Acc: 99.0455
resnet-50 - Epoch 70/100
----------
lr: [0.0002920152699465371]
train Loss: 0.4271 Top-1 Acc: 83.9951 Top-5 Acc: 98.5903
test Loss: 0.3381 Top-1 Acc: 87.6826 Top-5 Acc: 99.1285
resnet-50 - Epoch 71/100
----------
lr: [0.00027997551670480765]
train Loss: 0.4239 Top-1 Acc: 84.0491 Top-5 Acc: 98.6318
test Loss: 0.3496 Top-1 Acc: 87.0767 Top-5 Acc: 99.0745
resnet-50 - Epoch 72/100
----------
lr: [0.00026823146567776427]
train Loss: 0.4170 Top-1 Acc: 84.3372 Top-5 Acc: 98.6842
test Loss: 0.3457 Top-1 Acc: 88.0437 Top-5 Acc: 99.0787
resnet-50 - Epoch 73/100
----------
lr: [0.00025679594992932274]
train Loss: 0.4065 Top-1 Acc: 85.0865 Top-5 Acc: 98.6692
test Loss: 0.3321 Top-1 Acc: 87.7490 Top-5 Acc: 99.1782
resnet-50 - Epoch 74/100
----------
lr: [0.0002456814639509084]
train Loss: 0.4050 Top-1 Acc: 84.9438 Top-5 Acc: 98.6892
test Loss: 0.3626 Top-1 Acc: 87.4419 Top-5 Acc: 98.9874
resnet-50 - Epoch 75/100
----------
lr: [0.0002349001497784573]
train Loss: 0.3992 Top-1 Acc: 85.2202 Top-5 Acc: 98.6758
test Loss: 0.3373 Top-1 Acc: 88.0852 Top-5 Acc: 99.1035
resnet-50 - Epoch 76/100
----------
lr: [0.0002244637834432804]
train Loss: 0.3934 Top-1 Acc: 85.5144 Top-5 Acc: 98.7490
test Loss: 0.3293 Top-1 Acc: 88.3342 Top-5 Acc: 99.1118
resnet-50 - Epoch 77/100
----------
lr: [0.00021438376175687992]
train Loss: 0.3882 Top-1 Acc: 85.5578 Top-5 Acc: 98.8163
test Loss: 0.3312 Top-1 Acc: 87.8113 Top-5 Acc: 99.1616
resnet-50 - Epoch 78/100
----------
lr: [0.00020467108942438483]
train Loss: 0.3813 Top-1 Acc: 86.0851 Top-5 Acc: 98.8985
test Loss: 0.3318 Top-1 Acc: 88.5375 Top-5 Acc: 99.1617
resnet-50 - Epoch 79/100
----------
lr: [0.00019533636647386889]
train Loss: 0.3744 Top-1 Acc: 86.3950 Top-5 Acc: 98.8936
test Loss: 0.3193 Top-1 Acc: 88.8031 Top-5 Acc: 99.2322
resnet-50 - Epoch 80/100
----------
lr: [0.00018638977597841452]
train Loss: 0.3696 Top-1 Acc: 86.4896 Top-5 Acc: 98.9134
test Loss: 0.3247 Top-1 Acc: 88.6164 Top-5 Acc: 99.2198
resnet-50 - Epoch 81/100
----------
lr: [0.0001778410720329691]
train Loss: 0.3632 Top-1 Acc: 86.7943 Top-5 Acc: 98.9185
test Loss: 0.3179 Top-1 Acc: 88.1018 Top-5 Acc: 99.2695
resnet-50 - Epoch 82/100
----------
lr: [0.0001696995679265583]
train Loss: 0.3638 Top-1 Acc: 86.5925 Top-5 Acc: 98.8836
test Loss: 0.3239 Top-1 Acc: 88.0520 Top-5 Acc: 99.1990
resnet-50 - Epoch 83/100
----------
lr: [0.00016197412441851852]
train Loss: 0.3600 Top-1 Acc: 86.7712 Top-5 Acc: 98.9533
test Loss: 0.3098 Top-1 Acc: 88.8861 Top-5 Acc: 99.2032
resnet-50 - Epoch 84/100
----------
lr: [0.00015467313797922408]
train Loss: 0.3526 Top-1 Acc: 87.2123 Top-5 Acc: 99.0057
test Loss: 0.3159 Top-1 Acc: 88.6703 Top-5 Acc: 99.0994
resnet-50 - Epoch 85/100
----------
lr: [0.00014780452878119756]
train Loss: 0.3479 Top-1 Acc: 87.3363 Top-5 Acc: 99.0829
test Loss: 0.3192 Top-1 Acc: 88.5334 Top-5 Acc: 99.2281
resnet-50 - Epoch 86/100
----------
lr: [0.00014137572810829906]
train Loss: 0.3390 Top-1 Acc: 87.7049 Top-5 Acc: 99.0936
test Loss: 0.3095 Top-1 Acc: 88.8571 Top-5 Acc: 99.3152
resnet-50 - Epoch 87/100
----------
lr: [0.00013539366465842634]
train Loss: 0.3406 Top-1 Acc: 87.5744 Top-5 Acc: 99.0430
test Loss: 0.3126 Top-1 Acc: 88.6952 Top-5 Acc: 99.3194
resnet-50 - Epoch 88/100
----------
lr: [0.00012986474889303232]
train Loss: 0.3364 Top-1 Acc: 87.8587 Top-5 Acc: 99.0804
test Loss: 0.3083 Top-1 Acc: 89.2347 Top-5 Acc: 99.1783
resnet-50 - Epoch 89/100
----------
lr: [0.00012479485402933806]
train Loss: 0.3350 Top-1 Acc: 87.9068 Top-5 Acc: 99.0929
test Loss: 0.3145 Top-1 Acc: 88.8487 Top-5 Acc: 99.1451
resnet-50 - Epoch 90/100
----------
lr: [0.00012018929127011419]
train Loss: 0.3275 Top-1 Acc: 88.1587 Top-5 Acc: 99.1378
test Loss: 0.3042 Top-1 Acc: 89.2721 Top-5 Acc: 99.2281
resnet-50 - Epoch 91/100
----------
lr: [0.0001160527749912063]
train Loss: 0.3289 Top-1 Acc: 88.1884 Top-5 Acc: 99.1477
test Loss: 0.3081 Top-1 Acc: 89.2680 Top-5 Acc: 99.2281
resnet-50 - Epoch 92/100
----------
lr: [0.00011238936992058625]
train Loss: 0.3270 Top-1 Acc: 88.2940 Top-5 Acc: 99.0805
test Loss: 0.3054 Top-1 Acc: 89.2223 Top-5 Acc: 99.2156
resnet-50 - Epoch 93/100
----------
lr: [0.00010920240466794277]
train Loss: 0.3206 Top-1 Acc: 88.6295 Top-5 Acc: 99.1801
test Loss: 0.3026 Top-1 Acc: 88.8612 Top-5 Acc: 99.2281
resnet-50 - Epoch 94/100
----------
lr: [0.00010649431886114302]
train Loss: 0.3147 Top-1 Acc: 88.7284 Top-5 Acc: 99.2150
test Loss: 0.3035 Top-1 Acc: 88.6247 Top-5 Acc: 99.2239
resnet-50 - Epoch 95/100
----------
lr: [0.00010426636975545291]
train Loss: 0.3119 Top-1 Acc: 89.0330 Top-5 Acc: 99.1626
test Loss: 0.3025 Top-1 Acc: 89.1144 Top-5 Acc: 99.2364
resnet-50 - Epoch 96/100
----------
lr: [0.00010251801320462015]
train Loss: 0.3095 Top-1 Acc: 89.0226 Top-5 Acc: 99.2075
test Loss: 0.2988 Top-1 Acc: 89.1476 Top-5 Acc: 99.3857
resnet-50 - Epoch 97/100
----------
lr: [0.00010124543471429218]
train Loss: 0.3108 Top-1 Acc: 88.9437 Top-5 Acc: 99.2225
test Loss: 0.3047 Top-1 Acc: 89.1517 Top-5 Acc: 99.2530
resnet-50 - Epoch 98/100
----------
lr: [0.00010043747387396913]
train Loss: 0.3065 Top-1 Acc: 89.1304 Top-5 Acc: 99.2100
test Loss: 0.2992 Top-1 Acc: 89.3592 Top-5 Acc: 99.3111
resnet-50 - Epoch 99/100
----------
lr: [0.00010006152536841758]
train Loss: 0.3043 Top-1 Acc: 89.3240 Top-5 Acc: 99.2898
test Loss: 0.3013 Top-1 Acc: 89.3717 Top-5 Acc: 99.2696
resnet-50 - Epoch 100/100
----------
lr: [0.0001]
train Loss: 0.3029 Top-1 Acc: 89.3255 Top-5 Acc: 99.2325
test Loss: 0.3043 Top-1 Acc: 89.3551 Top-5 Acc: 99.3277
Training resnet-50 complete in 786m 57s
Best test Top-1 Acc: 89.371674
Best test Top-5 Acc: 99.385750
train resnet-50 done

resnet-34 - Epoch 1/100
----------
lr: [0.0002]
train Loss: 2.3195 Top-1 Acc: 15.2980 Top-5 Acc: 48.5627
test Loss: 2.3041 Top-1 Acc: 21.1446 Top-5 Acc: 50.4565
resnet-34 - Epoch 2/100
----------
lr: [0.0004]
train Loss: 1.6373 Top-1 Acc: 40.0766 Top-5 Acc: 75.4217
test Loss: 1.3159 Top-1 Acc: 51.6060 Top-5 Acc: 86.9646
resnet-34 - Epoch 3/100
----------
lr: [0.0006]
train Loss: 1.4039 Top-1 Acc: 47.0025 Top-5 Acc: 83.1351
test Loss: 1.7886 Top-1 Acc: 40.0814 Top-5 Acc: 76.5646
resnet-34 - Epoch 4/100
----------
lr: [0.0008]
train Loss: 1.2940 Top-1 Acc: 50.9920 Top-5 Acc: 85.9724
test Loss: 1.3547 Top-1 Acc: 49.3899 Top-5 Acc: 84.6489
resnet-34 - Epoch 5/100
----------
lr: [0.001]
train Loss: 1.2122 Top-1 Acc: 53.8778 Top-5 Acc: 87.7764
test Loss: 1.7110 Top-1 Acc: 36.7073 Top-5 Acc: 75.9794
resnet-34 - Epoch 6/100
----------
lr: [0.001]
train Loss: 1.1568 Top-1 Acc: 55.5930 Top-5 Acc: 89.0915
test Loss: 1.2178 Top-1 Acc: 55.9387 Top-5 Acc: 86.4957
resnet-34 - Epoch 7/100
----------
lr: [0.000998278903745945]
train Loss: 1.0816 Top-1 Acc: 58.2982 Top-5 Acc: 90.4982
test Loss: 1.0013 Top-1 Acc: 63.5126 Top-5 Acc: 92.1024
resnet-34 - Epoch 8/100
----------
lr: [0.0009965601596710891]
train Loss: 1.0350 Top-1 Acc: 59.8966 Top-5 Acc: 91.3335
test Loss: 0.8951 Top-1 Acc: 64.8697 Top-5 Acc: 94.2522
resnet-34 - Epoch 9/100
----------
lr: [0.000994353645620711]
train Loss: 1.0026 Top-1 Acc: 61.1767 Top-5 Acc: 91.8766
test Loss: 0.9659 Top-1 Acc: 66.7248 Top-5 Acc: 94.4016
resnet-34 - Epoch 10/100
----------
lr: [0.0009916617739430225]
train Loss: 0.9682 Top-1 Acc: 62.5469 Top-5 Acc: 92.4524
test Loss: 0.8816 Top-1 Acc: 66.9655 Top-5 Acc: 94.4804
resnet-34 - Epoch 11/100
----------
lr: [0.00098848748771634]
train Loss: 0.9429 Top-1 Acc: 63.4431 Top-5 Acc: 93.0156
test Loss: 0.9067 Top-1 Acc: 64.5169 Top-5 Acc: 92.8577
resnet-34 - Epoch 12/100
----------
lr: [0.0009848342575303802]
train Loss: 0.9278 Top-1 Acc: 64.2153 Top-5 Acc: 93.0368
test Loss: 0.9205 Top-1 Acc: 63.6537 Top-5 Acc: 95.0158
resnet-34 - Epoch 13/100
----------
lr: [0.0009807060776907206]
train Loss: 0.9073 Top-1 Acc: 64.8061 Top-5 Acc: 93.5512
test Loss: 0.7391 Top-1 Acc: 73.1657 Top-5 Acc: 96.2318
resnet-34 - Epoch 14/100
----------
lr: [0.000976107461850577]
train Loss: 0.8845 Top-1 Acc: 65.7615 Top-5 Acc: 93.7989
test Loss: 0.7344 Top-1 Acc: 71.3230 Top-5 Acc: 96.2276
resnet-34 - Epoch 15/100
----------
lr: [0.0009710434380746693]
train Loss: 0.8674 Top-1 Acc: 66.4144 Top-5 Acc: 94.0024
test Loss: 1.2034 Top-1 Acc: 58.7068 Top-5 Acc: 92.8204
resnet-34 - Epoch 16/100
----------
lr: [0.0009655195433405745]
train Loss: 0.8460 Top-1 Acc: 67.0880 Top-5 Acc: 94.3688
test Loss: 0.6920 Top-1 Acc: 74.4231 Top-5 Acc: 96.9829
resnet-34 - Epoch 17/100
----------
lr: [0.0009595418174835732]
train Loss: 0.8302 Top-1 Acc: 67.9046 Top-5 Acc: 94.5325
test Loss: 0.6918 Top-1 Acc: 75.0581 Top-5 Acc: 96.3106
resnet-34 - Epoch 18/100
----------
lr: [0.0009531167965916136]
train Loss: 0.8081 Top-1 Acc: 68.6453 Top-5 Acc: 94.6736
test Loss: 0.6455 Top-1 Acc: 76.0043 Top-5 Acc: 96.7920
resnet-34 - Epoch 19/100
----------
lr: [0.0009462515058576077]
train Loss: 0.7921 Top-1 Acc: 69.2120 Top-5 Acc: 94.8746
test Loss: 0.6841 Top-1 Acc: 74.3651 Top-5 Acc: 96.8335
resnet-34 - Epoch 20/100
----------
lr: [0.0009389534518968771]
train Loss: 0.7743 Top-1 Acc: 69.9870 Top-5 Acc: 95.0280
test Loss: 0.5867 Top-1 Acc: 79.0629 Top-5 Acc: 97.5432
resnet-34 - Epoch 21/100
----------
lr: [0.000931230614538144]
train Loss: 0.7622 Top-1 Acc: 70.5830 Top-5 Acc: 95.2726
test Loss: 0.6414 Top-1 Acc: 76.2492 Top-5 Acc: 96.8709
resnet-34 - Epoch 22/100
----------
lr: [0.0009230914380970417]
train Loss: 0.7492 Top-1 Acc: 70.8726 Top-5 Acc: 95.4870
test Loss: 0.5850 Top-1 Acc: 79.8431 Top-5 Acc: 97.4892
resnet-34 - Epoch 23/100
----------
lr: [0.0009145448221416838]
train Loss: 0.7222 Top-1 Acc: 71.9534 Top-5 Acc: 95.6537
test Loss: 0.6012 Top-1 Acc: 76.8011 Top-5 Acc: 97.2776
resnet-34 - Epoch 24/100
----------
lr: [0.000905600111760385]
train Loss: 0.7150 Top-1 Acc: 72.0665 Top-5 Acc: 95.7203
test Loss: 0.5437 Top-1 Acc: 79.5692 Top-5 Acc: 97.2775
resnet-34 - Epoch 25/100
----------
lr: [0.0008962670873421745]
train Loss: 0.7005 Top-1 Acc: 72.6903 Top-5 Acc: 96.0923
test Loss: 0.5985 Top-1 Acc: 76.2533 Top-5 Acc: 97.3813
resnet-34 - Epoch 26/100
----------
lr: [0.0008865559538812679]
train Loss: 0.6866 Top-1 Acc: 73.3804 Top-5 Acc: 96.1190
test Loss: 0.5419 Top-1 Acc: 80.0216 Top-5 Acc: 97.7506
resnet-34 - Epoch 27/100
----------
lr: [0.000876477329817195]
train Loss: 0.6754 Top-1 Acc: 73.6681 Top-5 Acc: 96.3193
test Loss: 0.5985 Top-1 Acc: 78.6064 Top-5 Acc: 96.8791
resnet-34 - Epoch 28/100
----------
lr: [0.0008660422354227753]
train Loss: 0.6652 Top-1 Acc: 74.3419 Top-5 Acc: 96.3051
test Loss: 0.5055 Top-1 Acc: 81.7231 Top-5 Acc: 97.9748
resnet-34 - Epoch 29/100
----------
lr: [0.0008552620807526363]
train Loss: 0.6522 Top-1 Acc: 74.6647 Top-5 Acc: 96.4753
test Loss: 0.5010 Top-1 Acc: 80.6482 Top-5 Acc: 98.2653
resnet-34 - Epoch 30/100
----------
lr: [0.0008441486531654493]
train Loss: 0.6361 Top-1 Acc: 75.2588 Top-5 Acc: 96.6690
test Loss: 0.5009 Top-1 Acc: 81.3372 Top-5 Acc: 97.9581
resnet-34 - Epoch 31/100
----------
lr: [0.0008327141044335113]
train Loss: 0.6292 Top-1 Acc: 75.5728 Top-5 Acc: 96.6682
test Loss: 0.4832 Top-1 Acc: 82.7108 Top-5 Acc: 98.1906
resnet-34 - Epoch 32/100
----------
lr: [0.000820970937453775]
train Loss: 0.6270 Top-1 Acc: 75.4455 Top-5 Acc: 96.7436
test Loss: 0.5675 Top-1 Acc: 79.4572 Top-5 Acc: 97.3689
resnet-34 - Epoch 33/100
----------
lr: [0.0008089319925748344]
train Loss: 0.6122 Top-1 Acc: 76.1243 Top-5 Acc: 96.8783
test Loss: 0.4438 Top-1 Acc: 83.2462 Top-5 Acc: 98.4396
resnet-34 - Epoch 34/100
----------
lr: [0.0007966104335548217]
train Loss: 0.6080 Top-1 Acc: 76.3353 Top-5 Acc: 96.9605
test Loss: 0.4668 Top-1 Acc: 82.7773 Top-5 Acc: 98.1449
resnet-34 - Epoch 35/100
----------
lr: [0.0007840197331655513]
train Loss: 0.5994 Top-1 Acc: 76.6286 Top-5 Acc: 97.0220
test Loss: 0.4125 Top-1 Acc: 85.1303 Top-5 Acc: 98.7591
resnet-34 - Epoch 36/100
----------
lr: [0.0007711736584586432]
train Loss: 0.5898 Top-1 Acc: 76.9030 Top-5 Acc: 97.1242
test Loss: 0.4481 Top-1 Acc: 83.3997 Top-5 Acc: 98.4893
resnet-34 - Epoch 37/100
----------
lr: [0.0007580862557097296]
train Loss: 0.5836 Top-1 Acc: 77.3845 Top-5 Acc: 97.0478
test Loss: 0.4238 Top-1 Acc: 84.1426 Top-5 Acc: 98.5973
resnet-34 - Epoch 38/100
----------
lr: [0.0007447718350571855]
train Loss: 0.5697 Top-1 Acc: 77.7339 Top-5 Acc: 97.1873
test Loss: 0.4587 Top-1 Acc: 83.8023 Top-5 Acc: 98.4230
resnet-34 - Epoch 39/100
----------
lr: [0.0007312449548521687]
train Loss: 0.5609 Top-1 Acc: 78.2452 Top-5 Acc: 97.2688
test Loss: 0.4469 Top-1 Acc: 83.8811 Top-5 Acc: 98.3109
resnet-34 - Epoch 40/100
----------
lr: [0.0007175204057370693]
train Loss: 0.5576 Top-1 Acc: 78.2340 Top-5 Acc: 97.2737
test Loss: 0.4464 Top-1 Acc: 83.1715 Top-5 Acc: 98.5018
resnet-34 - Epoch 41/100
----------
lr: [0.0007036131944697442]
train Loss: 0.5537 Top-1 Acc: 78.4535 Top-5 Acc: 97.4596
test Loss: 0.4132 Top-1 Acc: 84.5244 Top-5 Acc: 98.5433
resnet-34 - Epoch 42/100
----------
lr: [0.0006895385275112213]
train Loss: 0.5401 Top-1 Acc: 79.0262 Top-5 Acc: 97.5286
test Loss: 0.4034 Top-1 Acc: 85.0888 Top-5 Acc: 98.6429
resnet-34 - Epoch 43/100
----------
lr: [0.0006753117943947742]
train Loss: 0.5375 Top-1 Acc: 79.1132 Top-5 Acc: 97.5503
test Loss: 0.4221 Top-1 Acc: 84.4746 Top-5 Acc: 98.5724
resnet-34 - Epoch 44/100
----------
lr: [0.0006609485508945376]
train Loss: 0.5314 Top-1 Acc: 79.3482 Top-5 Acc: 97.4696
test Loss: 0.4005 Top-1 Acc: 85.1262 Top-5 Acc: 98.7134
resnet-34 - Epoch 45/100
----------
lr: [0.0006464645020120294]
train Loss: 0.5216 Top-1 Acc: 79.6906 Top-5 Acc: 97.6358
test Loss: 0.5346 Top-1 Acc: 80.2457 Top-5 Acc: 97.6178
resnet-34 - Epoch 46/100
----------
lr: [0.0006318754847991442]
train Loss: 0.5123 Top-1 Acc: 79.8666 Top-5 Acc: 97.8792
test Loss: 0.4025 Top-1 Acc: 84.6614 Top-5 Acc: 98.7052
resnet-34 - Epoch 47/100
----------
lr: [0.0006171974510363578]
train Loss: 0.5053 Top-1 Acc: 80.3135 Top-5 Acc: 97.8693
test Loss: 0.3728 Top-1 Acc: 86.5745 Top-5 Acc: 98.9293
resnet-34 - Epoch 48/100
----------
lr: [0.0006024464497850381]
train Loss: 0.5010 Top-1 Acc: 80.3964 Top-5 Acc: 97.8751
test Loss: 0.3756 Top-1 Acc: 86.1471 Top-5 Acc: 98.9375
resnet-34 - Epoch 49/100
----------
lr: [0.000587638609832873]
train Loss: 0.4942 Top-1 Acc: 80.6002 Top-5 Acc: 98.0413
test Loss: 0.3988 Top-1 Acc: 85.8939 Top-5 Acc: 98.9292
resnet-34 - Epoch 50/100
----------
lr: [0.0005727901220515562]
train Loss: 0.4846 Top-1 Acc: 81.2397 Top-5 Acc: 97.9922
test Loss: 0.3930 Top-1 Acc: 85.7860 Top-5 Acc: 98.8753
resnet-34 - Epoch 51/100
----------
lr: [0.0005579172216859389]
train Loss: 0.4767 Top-1 Acc: 81.4066 Top-5 Acc: 97.9780
test Loss: 0.3739 Top-1 Acc: 86.4749 Top-5 Acc: 98.8795
resnet-34 - Epoch 52/100
----------
lr: [0.0005430361705939213]
train Loss: 0.4754 Top-1 Acc: 81.5544 Top-5 Acc: 98.0462
test Loss: 0.3760 Top-1 Acc: 86.1471 Top-5 Acc: 98.7051
resnet-34 - Epoch 53/100
----------
lr: [0.0005281632394564116]
train Loss: 0.4680 Top-1 Acc: 81.7381 Top-5 Acc: 98.0985
test Loss: 0.3951 Top-1 Acc: 85.5329 Top-5 Acc: 98.7716
resnet-34 - Epoch 54/100
----------
lr: [0.0005133146899766715]
train Loss: 0.4610 Top-1 Acc: 82.0979 Top-5 Acc: 98.1185
test Loss: 0.3707 Top-1 Acc: 86.5662 Top-5 Acc: 98.9791
resnet-34 - Epoch 55/100
----------
lr: [0.0004985067570883801]
train Loss: 0.4534 Top-1 Acc: 82.4881 Top-5 Acc: 98.2257
test Loss: 0.3679 Top-1 Acc: 86.5496 Top-5 Acc: 98.9044
resnet-34 - Epoch 56/100
----------
lr: [0.00048375563119170404]
train Loss: 0.4505 Top-1 Acc: 82.3254 Top-5 Acc: 98.2281
test Loss: 0.3754 Top-1 Acc: 86.0931 Top-5 Acc: 98.7384
resnet-34 - Epoch 57/100
----------
lr: [0.00046907744043659587]
train Loss: 0.4350 Top-1 Acc: 83.1784 Top-5 Acc: 98.3560
test Loss: 0.3542 Top-1 Acc: 87.3257 Top-5 Acc: 98.9458
resnet-34 - Epoch 58/100
----------
lr: [0.0004544882330724729]
train Loss: 0.4316 Top-1 Acc: 83.2731 Top-5 Acc: 98.3884
test Loss: 0.3513 Top-1 Acc: 87.0725 Top-5 Acc: 98.7342
resnet-34 - Epoch 59/100
----------
lr: [0.0004400039598832889]
train Loss: 0.4264 Top-1 Acc: 83.4635 Top-5 Acc: 98.3404
test Loss: 0.3359 Top-1 Acc: 87.5249 Top-5 Acc: 99.0621
resnet-34 - Epoch 60/100
----------
lr: [0.0004256404567268918]
train Loss: 0.4172 Top-1 Acc: 83.7416 Top-5 Acc: 98.4034
test Loss: 0.3888 Top-1 Acc: 85.3586 Top-5 Acc: 98.8960
resnet-34 - Epoch 61/100
----------
lr: [0.00041141342719735894]
train Loss: 0.4112 Top-1 Acc: 84.0051 Top-5 Acc: 98.5173
test Loss: 0.3729 Top-1 Acc: 86.3836 Top-5 Acc: 98.9292
resnet-34 - Epoch 62/100
----------
lr: [0.00039733842542880027]
train Loss: 0.4053 Top-1 Acc: 84.4020 Top-5 Acc: 98.5255
test Loss: 0.3478 Top-1 Acc: 87.1431 Top-5 Acc: 99.0288
resnet-34 - Epoch 63/100
----------
lr: [0.000383430839058869]
train Loss: 0.4011 Top-1 Acc: 84.5044 Top-5 Acc: 98.5670
test Loss: 0.3626 Top-1 Acc: 86.3131 Top-5 Acc: 98.9293
resnet-34 - Epoch 64/100
----------
lr: [0.0003697058723699185]
train Loss: 0.3912 Top-1 Acc: 84.8582 Top-5 Acc: 98.6800
test Loss: 0.3251 Top-1 Acc: 87.9316 Top-5 Acc: 99.1866
resnet-34 - Epoch 65/100
----------
lr: [0.0003561785296253988]
train Loss: 0.3848 Top-1 Acc: 85.0334 Top-5 Acc: 98.6194
test Loss: 0.3309 Top-1 Acc: 88.0146 Top-5 Acc: 99.1119
resnet-34 - Epoch 66/100
----------
lr: [0.00034286359861869595]
train Loss: 0.3789 Top-1 Acc: 85.3674 Top-5 Acc: 98.6867
test Loss: 0.3324 Top-1 Acc: 87.7822 Top-5 Acc: 99.0371
resnet-34 - Epoch 67/100
----------
lr: [0.0003297756344511347]
train Loss: 0.3747 Top-1 Acc: 85.4836 Top-5 Acc: 98.6882
test Loss: 0.3303 Top-1 Acc: 87.4461 Top-5 Acc: 99.0787
resnet-34 - Epoch 68/100
----------
lr: [0.00031692894355531755]
train Loss: 0.3649 Top-1 Acc: 86.0235 Top-5 Acc: 98.7639
test Loss: 0.3241 Top-1 Acc: 87.9897 Top-5 Acc: 99.1202
resnet-34 - Epoch 69/100
----------
lr: [0.00030433756797932856]
train Loss: 0.3577 Top-1 Acc: 86.3468 Top-5 Acc: 98.8462
test Loss: 0.3290 Top-1 Acc: 87.3298 Top-5 Acc: 99.0455
resnet-34 - Epoch 70/100
----------
lr: [0.0002920152699465371]
train Loss: 0.3605 Top-1 Acc: 86.2147 Top-5 Acc: 98.7765
test Loss: 0.3164 Top-1 Acc: 88.3300 Top-5 Acc: 99.1119
resnet-34 - Epoch 71/100
----------
lr: [0.00027997551670480765]
train Loss: 0.3474 Top-1 Acc: 86.6293 Top-5 Acc: 98.8312
test Loss: 0.3087 Top-1 Acc: 88.8156 Top-5 Acc: 99.1409
resnet-34 - Epoch 72/100
----------
lr: [0.00026823146567776427]
train Loss: 0.3434 Top-1 Acc: 86.8701 Top-5 Acc: 98.9334
test Loss: 0.3113 Top-1 Acc: 88.4296 Top-5 Acc: 99.0953
resnet-34 - Epoch 73/100
----------
lr: [0.00025679594992932274]
train Loss: 0.3361 Top-1 Acc: 87.2374 Top-5 Acc: 98.8810
test Loss: 0.3216 Top-1 Acc: 87.6992 Top-5 Acc: 99.2073
resnet-34 - Epoch 74/100
----------
lr: [0.0002456814639509084]
train Loss: 0.3233 Top-1 Acc: 87.5987 Top-5 Acc: 99.0231
test Loss: 0.3101 Top-1 Acc: 88.5084 Top-5 Acc: 99.1284
resnet-34 - Epoch 75/100
----------
lr: [0.0002349001497784573]
train Loss: 0.3234 Top-1 Acc: 87.6169 Top-5 Acc: 98.9632
test Loss: 0.2959 Top-1 Acc: 89.1559 Top-5 Acc: 99.1036
resnet-34 - Epoch 76/100
----------
lr: [0.0002244637834432804]
train Loss: 0.3196 Top-1 Acc: 87.7080 Top-5 Acc: 99.0595
test Loss: 0.3001 Top-1 Acc: 88.6744 Top-5 Acc: 99.1824
resnet-34 - Epoch 77/100
----------
lr: [0.00021438376175687992]
train Loss: 0.3095 Top-1 Acc: 88.3885 Top-5 Acc: 99.1428
test Loss: 0.2986 Top-1 Acc: 89.0853 Top-5 Acc: 99.1492
resnet-34 - Epoch 78/100
----------
lr: [0.00020467108942438483]
train Loss: 0.3045 Top-1 Acc: 88.4236 Top-5 Acc: 99.0704
test Loss: 0.2974 Top-1 Acc: 88.9110 Top-5 Acc: 99.2447
resnet-34 - Epoch 79/100
----------
lr: [0.00019533636647386889]
train Loss: 0.2963 Top-1 Acc: 88.8637 Top-5 Acc: 99.1228
test Loss: 0.2959 Top-1 Acc: 89.1019 Top-5 Acc: 99.2114
resnet-34 - Epoch 80/100
----------
lr: [0.00018638977597841452]
train Loss: 0.2933 Top-1 Acc: 89.0084 Top-5 Acc: 99.1402
test Loss: 0.2960 Top-1 Acc: 89.2555 Top-5 Acc: 99.1243
resnet-34 - Epoch 81/100
----------
lr: [0.0001778410720329691]
train Loss: 0.2900 Top-1 Acc: 89.1189 Top-5 Acc: 99.1502
test Loss: 0.2967 Top-1 Acc: 89.2347 Top-5 Acc: 99.1948
resnet-34 - Epoch 82/100
----------
lr: [0.0001696995679265583]
train Loss: 0.2878 Top-1 Acc: 89.1446 Top-5 Acc: 99.2100
test Loss: 0.2953 Top-1 Acc: 88.5707 Top-5 Acc: 99.1617
resnet-34 - Epoch 83/100
----------
lr: [0.00016197412441851852]
train Loss: 0.2787 Top-1 Acc: 89.4743 Top-5 Acc: 99.2556
test Loss: 0.2958 Top-1 Acc: 89.3011 Top-5 Acc: 99.0952
resnet-34 - Epoch 84/100
----------
lr: [0.00015467313797922408]
train Loss: 0.2774 Top-1 Acc: 89.4392 Top-5 Acc: 99.2706
test Loss: 0.2971 Top-1 Acc: 89.0770 Top-5 Acc: 99.2695
resnet-34 - Epoch 85/100
----------
lr: [0.00014780452878119756]
train Loss: 0.2684 Top-1 Acc: 89.8316 Top-5 Acc: 99.3179
test Loss: 0.2895 Top-1 Acc: 89.0480 Top-5 Acc: 99.1866
resnet-34 - Epoch 86/100
----------
lr: [0.00014137572810829906]
train Loss: 0.2641 Top-1 Acc: 90.1154 Top-5 Acc: 99.3047
test Loss: 0.2905 Top-1 Acc: 89.0687 Top-5 Acc: 99.2156
resnet-34 - Epoch 87/100
----------
lr: [0.00013539366465842634]
train Loss: 0.2616 Top-1 Acc: 90.2800 Top-5 Acc: 99.2931
test Loss: 0.2836 Top-1 Acc: 89.2804 Top-5 Acc: 99.2613
resnet-34 - Epoch 88/100
----------
lr: [0.00012986474889303232]
train Loss: 0.2590 Top-1 Acc: 90.4379 Top-5 Acc: 99.3122
test Loss: 0.2826 Top-1 Acc: 89.9651 Top-5 Acc: 99.1285
resnet-34 - Epoch 89/100
----------
lr: [0.00012479485402933806]
train Loss: 0.2531 Top-1 Acc: 90.4943 Top-5 Acc: 99.3545
test Loss: 0.2834 Top-1 Acc: 89.4547 Top-5 Acc: 99.1451
resnet-34 - Epoch 90/100
----------
lr: [0.00012018929127011419]
train Loss: 0.2524 Top-1 Acc: 90.5060 Top-5 Acc: 99.3620
test Loss: 0.2813 Top-1 Acc: 89.7452 Top-5 Acc: 99.1948
resnet-34 - Epoch 91/100
----------
lr: [0.0001160527749912063]
train Loss: 0.2426 Top-1 Acc: 91.0551 Top-5 Acc: 99.3645
test Loss: 0.2813 Top-1 Acc: 89.8655 Top-5 Acc: 99.1949
resnet-34 - Epoch 92/100
----------
lr: [0.00011238936992058625]
train Loss: 0.2389 Top-1 Acc: 91.2180 Top-5 Acc: 99.3919
test Loss: 0.2776 Top-1 Acc: 89.8490 Top-5 Acc: 99.1866
resnet-34 - Epoch 93/100
----------
lr: [0.00010920240466794277]
train Loss: 0.2384 Top-1 Acc: 90.9994 Top-5 Acc: 99.4144
test Loss: 0.2843 Top-1 Acc: 89.3094 Top-5 Acc: 99.2198
resnet-34 - Epoch 94/100
----------
lr: [0.00010649431886114302]
train Loss: 0.2336 Top-1 Acc: 91.4181 Top-5 Acc: 99.4442
test Loss: 0.2816 Top-1 Acc: 89.6082 Top-5 Acc: 99.1782
resnet-34 - Epoch 95/100
----------
lr: [0.00010426636975545291]
train Loss: 0.2299 Top-1 Acc: 91.4472 Top-5 Acc: 99.4268
test Loss: 0.2805 Top-1 Acc: 89.6456 Top-5 Acc: 99.2613
resnet-34 - Epoch 96/100
----------
lr: [0.00010251801320462015]
train Loss: 0.2284 Top-1 Acc: 91.4332 Top-5 Acc: 99.4642
test Loss: 0.2838 Top-1 Acc: 89.1808 Top-5 Acc: 99.1451
resnet-34 - Epoch 97/100
----------
lr: [0.00010124543471429218]
train Loss: 0.2262 Top-1 Acc: 91.5743 Top-5 Acc: 99.5073
test Loss: 0.2767 Top-1 Acc: 89.8406 Top-5 Acc: 99.1243
resnet-34 - Epoch 98/100
----------
lr: [0.00010043747387396913]
train Loss: 0.2258 Top-1 Acc: 91.6183 Top-5 Acc: 99.4169
test Loss: 0.2757 Top-1 Acc: 90.0067 Top-5 Acc: 99.2364
resnet-34 - Epoch 99/100
----------
lr: [0.00010006152536841758]
train Loss: 0.2192 Top-1 Acc: 91.7585 Top-5 Acc: 99.5041
test Loss: 0.2792 Top-1 Acc: 89.9029 Top-5 Acc: 99.1866
resnet-34 - Epoch 100/100
----------
lr: [0.0001]
train Loss: 0.2221 Top-1 Acc: 91.6929 Top-5 Acc: 99.4368
test Loss: 0.2783 Top-1 Acc: 89.5751 Top-5 Acc: 99.2862
Training resnet-34 complete in 472m 2s
Best test Top-1 Acc: 90.006668
Best test Top-5 Acc: 99.286171
train resnet-34 done

resnet-18 - Epoch 1/100
----------
lr: [0.0002]
train Loss: 2.4253 Top-1 Acc: 2.1798 Top-5 Acc: 40.4881
test Loss: 2.3985 Top-1 Acc: 1.8302 Top-5 Acc: 41.9572
resnet-18 - Epoch 2/100
----------
lr: [0.0004]
train Loss: 1.5837 Top-1 Acc: 41.1989 Top-5 Acc: 77.3429
test Loss: 1.4199 Top-1 Acc: 47.0161 Top-5 Acc: 83.1590
resnet-18 - Epoch 3/100
----------
lr: [0.0006]
train Loss: 1.3481 Top-1 Acc: 48.9129 Top-5 Acc: 84.7994
test Loss: 1.2226 Top-1 Acc: 55.1668 Top-5 Acc: 89.9651
resnet-18 - Epoch 4/100
----------
lr: [0.0008]
train Loss: 1.2262 Top-1 Acc: 53.0345 Top-5 Acc: 87.5995
test Loss: 1.3925 Top-1 Acc: 44.2812 Top-5 Acc: 87.6701
resnet-18 - Epoch 5/100
----------
lr: [0.001]
train Loss: 1.1549 Top-1 Acc: 55.8116 Top-5 Acc: 89.0615
test Loss: 0.9723 Top-1 Acc: 63.6579 Top-5 Acc: 91.9737
resnet-18 - Epoch 6/100
----------
lr: [0.001]
train Loss: 1.1038 Top-1 Acc: 57.7534 Top-5 Acc: 90.1389
test Loss: 0.9158 Top-1 Acc: 66.5380 Top-5 Acc: 93.3018
resnet-18 - Epoch 7/100
----------
lr: [0.000998278903745945]
train Loss: 1.0335 Top-1 Acc: 60.1638 Top-5 Acc: 91.4482
test Loss: 0.9786 Top-1 Acc: 62.0767 Top-5 Acc: 94.0612
resnet-18 - Epoch 8/100
----------
lr: [0.0009965601596710891]
train Loss: 0.9941 Top-1 Acc: 61.8732 Top-5 Acc: 91.9804
test Loss: 0.8054 Top-1 Acc: 68.9865 Top-5 Acc: 95.1444
resnet-18 - Epoch 9/100
----------
lr: [0.000994353645620711]
train Loss: 0.9631 Top-1 Acc: 62.8690 Top-5 Acc: 92.8055
test Loss: 1.0141 Top-1 Acc: 61.3131 Top-5 Acc: 91.7040
resnet-18 - Epoch 10/100
----------
lr: [0.0009916617739430225]
train Loss: 0.9335 Top-1 Acc: 63.9433 Top-5 Acc: 93.1825
test Loss: 0.8715 Top-1 Acc: 65.6457 Top-5 Acc: 94.8041
resnet-18 - Epoch 11/100
----------
lr: [0.00098848748771634]
train Loss: 0.9051 Top-1 Acc: 65.1736 Top-5 Acc: 93.3911
test Loss: 0.8731 Top-1 Acc: 65.6416 Top-5 Acc: 93.8579
resnet-18 - Epoch 12/100
----------
lr: [0.0009848342575303802]
train Loss: 0.8854 Top-1 Acc: 65.8587 Top-5 Acc: 93.8562
test Loss: 0.7604 Top-1 Acc: 72.3979 Top-5 Acc: 95.9745
resnet-18 - Epoch 13/100
----------
lr: [0.0009807060776907206]
train Loss: 0.8696 Top-1 Acc: 66.5614 Top-5 Acc: 93.9865
test Loss: 0.6940 Top-1 Acc: 74.1783 Top-5 Acc: 96.2483
resnet-18 - Epoch 14/100
----------
lr: [0.000976107461850577]
train Loss: 0.8569 Top-1 Acc: 66.6908 Top-5 Acc: 94.1601
test Loss: 0.6626 Top-1 Acc: 76.8841 Top-5 Acc: 96.9704
resnet-18 - Epoch 15/100
----------
lr: [0.0009710434380746693]
train Loss: 0.8273 Top-1 Acc: 68.3739 Top-5 Acc: 94.5457
test Loss: 0.6785 Top-1 Acc: 73.9044 Top-5 Acc: 96.5056
resnet-18 - Epoch 16/100
----------
lr: [0.0009655195433405745]
train Loss: 0.8172 Top-1 Acc: 68.3616 Top-5 Acc: 94.6272
test Loss: 0.6089 Top-1 Acc: 77.7308 Top-5 Acc: 97.1779
resnet-18 - Epoch 17/100
----------
lr: [0.0009595418174835732]
train Loss: 0.7964 Top-1 Acc: 69.1872 Top-5 Acc: 94.9369
test Loss: 0.6126 Top-1 Acc: 78.0835 Top-5 Acc: 97.3107
resnet-18 - Epoch 18/100
----------
lr: [0.0009531167965916136]
train Loss: 0.7826 Top-1 Acc: 69.8369 Top-5 Acc: 95.0606
test Loss: 0.6179 Top-1 Acc: 78.5359 Top-5 Acc: 97.2900
resnet-18 - Epoch 19/100
----------
lr: [0.0009462515058576077]
train Loss: 0.7721 Top-1 Acc: 70.2762 Top-5 Acc: 95.1977
test Loss: 0.5742 Top-1 Acc: 78.4902 Top-5 Acc: 97.5639
resnet-18 - Epoch 20/100
----------
lr: [0.0009389534518968771]
train Loss: 0.7502 Top-1 Acc: 71.2092 Top-5 Acc: 95.4428
test Loss: 0.6134 Top-1 Acc: 77.1041 Top-5 Acc: 96.7256
resnet-18 - Epoch 21/100
----------
lr: [0.000931230614538144]
train Loss: 0.7420 Top-1 Acc: 71.1217 Top-5 Acc: 95.7053
test Loss: 0.5954 Top-1 Acc: 77.7473 Top-5 Acc: 96.9040
resnet-18 - Epoch 22/100
----------
lr: [0.0009230914380970417]
train Loss: 0.7212 Top-1 Acc: 72.3548 Top-5 Acc: 95.8174
test Loss: 0.5717 Top-1 Acc: 78.2868 Top-5 Acc: 97.5639
resnet-18 - Epoch 23/100
----------
lr: [0.0009145448221416838]
train Loss: 0.7105 Top-1 Acc: 72.8679 Top-5 Acc: 95.9529
test Loss: 0.5806 Top-1 Acc: 79.0256 Top-5 Acc: 97.3564
resnet-18 - Epoch 24/100
----------
lr: [0.000905600111760385]
train Loss: 0.7046 Top-1 Acc: 72.9613 Top-5 Acc: 95.9612
test Loss: 0.5850 Top-1 Acc: 78.4944 Top-5 Acc: 97.5639
resnet-18 - Epoch 25/100
----------
lr: [0.0008962670873421745]
train Loss: 0.6838 Top-1 Acc: 73.6746 Top-5 Acc: 96.1680
test Loss: 0.5605 Top-1 Acc: 78.9882 Top-5 Acc: 97.6262
resnet-18 - Epoch 26/100
----------
lr: [0.0008865559538812679]
train Loss: 0.6752 Top-1 Acc: 73.9380 Top-5 Acc: 96.4272
test Loss: 0.5394 Top-1 Acc: 78.4570 Top-5 Acc: 98.1657
resnet-18 - Epoch 27/100
----------
lr: [0.000876477329817195]
train Loss: 0.6649 Top-1 Acc: 74.4655 Top-5 Acc: 96.2752
test Loss: 0.5235 Top-1 Acc: 79.0753 Top-5 Acc: 98.1656
resnet-18 - Epoch 28/100
----------
lr: [0.0008660422354227753]
train Loss: 0.6557 Top-1 Acc: 75.0380 Top-5 Acc: 96.5560
test Loss: 0.4866 Top-1 Acc: 83.2462 Top-5 Acc: 98.4354
resnet-18 - Epoch 29/100
----------
lr: [0.0008552620807526363]
train Loss: 0.6492 Top-1 Acc: 74.9339 Top-5 Acc: 96.7354
test Loss: 0.5112 Top-1 Acc: 80.9554 Top-5 Acc: 98.0577
resnet-18 - Epoch 30/100
----------
lr: [0.0008441486531654493]
train Loss: 0.6371 Top-1 Acc: 75.4121 Top-5 Acc: 96.8134
test Loss: 0.5046 Top-1 Acc: 80.4241 Top-5 Acc: 98.1076
resnet-18 - Epoch 31/100
----------
lr: [0.0008327141044335113]
train Loss: 0.6294 Top-1 Acc: 75.7754 Top-5 Acc: 96.7761
test Loss: 0.5296 Top-1 Acc: 79.7850 Top-5 Acc: 97.7257
resnet-18 - Epoch 32/100
----------
lr: [0.000820970937453775]
train Loss: 0.6153 Top-1 Acc: 76.4475 Top-5 Acc: 96.9306
test Loss: 0.6313 Top-1 Acc: 76.8758 Top-5 Acc: 96.2691
resnet-18 - Epoch 33/100
----------
lr: [0.0008089319925748344]
train Loss: 0.6109 Top-1 Acc: 76.4471 Top-5 Acc: 96.9356
test Loss: 0.4790 Top-1 Acc: 82.1049 Top-5 Acc: 98.2113
resnet-18 - Epoch 34/100
----------
lr: [0.0007966104335548217]
train Loss: 0.6007 Top-1 Acc: 76.7879 Top-5 Acc: 97.1691
test Loss: 0.4685 Top-1 Acc: 83.2835 Top-5 Acc: 98.3815
resnet-18 - Epoch 35/100
----------
lr: [0.0007840197331655513]
train Loss: 0.5985 Top-1 Acc: 77.0586 Top-5 Acc: 97.0801
test Loss: 0.4743 Top-1 Acc: 83.0428 Top-5 Acc: 98.2860
resnet-18 - Epoch 36/100
----------
lr: [0.0007711736584586432]
train Loss: 0.5919 Top-1 Acc: 77.2574 Top-5 Acc: 97.2015
test Loss: 0.4632 Top-1 Acc: 82.7191 Top-5 Acc: 98.4022
resnet-18 - Epoch 37/100
----------
lr: [0.0007580862557097296]
train Loss: 0.5802 Top-1 Acc: 77.5806 Top-5 Acc: 97.2986
test Loss: 0.4551 Top-1 Acc: 84.1052 Top-5 Acc: 98.3482
resnet-18 - Epoch 38/100
----------
lr: [0.0007447718350571855]
train Loss: 0.5768 Top-1 Acc: 77.9345 Top-5 Acc: 97.2189
test Loss: 0.5337 Top-1 Acc: 80.1710 Top-5 Acc: 97.7963
resnet-18 - Epoch 39/100
----------
lr: [0.0007312449548521687]
train Loss: 0.5625 Top-1 Acc: 78.5118 Top-5 Acc: 97.4515
test Loss: 0.4461 Top-1 Acc: 83.7691 Top-5 Acc: 98.6637
resnet-18 - Epoch 40/100
----------
lr: [0.0007175204057370693]
train Loss: 0.5506 Top-1 Acc: 78.9470 Top-5 Acc: 97.4257
test Loss: 0.4609 Top-1 Acc: 83.1839 Top-5 Acc: 98.2984
resnet-18 - Epoch 41/100
----------
lr: [0.0007036131944697442]
train Loss: 0.5536 Top-1 Acc: 78.8747 Top-5 Acc: 97.4472
test Loss: 0.4529 Top-1 Acc: 84.2339 Top-5 Acc: 98.5641
resnet-18 - Epoch 42/100
----------
lr: [0.0006895385275112213]
train Loss: 0.5407 Top-1 Acc: 79.2243 Top-5 Acc: 97.6391
test Loss: 0.4337 Top-1 Acc: 83.8604 Top-5 Acc: 98.5682
resnet-18 - Epoch 43/100
----------
lr: [0.0006753117943947742]
train Loss: 0.5396 Top-1 Acc: 79.2566 Top-5 Acc: 97.5152
test Loss: 0.4089 Top-1 Acc: 85.5246 Top-5 Acc: 98.5807
resnet-18 - Epoch 44/100
----------
lr: [0.0006609485508945376]
train Loss: 0.5281 Top-1 Acc: 79.7617 Top-5 Acc: 97.6964
test Loss: 0.4528 Top-1 Acc: 83.6861 Top-5 Acc: 98.3068
resnet-18 - Epoch 45/100
----------
lr: [0.0006464645020120294]
train Loss: 0.5245 Top-1 Acc: 79.9294 Top-5 Acc: 97.6566
test Loss: 0.4234 Top-1 Acc: 83.7152 Top-5 Acc: 98.7633
resnet-18 - Epoch 46/100
----------
lr: [0.0006318754847991442]
train Loss: 0.5169 Top-1 Acc: 80.4073 Top-5 Acc: 97.7205
test Loss: 0.4101 Top-1 Acc: 85.4996 Top-5 Acc: 98.8753
resnet-18 - Epoch 47/100
----------
lr: [0.0006171974510363578]
train Loss: 0.5125 Top-1 Acc: 80.3968 Top-5 Acc: 97.8394
test Loss: 0.3814 Top-1 Acc: 86.1139 Top-5 Acc: 98.7632
resnet-18 - Epoch 48/100
----------
lr: [0.0006024464497850381]
train Loss: 0.5043 Top-1 Acc: 80.8823 Top-5 Acc: 97.9730
test Loss: 0.4034 Top-1 Acc: 85.9437 Top-5 Acc: 98.8504
resnet-18 - Epoch 49/100
----------
lr: [0.000587638609832873]
train Loss: 0.4931 Top-1 Acc: 81.1791 Top-5 Acc: 97.9324
test Loss: 0.4092 Top-1 Acc: 85.4208 Top-5 Acc: 98.8130
resnet-18 - Epoch 50/100
----------
lr: [0.0005727901220515562]
train Loss: 0.4924 Top-1 Acc: 81.4231 Top-5 Acc: 97.9797
test Loss: 0.3821 Top-1 Acc: 86.5704 Top-5 Acc: 98.9292
resnet-18 - Epoch 51/100
----------
lr: [0.0005579172216859389]
train Loss: 0.4831 Top-1 Acc: 81.4355 Top-5 Acc: 98.0262
test Loss: 0.3873 Top-1 Acc: 86.4002 Top-5 Acc: 98.7550
resnet-18 - Epoch 52/100
----------
lr: [0.0005430361705939213]
train Loss: 0.4797 Top-1 Acc: 81.6633 Top-5 Acc: 98.0637
test Loss: 0.3976 Top-1 Acc: 85.1345 Top-5 Acc: 98.7217
resnet-18 - Epoch 53/100
----------
lr: [0.0005281632394564116]
train Loss: 0.4687 Top-1 Acc: 82.2088 Top-5 Acc: 98.1542
test Loss: 0.3897 Top-1 Acc: 86.0143 Top-5 Acc: 98.7798
resnet-18 - Epoch 54/100
----------
lr: [0.0005133146899766715]
train Loss: 0.4665 Top-1 Acc: 82.0712 Top-5 Acc: 98.2290
test Loss: 0.3787 Top-1 Acc: 86.1844 Top-5 Acc: 98.9376
resnet-18 - Epoch 55/100
----------
lr: [0.0004985067570883801]
train Loss: 0.4551 Top-1 Acc: 82.7090 Top-5 Acc: 98.3261
test Loss: 0.3915 Top-1 Acc: 84.9353 Top-5 Acc: 98.8629
resnet-18 - Epoch 56/100
----------
lr: [0.00048375563119170404]
train Loss: 0.4564 Top-1 Acc: 82.6367 Top-5 Acc: 98.1325
test Loss: 0.3978 Top-1 Acc: 84.7941 Top-5 Acc: 98.6304
resnet-18 - Epoch 57/100
----------
lr: [0.00046907744043659587]
train Loss: 0.4424 Top-1 Acc: 83.1892 Top-5 Acc: 98.3801
test Loss: 0.3696 Top-1 Acc: 86.5828 Top-5 Acc: 98.8795
resnet-18 - Epoch 58/100
----------
lr: [0.0004544882330724729]
train Loss: 0.4349 Top-1 Acc: 83.5964 Top-5 Acc: 98.4525
test Loss: 0.3720 Top-1 Acc: 86.4957 Top-5 Acc: 98.7052
resnet-18 - Epoch 59/100
----------
lr: [0.0004400039598832889]
train Loss: 0.4379 Top-1 Acc: 83.5103 Top-5 Acc: 98.4525
test Loss: 0.3678 Top-1 Acc: 86.4168 Top-5 Acc: 99.0164
resnet-18 - Epoch 60/100
----------
lr: [0.0004256404567268918]
train Loss: 0.4259 Top-1 Acc: 83.9945 Top-5 Acc: 98.4774
test Loss: 0.3462 Top-1 Acc: 87.4917 Top-5 Acc: 99.0703
resnet-18 - Epoch 61/100
----------
lr: [0.00041141342719735894]
train Loss: 0.4188 Top-1 Acc: 84.3132 Top-5 Acc: 98.5048
test Loss: 0.3616 Top-1 Acc: 87.0642 Top-5 Acc: 98.8712
resnet-18 - Epoch 62/100
----------
lr: [0.00039733842542880027]
train Loss: 0.4050 Top-1 Acc: 84.7783 Top-5 Acc: 98.5521
test Loss: 0.3437 Top-1 Acc: 87.4004 Top-5 Acc: 98.9542
resnet-18 - Epoch 63/100
----------
lr: [0.000383430839058869]
train Loss: 0.4109 Top-1 Acc: 84.7129 Top-5 Acc: 98.5147
test Loss: 0.3529 Top-1 Acc: 87.2261 Top-5 Acc: 98.8587
resnet-18 - Epoch 64/100
----------
lr: [0.0003697058723699185]
train Loss: 0.3982 Top-1 Acc: 85.1489 Top-5 Acc: 98.6842
test Loss: 0.3417 Top-1 Acc: 87.3216 Top-5 Acc: 99.0870
resnet-18 - Epoch 65/100
----------
lr: [0.0003561785296253988]
train Loss: 0.3906 Top-1 Acc: 85.4015 Top-5 Acc: 98.7789
test Loss: 0.3460 Top-1 Acc: 87.1016 Top-5 Acc: 98.9956
resnet-18 - Epoch 66/100
----------
lr: [0.00034286359861869595]
train Loss: 0.3898 Top-1 Acc: 85.4671 Top-5 Acc: 98.6692
test Loss: 0.3327 Top-1 Acc: 87.6577 Top-5 Acc: 99.1783
resnet-18 - Epoch 67/100
----------
lr: [0.0003297756344511347]
train Loss: 0.3769 Top-1 Acc: 86.1800 Top-5 Acc: 98.7938
test Loss: 0.3265 Top-1 Acc: 88.1599 Top-5 Acc: 99.1409
resnet-18 - Epoch 68/100
----------
lr: [0.00031692894355531755]
train Loss: 0.3719 Top-1 Acc: 86.0121 Top-5 Acc: 98.8686
test Loss: 0.3257 Top-1 Acc: 88.6454 Top-5 Acc: 99.1451
resnet-18 - Epoch 69/100
----------
lr: [0.00030433756797932856]
train Loss: 0.3713 Top-1 Acc: 86.1947 Top-5 Acc: 98.8412
test Loss: 0.3455 Top-1 Acc: 87.4419 Top-5 Acc: 99.0372
resnet-18 - Epoch 70/100
----------
lr: [0.0002920152699465371]
train Loss: 0.3574 Top-1 Acc: 86.8003 Top-5 Acc: 98.8453
test Loss: 0.3308 Top-1 Acc: 87.8237 Top-5 Acc: 98.9832
resnet-18 - Epoch 71/100
----------
lr: [0.00027997551670480765]
train Loss: 0.3517 Top-1 Acc: 86.9349 Top-5 Acc: 98.8950
test Loss: 0.3282 Top-1 Acc: 88.0810 Top-5 Acc: 99.0870
resnet-18 - Epoch 72/100
----------
lr: [0.00026823146567776427]
train Loss: 0.3472 Top-1 Acc: 87.3221 Top-5 Acc: 98.9566
test Loss: 0.3241 Top-1 Acc: 88.7657 Top-5 Acc: 99.1285
resnet-18 - Epoch 73/100
----------
lr: [0.00025679594992932274]
train Loss: 0.3392 Top-1 Acc: 87.4814 Top-5 Acc: 99.0089
test Loss: 0.3277 Top-1 Acc: 88.3259 Top-5 Acc: 99.1492
resnet-18 - Epoch 74/100
----------
lr: [0.0002456814639509084]
train Loss: 0.3382 Top-1 Acc: 87.5993 Top-5 Acc: 99.0630
test Loss: 0.3207 Top-1 Acc: 88.3300 Top-5 Acc: 99.1949
resnet-18 - Epoch 75/100
----------
lr: [0.0002349001497784573]
train Loss: 0.3343 Top-1 Acc: 87.8428 Top-5 Acc: 99.0854
test Loss: 0.3258 Top-1 Acc: 87.9357 Top-5 Acc: 99.0870
resnet-18 - Epoch 76/100
----------
lr: [0.0002244637834432804]
train Loss: 0.3255 Top-1 Acc: 88.1869 Top-5 Acc: 99.1003
test Loss: 0.3242 Top-1 Acc: 87.8860 Top-5 Acc: 99.0953
resnet-18 - Epoch 77/100
----------
lr: [0.00021438376175687992]
train Loss: 0.3160 Top-1 Acc: 88.4807 Top-5 Acc: 99.1634
test Loss: 0.3124 Top-1 Acc: 88.8363 Top-5 Acc: 99.1243
resnet-18 - Epoch 78/100
----------
lr: [0.00020467108942438483]
train Loss: 0.3160 Top-1 Acc: 88.5282 Top-5 Acc: 99.1552
test Loss: 0.3179 Top-1 Acc: 88.5043 Top-5 Acc: 99.0953
resnet-18 - Epoch 79/100
----------
lr: [0.00019533636647386889]
train Loss: 0.3070 Top-1 Acc: 89.0058 Top-5 Acc: 99.1933
test Loss: 0.3045 Top-1 Acc: 89.1144 Top-5 Acc: 99.0662
resnet-18 - Epoch 80/100
----------
lr: [0.00018638977597841452]
train Loss: 0.3039 Top-1 Acc: 89.0075 Top-5 Acc: 99.2599
test Loss: 0.3057 Top-1 Acc: 88.6579 Top-5 Acc: 99.1243
resnet-18 - Epoch 81/100
----------
lr: [0.0001778410720329691]
train Loss: 0.2965 Top-1 Acc: 89.4710 Top-5 Acc: 99.2225
test Loss: 0.3018 Top-1 Acc: 88.9235 Top-5 Acc: 99.0787
resnet-18 - Epoch 82/100
----------
lr: [0.0001696995679265583]
train Loss: 0.2930 Top-1 Acc: 89.3564 Top-5 Acc: 99.2324
test Loss: 0.3109 Top-1 Acc: 88.6288 Top-5 Acc: 99.1243
resnet-18 - Epoch 83/100
----------
lr: [0.00016197412441851852]
train Loss: 0.2872 Top-1 Acc: 89.7168 Top-5 Acc: 99.2756
test Loss: 0.2942 Top-1 Acc: 89.3219 Top-5 Acc: 99.2363
resnet-18 - Epoch 84/100
----------
lr: [0.00015467313797922408]
train Loss: 0.2843 Top-1 Acc: 89.8590 Top-5 Acc: 99.2549
test Loss: 0.2964 Top-1 Acc: 89.5543 Top-5 Acc: 99.1160
resnet-18 - Epoch 85/100
----------
lr: [0.00014780452878119756]
train Loss: 0.2801 Top-1 Acc: 90.1082 Top-5 Acc: 99.2873
test Loss: 0.3080 Top-1 Acc: 88.7409 Top-5 Acc: 99.0787
resnet-18 - Epoch 86/100
----------
lr: [0.00014137572810829906]
train Loss: 0.2735 Top-1 Acc: 90.3515 Top-5 Acc: 99.3919
test Loss: 0.2977 Top-1 Acc: 89.4007 Top-5 Acc: 99.1285
resnet-18 - Epoch 87/100
----------
lr: [0.00013539366465842634]
train Loss: 0.2708 Top-1 Acc: 90.3830 Top-5 Acc: 99.3022
test Loss: 0.2981 Top-1 Acc: 89.3136 Top-5 Acc: 99.1409
resnet-18 - Epoch 88/100
----------
lr: [0.00012986474889303232]
train Loss: 0.2651 Top-1 Acc: 90.6124 Top-5 Acc: 99.4318
test Loss: 0.3051 Top-1 Acc: 89.0563 Top-5 Acc: 99.2115
resnet-18 - Epoch 89/100
----------
lr: [0.00012479485402933806]
train Loss: 0.2658 Top-1 Acc: 90.6805 Top-5 Acc: 99.4044
test Loss: 0.2928 Top-1 Acc: 89.3053 Top-5 Acc: 99.1201
resnet-18 - Epoch 90/100
----------
lr: [0.00012018929127011419]
train Loss: 0.2567 Top-1 Acc: 91.0682 Top-5 Acc: 99.4143
test Loss: 0.2908 Top-1 Acc: 89.9818 Top-5 Acc: 99.1451
resnet-18 - Epoch 91/100
----------
lr: [0.0001160527749912063]
train Loss: 0.2549 Top-1 Acc: 91.1157 Top-5 Acc: 99.4343
test Loss: 0.2923 Top-1 Acc: 89.8946 Top-5 Acc: 99.1533
resnet-18 - Epoch 92/100
----------
lr: [0.00011238936992058625]
train Loss: 0.2531 Top-1 Acc: 91.3841 Top-5 Acc: 99.4201
test Loss: 0.2908 Top-1 Acc: 89.6041 Top-5 Acc: 99.1119
resnet-18 - Epoch 93/100
----------
lr: [0.00010920240466794277]
train Loss: 0.2487 Top-1 Acc: 91.3408 Top-5 Acc: 99.4376
test Loss: 0.2925 Top-1 Acc: 89.6871 Top-5 Acc: 99.1865
resnet-18 - Epoch 94/100
----------
lr: [0.00010649431886114302]
train Loss: 0.2460 Top-1 Acc: 91.5693 Top-5 Acc: 99.4393
test Loss: 0.2946 Top-1 Acc: 89.3965 Top-5 Acc: 99.0952
resnet-18 - Epoch 95/100
----------
lr: [0.00010426636975545291]
train Loss: 0.2445 Top-1 Acc: 91.5526 Top-5 Acc: 99.4268
test Loss: 0.3005 Top-1 Acc: 89.2264 Top-5 Acc: 99.2862
resnet-18 - Epoch 96/100
----------
lr: [0.00010251801320462015]
train Loss: 0.2395 Top-1 Acc: 91.7828 Top-5 Acc: 99.4700
test Loss: 0.2949 Top-1 Acc: 89.4464 Top-5 Acc: 99.1450
resnet-18 - Epoch 97/100
----------
lr: [0.00010124543471429218]
train Loss: 0.2388 Top-1 Acc: 91.9090 Top-5 Acc: 99.5265
test Loss: 0.2946 Top-1 Acc: 89.4630 Top-5 Acc: 99.0828
resnet-18 - Epoch 98/100
----------
lr: [0.00010043747387396913]
train Loss: 0.2339 Top-1 Acc: 92.0271 Top-5 Acc: 99.5689
test Loss: 0.2869 Top-1 Acc: 89.8157 Top-5 Acc: 99.1118
resnet-18 - Epoch 99/100
----------
lr: [0.00010006152536841758]
train Loss: 0.2337 Top-1 Acc: 92.0602 Top-5 Acc: 99.4891
test Loss: 0.2920 Top-1 Acc: 89.4505 Top-5 Acc: 99.1699
resnet-18 - Epoch 100/100
----------
lr: [0.0001]
train Loss: 0.2335 Top-1 Acc: 91.8459 Top-5 Acc: 99.4799
test Loss: 0.2884 Top-1 Acc: 89.8614 Top-5 Acc: 99.1367
Training resnet-18 complete in 304m 5s
Best test Top-1 Acc: 89.981750
Best test Top-5 Acc: 99.286156
train resnet-18 done