2021.9.25

modify learning rate! mnist noisy 20% 84.9%-86.08%
add weight decay 86.07%
weight-decay + modify lr = 83.27%?

2021.9.26

lr 0.01 + bs 128 + weight-decay = 86.66%
lr 0.01 + bs 128 + weight-decay + aug(rotate10)= 97.75% ??? wtf?