7762aa93ff14078

http://nhiro.org.s3.amazonaws.com/6/2/621246f79b62acddf5cab7470964d102.jpg https://gyazo.com/621246f79b62acddf5cab7470964d102

(OCR text)

79

ニューラルネット

ReLUo H Softmaxo

LB 0.446: Input -> 0.13 Dropout -> 2500 -> 0.77 Dropout

-> 1300 -> 0.35 Dropout -> 40 -> 0.1 Dropout -> Output

(AdaGrad, 600 epochs, batch-1024, linear decreasing

learning rate starting at 0.04, ending at 0.005)

LB 0.441: Input -> 0.15 Drop -> 2000 -> 0.7 Drop -> 1200

-> 0.4 Drop -> 40 -> Output (AdaGrad, 400 epochs, batch

512, learning rate from 0.04 to 0.001)

LB 0.463: Input -> 0.15 Drop -> 180 -> 0.1 GaussianNoise

-> 0.1 Drop -> 180 -> 0.05 Drop -> 180 -> 0.05 Drop ->

140 -0.05 Drop -> 140 -> 0.05 Drop -> 140 -> 0.1 Drop -

> 140 -> 0.1 GaussianNoise -> 160 -> Output (AdaGrad,

100 epochs, batch=512, rate = 0.03 to 0.005)