7762aa93ff14089

http://nhiro.org.s3.amazonaws.com/5/e/5ea58456dabfa65a966505cf6537d79e.jpg https://gyazo.com/5ea58456dabfa65a966505cf6537d79e

(OCR text)

ランダムサーチ

90

Grid Layout

Random Layout

Important parameter

Important parameter

Figure 1: Grid and random search of nine trials for optimizing a function f(x,y) g(x)+h(y)

g(x) with low effective dimensionality. Above each square g(x) is shown in green, and

left of each square hy) is shown in yellow. With grid search, nine trials only test g(x)

in three distinct places. With random search, all nine trials explore distinct values of

g. This failure of grid search is the rule rather than the exception in high dimensional

hyper-parameter optimization.

から引用

寄与の小さいパラメータがある場合、

Grid Layoutではその軸方向のサンプルが

無駄になってしまう

Unimportant parameter

Unimportant parameter