ReLU関数
rectified linear unit; ReLU function
$ \max\{0,x\}
https://gyazo.com/866ff5744ae900ae2372aa506a4d18e9
活性化関数に利用される
code:ReLU_plot.jl
using Plots
# ReLU関数の描画
x = range(-10, stop=10, length=100)
y = max.(0, x)
plt = plot(x, y;
line=2,
xlims=(-10,10),
ylims=(-1,10),
xlabel="",
ylabel="",
framestyle=:origin,
label="\$y=\\max(0,x)\$"
)