Info-Soft (2024-03-01)
自動微分
Automatic Differentiation
Autograd
計算グラフ
---
Python
JAX (Google)
Tensorflow (Google)
PyTorch
Julia 言語 language
Transformer
y.backward()
x.grad
x.data
x.data.sub_(mu * x.grad.data)
x.grad.data.zero_()
https://gyazo.com/4c49e4d48dc88162d61a50565329be84