Weight
w
8.0
0
loss score (lower is better)
↓
downhill direction
Take one optimizer step
Nudges
w
a little downhill, like backprop does.