Activation function
Heaviside step
Sigmoid
Tanh
Linear
ReLU
Leaky ReLU
input value
0.0
Show the slope curve f′(x)
f(x) =
0.50
slope f′(x) =
0.25
gradient flows
the activation's output for this input