Copyright 2000 Thomas R. Shultz
9
Activation Function
Useful hidden units have non-linear activation functions, such as the sigmoid function shown here. In this equation,
e
is the exponential and
x
is the net input to unit
i.