The sigmoid activation function has a floor and ceiling, somewhat like real neurons. Output units designed to make binary decisions also typically have a sigmoid activation function.