[Click on image for larger view.] Figure 1. The activation function demo. The demo program illustrates three common neural network activation functions: logistic sigmoid, hyperbolic tangent and ...