Without a nonlinear function in the pipeline, a basic deep neural network would be one giant linear system ... determine the derivative on either side of zero. “In the early days of neural networks, ...