Neural networks are therefore a specialized kind of directed graph. Many neural networks distinguish between three layers of nodes: input, hidden, and output.