Two researchers show that for neural networks to be able to remember better, they need far more parameters than previously thought.