dead ReLU

Also written: dead neuron, dead neurons, dead unit, dead units

A ReLU neuron whose input is always negative, so it always outputs 0, gets no gradient and stops learning.