This symbol, \(\delta\), is the error of a neuron in a feedforward neural network. It quantifies how much the neuron's potential contributed to the network's training loss. The error is computed in the backward pass in backpropagation, so it plays a role in computing the gradient when minimizing the loss function. The error is computed differently, depending on whether the neuron is a hidden neuron or an output neuron.
Was this page helpful?