In artificial intelligence, the delta rule is a gradient descent learning rule for updating the weights of the artificial neurons in a single-layer perceptron. It is a special case of the more general backpropagation algorithm. For a neuron with activation function, the delta rule for 's th weight is given by
- ,
where
| is a small constant called learning rate | |
| is the neuron's activation function | |
| is the target output | |
| is the weighted sum of the neuron's inputs | |
| is the actual output | |
| is the th input. |
It holds that and .
The delta rule is commonly stated in simplified form for a perceptron with a linear activation function as
Read more about Delta Rule: Derivation of The Delta Rule
Famous quotes containing the word rule:
“Totalitarianism is never content to rule by external means, namely, through the state and a machinery of violence; thanks to its peculiar ideology and the role assigned to it in this apparatus of coercion, totalitarianism has discovered a means of dominating and terrorizing human beings from within.”
—Hannah Arendt (1906–1975)