Idea
The basic idea behind LMS filter is to approach the optimum filter weights, by updating the filter weights in a manner to converge to the optimum filter weight. The algorithm starts by assuming a small weights (zero in most cases), and at each step, by finding the gradient of the mean square error, the weights are updated. That is, if the MSE-gradient is positive, it implies, the error would keep increasing positively, if the same weight is used for further iterations, which means we need to reduce the weights. In the same way, if the gradient is negative, we need to increase the weights. So, the basic weight update equation is :
,
where represents the mean-square error. The negative sign indicates that, we need to change the weights in a direction opposite to that of the gradient slope.
The mean-square error, as a function of filter weights is a quadratic function which means it has only one extrema, that minimises the mean-square error, which is the optimal weight. The LMS thus, approaches towards this optimal weights by ascending/descending down the mean-square-error vs filter weight curve.
Read more about this topic: Least Mean Squares Filter
Famous quotes containing the word idea:
“One theme links together these new proposals for family policy—the idea that the family is exceedingly durable. Changes in structure and function and individual roles are not to be confused with the collapse of the family. Families remain more important in the lives of children than other institutions. Family ties are stronger and more vital than many of us imagine in the perennial atmosphere of crisis surrounding the subject.”
—Joseph Featherstone (20th century)
“... if there’s a house, then there is a wall ... between them and the outside world. The ideal is to stay inside and to never have to go out, and the whole idea of staying home is really important. I think men do get out, but it is not glamorized the way it is here in America, where the big story is to ride out and go someplace and to travel.”
—Gish Jen (b. 1956)
“The idea that leisure is of value in itself is only conditionally true.... The average man simply spends his leisure as a dog spends it. His recreations are all puerile, and the time supposed to benefit him really only stupefies him.”
—H.L. (Henry Lewis)