Discussion
The idea behind RLS filters is to minimize a cost function by appropriately selecting the filter coefficients, updating the filter as new data arrives. The error signal and desired signal are defined in the negative feedback diagram below:
The error implicitly depends on the filter coefficients through the estimate :
The weighted least squares error function —the cost function we desire to minimize—being a function of e(n) is therefore also dependent on the filter coefficients:
where is the "forgetting factor" which gives exponentially less weight to older error samples.
The cost function is minimized by taking the partial derivatives for all entries of the coefficient vector and setting the results to zero
Next, replace with the definition of the error signal
Rearranging the equation yields
This form can be expressed in terms of matrices
where is the weighted sample correlation matrix for, and is the equivalent estimate for the cross-correlation between and . Based on this expression we find the coefficients which minimize the cost function as
This is the main result of the discussion.
Read more about this topic: Recursive Least Squares Filter
Famous quotes containing the word discussion:
“This is certainly not the place for a discourse about what festivals are for. Discussions on this theme were plentiful during that phase of preparation and on the whole were fruitless. My experience is that discussion is fruitless. What sets forth and demonstrates is the sight of events in action, is living through these events and understanding them.”
—Doris Lessing (b. 1919)
“If the abstract rights of man will bear discussion and explanation, those of women, by a parity of reasoning, will not shrink from the same test: though a different opinion prevails in this country.”
—Mary Wollstonecraft (1759–1797)
“My companion and I, having a minute’s discussion on some point of ancient history, were amused by the attitude which the Indian, who could not tell what we were talking about, assumed. He constituted himself umpire, and, judging by our air and gesture, he very seriously remarked from time to time, “you beat,” or “he beat.””
—Henry David Thoreau (1817–1862)