For Estimating Continuous Variables
The k-NN algorithm can also be adapted for use in estimating continuous variables. One such implementation uses an inverse distance weighted average of the k-nearest multivariate neighbors. This algorithm functions as follows:
- Compute Euclidean or Mahalanobis distance from target plot to those that were sampled.
- Order samples taking for account calculated distances.
- Choose heuristically optimal k nearest neighbor based on RMSE done by cross validation technique.
- Calculate an inverse distance weighted average with the k-nearest multivariate neighbors.
Using a weighted k-NN also significantly improves the results: the class (or value, in regression problems) of each of the k nearest points is multiplied by a weight proportional to the inverse of the distance between that point and the point for which the class is to be predicted.
Read more about this topic: k-nearest Neighbor Algorithm
Famous quotes containing the words estimating, continuous and/or variables:
“I am sure that in estimating every man’s value either in private or public life, a pure integrity is the quality we take first into calculation, and that learning and talents are only the second.”
—Thomas Jefferson (1743–1826)
“I can never get people to understand that poetry is the expression of excited passion, and that there is no such thing as a life of passion any more than a continuous earthquake, or an eternal fever. Besides, who would ever shave themselves in such a state?”
—George Gordon Noel Byron (1788–1824)
“Science is feasible when the variables are few and can be enumerated; when their combinations are distinct and clear. We are tending toward the condition of science and aspiring to do it. The artist works out his own formulas; the interest of science lies in the art of making science.”
—Paul Valéry (1871–1945)