For Estimating Continuous Variables
The k-NN algorithm can also be adapted for use in estimating continuous variables. One such implementation uses an inverse distance weighted average of the k-nearest multivariate neighbors. This algorithm functions as follows:
- Compute Euclidean or Mahalanobis distance from target plot to those that were sampled.
- Order samples taking for account calculated distances.
- Choose heuristically optimal k nearest neighbor based on RMSE done by cross validation technique.
- Calculate an inverse distance weighted average with the k-nearest multivariate neighbors.
Using a weighted k-NN also significantly improves the results: the class (or value, in regression problems) of each of the k nearest points is multiplied by a weight proportional to the inverse of the distance between that point and the point for which the class is to be predicted.
Read more about this topic: k-nearest Neighbor Algorithm
Famous quotes containing the words estimating, continuous and/or variables:
“I am sure that in estimating every man’s value either in private or public life, a pure integrity is the quality we take first into calculation, and that learning and talents are only the second.”
—Thomas Jefferson (1743–1826)
“Perhaps when distant people on other planets pick up some wave-length of ours all they hear is a continuous scream.”
—Iris Murdoch (b. 1919)
“Science is feasible when the variables are few and can be enumerated; when their combinations are distinct and clear. We are tending toward the condition of science and aspiring to do it. The artist works out his own formulas; the interest of science lies in the art of making science.”
—Paul Valéry (1871–1945)