The curse of dimensionality refers to various phenomena that arise when analyzing and organizing data in high-dimensional spaces (often with hundreds or thousands of dimensions) that do not occur in low-dimensional settings such as the physical space commonly modeled with just three dimensions.
There are multiple phenomena referred to by this name in domains such as numerical analysis, sampling, combinatorics, machine learning, data mining and databases. The common theme of these problems is that when the dimensionality increases, the volume of the space increases so fast that the available data becomes sparse. This sparsity is problematic for any method that requires statistical significance. In order to obtain a statistically sound and reliable result, the amount of data needed to support the result often grows exponentially with the dimensionality. Also organizing and searching data often relies on detecting areas where objects form groups with similar properties; in high dimensional data however all objects appear to be sparse and dissimilar in many ways which prevents common data organization strategies from being efficient.
The term curse of dimensionality was coined by Richard E. Bellman when considering problems in dynamic optimization.
Read more about Curse Of Dimensionality: The "curse of Dimensionality" As Open Problem
Famous quotes containing the words curse of and/or curse:
“There is nothing worse than an idle hour, with no occupation offering. People who have many such hours are simply animals waiting docilely for death. We all come to that state soon or late. It is the curse of senility.”
—H.L. (Henry Lewis)
“A noble person confers no such gift as his whole confidence: none so exalts the giver and the receiver; it produces the truest gratitude. Perhaps it is only essential to friendship that some vital trust should have been reposed by the one in the other. I feel addressed and probed even to the remotest parts of my being when one nobly shows, even in trivial things, an implicit faith in me.... A threat or a curse may be forgotten, but this mild trust translates me.”
—Henry David Thoreau (1817–1862)