Consistent Hashing - History

History

Originally devised by Karger et al. at MIT for use in distributed caching, the idea has now been expanded to other areas also. An academic paper from 1997 introduced the term "consistent hashing" as a way of distributing requests among a changing population of Web servers. Each slot is then represented by a node in a distributed system. The addition (joins) and removal (leaves/failures) of nodes only requires items to be re-shuffled when the number of slots/nodes change.

Consistent hashing has also been used to reduce the impact of partial system failures in large Web applications as to allow for robust caches without incurring the system wide fallout of a failure.

The consistent hashing concept also applies to the design of distributed hash tables (DHTs). DHTs use consistent hashing to partition a keyspace among a distributed set of nodes, and additionally provide an overlay network that connects nodes such that the node responsible for any key can be efficiently located.

Read more about this topic:  Consistent Hashing

Famous quotes containing the word history:

    “The myth of independence from the mother is abandoned in mid- life as women learn new routes around the mother—both the mother without and the mother within. A mid-life daughter may reengage with a mother or put new controls on care and set limits to love. But whatever she does, her child’s history is never finished.”
    —Terri Apter (20th century)

    “When the history of guilt is written, parents who refuse their children money will be right up there in the Top Ten.”
    —Erma Brombeck (20th century)

    “There has never been in history another such culture as the Western civilization M a culture which has practiced the belief that the physical and social environment of man is subject to rational manipulation and that history is subject to the will and action of man; whereas central to the traditional cultures of the rivals of Western civilization, those of Africa and Asia, is a belief that it is environment that dominates man.”
    —Ishmael Reed (b. 1938)