Coherent Extrapolated Volition
Yudkowsky advances the Coherent Extrapolated Volition (CEV) model. According to him our coherent extrapolated volition is our choices and the actions we would collectively take if "we knew more, thought faster, were more the people we wished we were, and had grown up closer together."
Rather than a Friendly AI being designed directly by human programmers, it is to be designed by a seed AI programmed to first study human nature and then produce the AI which humanity would want, given sufficient time and insight to arrive at a satisfactory answer. The appeal to an objective though contingent human nature (perhaps expressed, for mathematical purposes, in the form of a utility function or other decision-theoretic formalism), as providing the ultimate criterion of "Friendliness", is an answer to the meta-ethical problem of defining an objective morality; extrapolated volition is intended to be what humanity objectively would want, all things considered, but it can only be defined relative to the psychological and cognitive qualities of present-day, unextrapolated humanity.
Making the CEV concept precise enough to serve as a formal program specification is part of the research agenda of the Singularity Institute for Artificial Intelligence.
Other researchers believe, however, that the collective will of humanity will not converge to a single coherent set of goals.
Read more about this topic: Friendly Artificial Intelligence
Famous quotes containing the words coherent and/or volition:
“We have good reason to believe that memories of early childhood do not persist in consciousness because of the absence or fragmentary character of language covering this period. Words serve as fixatives for mental images. . . . Even at the end of the second year of life when word tags exist for a number of objects in the child’s life, these words are discrete and do not yet bind together the parts of an experience or organize them in a way that can produce a coherent memory.”
—Selma H. Fraiberg (20th century)
“the ocean, under the pulsation of lighthouses and noise of bell
buoys,
advances as usual, looking as if it were not that ocean in which
dropped things are bound to sink—
in which if they turn and twist, it is neither with volition nor
consciousness.”
—Marianne Moore (1887–1972)