Study of Information Processing in Evolutionary Systems
The notion that information processing is essential to life and to evolution predates the entry of the term informatics into the English language (1966). Various investigators argued in the 1940s that certain principles of information processing apply both in living and engineered systems, and much of their thinking is encapsulated in Norbert Wiener's Cybernetics, or Control and Communication in the Animal and the Machine (1948). Wiener regarded evolution as phylogenetic learning, or accrual of information in the genome. While cybernetics and biocybernetics address information, they place an emphasis on principles of feedback and control that informatics does not. Relatively recent work has focused on evolution as optimization of fitness functions, and has addressed the role of information in optimization. Beginning with a 1995 technical report and continuing with a 1997 article, "No Free Lunch Theorems for Optimization" Wolpert and Macready established that evolutionary algorithms have average performance no better than that of random search. They argued that superior performance could be achieved only if algorithms incorporate prior knowledge of problems, and provided an information-geometric analysis of how algorithms and problems are matched (and mismatched). English argued in 1996 that there was no free lunch due to an underlying "conservation of information," and pursued the notion further in 1999. In that work, conservation was characterized in terms of Shannon information and mutual information. In 2000, English turned to Kolmogorov complexity as a measure of information in instances of fitness functions and optimization algorithms. He observed that almost all problems exhibit a high degree of Kolmogorov randomness, and thus are easy for almost all optimization algorithms. In 2004, English gave a new perspective on conservation by way of characterizing approximate satisfaction of a necessary and sufficient condition for "no free lunch." Wolpert and Macready proved the existence of coevolutionary "free lunches" in 2005. This may be interpreted as the discovery of a problem class for which some coevolutionary algorithms are generally better informed than others of how to solve problems.
Read more about this topic: Evolutionary Informatics
Famous quotes containing the words study of, study, information, evolutionary and/or systems:
“I have not made a study of it, but believe that it is a minor point in the history of the war.”
—Jean-Marie Le Pen (b. 1928)
“I have always thought that one man of tolerable abilities may work great changes, and accomplish great affairs among mankind, if he first forms a good plan, and, cutting off all amusements or other employments that would divert his attention, make the execution of that same plan his sole study and business.”
—Benjamin Franklin (1706–1790)
“But while ignorance can make you insensitive, familiarity can also numb. Entering the second half-century of an information age, our cumulative knowledge has changed the level of what appalls, what stuns, what shocks.”
—Anna Quindlen (b. 1952)
“The point is, ladies and gentlemen, that greed, for lack of a better word, is good. Greed is right. Greed works. Greed clarifies, cuts through, and captures the essence of the evolutionary spirit.”
—Stanley Weiser, U.S. screenwriter, and Oliver Stone. Gordon Gekko (Michael Douglas)
“The geometry of landscape and situation seems to create its own systems of time, the sense of a dynamic element which is cinematising the events of the canvas, translating a posture or ceremony into dynamic terms. The greatest movie of the 20th century is the Mona Lisa, just as the greatest novel is Gray’s Anatomy.”
—J.G. (James Graham)