Study of Information Processing in Evolutionary Systems
The notion that information processing is essential to life and to evolution predates the entry of the term informatics into the English language (1966). Various investigators argued in the 1940s that certain principles of information processing apply both in living and engineered systems, and much of their thinking is encapsulated in Norbert Wiener's Cybernetics, or Control and Communication in the Animal and the Machine (1948). Wiener regarded evolution as phylogenetic learning, or accrual of information in the genome. While cybernetics and biocybernetics address information, they place an emphasis on principles of feedback and control that informatics does not. Relatively recent work has focused on evolution as optimization of fitness functions, and has addressed the role of information in optimization. Beginning with a 1995 technical report and continuing with a 1997 article, "No Free Lunch Theorems for Optimization" Wolpert and Macready established that evolutionary algorithms have average performance no better than that of random search. They argued that superior performance could be achieved only if algorithms incorporate prior knowledge of problems, and provided an information-geometric analysis of how algorithms and problems are matched (and mismatched). English argued in 1996 that there was no free lunch due to an underlying "conservation of information," and pursued the notion further in 1999. In that work, conservation was characterized in terms of Shannon information and mutual information. In 2000, English turned to Kolmogorov complexity as a measure of information in instances of fitness functions and optimization algorithms. He observed that almost all problems exhibit a high degree of Kolmogorov randomness, and thus are easy for almost all optimization algorithms. In 2004, English gave a new perspective on conservation by way of characterizing approximate satisfaction of a necessary and sufficient condition for "no free lunch." Wolpert and Macready proved the existence of coevolutionary "free lunches" in 2005. This may be interpreted as the discovery of a problem class for which some coevolutionary algorithms are generally better informed than others of how to solve problems.
Read more about this topic: Evolutionary Informatics
Famous quotes containing the words study of, study, information, evolutionary and/or systems:
“If the study of all these sciences, which we have enumerated, should ever bring us to their mutual association and relationship, and teach us the nature of the ties which bind them together, I believe that the diligent treatment of them will forward the objects which we have in view, and that the labor, which otherwise would be fruitless, will be well bestowed.”
—Plato (c. 427–347 B.C.)
“It’s worth living abroad to study up on genteel and delicate manners. The maid smiles continuously; she smiles like a duchess on a stage, while at the same time it is clear from her face that she is exhausted from overwork.”
—Anton Pavlovich Chekhov (1860–1904)
“We hear a great deal of lamentation these days about writers having all taken themselves to the colleges and universities where they live decorously instead of going out and getting firsthand information about life. The fact is that anybody who has survived his childhood has enough information about life to last him the rest of his days.”
—Flannery O’Connor (1925–1964)
“The point is, ladies and gentlemen, that greed, for lack of a better word, is good. Greed is right. Greed works. Greed clarifies, cuts through, and captures the essence of the evolutionary spirit.”
—Stanley Weiser, U.S. screenwriter, and Oliver Stone. Gordon Gekko (Michael Douglas)
“The skylines lit up at dead of night, the air- conditioning systems cooling empty hotels in the desert and artificial light in the middle of the day all have something both demented and admirable about them. The mindless luxury of a rich civilization, and yet of a civilization perhaps as scared to see the lights go out as was the hunter in his primitive night.”
—Jean Baudrillard (b. 1929)