Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate of, rate, information, loss, sensitive, dependence, initial and/or conditions:
“At this very moment,... the most frightful horrors are taking place in every corner of the world. People are being crushed, slashed, disembowelled, mangled; their dead bodies rot and their eyes decay with the rest. Screams of pain and fear go pulsing through the air at the rate of eleven hundred feet per second. After travelling for three seconds they are perfectly inaudible. These are distressing facts; but do we enjoy life any the less because of them? Most certainly we do not.”
—Aldous Huxley (1894–1963)
“I don’t know but a book in a man’s brain is better off than a book bound in calf—at any rate it is safer from criticism. And taking a book off the brain, is akin to the ticklish & dangerous business of taking an old painting off a panel—you have to scrape off the whole brain in order to get at it with due safety—& even then, the painting may not be worth the trouble.”
—Herman Melville (1819–1891)
“English literature is a kind of training in social ethics.... English trains you to handle a body of information in a way that is conducive to action.”
—Marilyn Butler (b. 1937)
“Somebody who should have been born
is gone.
Yes, woman, such logic will lead
to loss without death. Or say what you meant,
you coward . . . this baby that I bleed.”
—Anne Sexton (1928–1974)
“Every poem of value must have a residue [of language].... It cannot be exhausted because our lives are not long enough to do so. Indeed, in the greatest poetry, the residue may seem to increase as our experience increases—that is, as we become more sensitive to the particular ignitions in its language. We return to a poem not because of its symbolic [or sociological] value, but because of the waste, or subversion, or difficulty, or consolation of its provision.”
—William Logan, U.S. educator. “Condition of the Individual Talent,” The Sewanee Review, p. 93, Winter 1994.
“The more the specific feelings of being under obligation range themselves under a supreme principle of human dependence the clearer and more fertile will be the realization of the concept, indispensable to all true culture, of service; from the service of God down to the simple social relationship as between employer and employee.”
—Johan Huizinga (1872–1945)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“Men can intoxicate themselves with ideas as effectually as with alcohol or with bang and produce, be dint of serious thinking, mental conditions hardly distinguishable from monomania.”
—Thomas Henry Huxley (1825–95)