Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate of, rate, information, loss, sensitive, dependence, initial and/or conditions:
“At this very moment,... the most frightful horrors are taking place in every corner of the world. People are being crushed, slashed, disembowelled, mangled; their dead bodies rot and their eyes decay with the rest. Screams of pain and fear go pulsing through the air at the rate of eleven hundred feet per second. After travelling for three seconds they are perfectly inaudible. These are distressing facts; but do we enjoy life any the less because of them? Most certainly we do not.”
—Aldous Huxley (1894–1963)
““Terence, this is stupid stuff:
You eat your victuals fast enough;
There can’t be much amiss, ‘tis clear,
To see the rate you drink your beer.”
—A.E. (Alfred Edward)
“If you have any information or evidence regarding the O.J. Simpson case, press 2 now. If you are an expert in fields relating to the O.J. Simpson case and would like to offer your services, press 3 now. If you would like the address where you can send a letter of support to O.J. Simpson, press 1 now. If you are seeking legal representation from the law offices of Robert L. Shapiro, press 4 now.”
—Advertisement. Aired August 8, 1994 by Tom Snyder on TV station CNBC. Chicago Sun Times, p. 11 (July 24, 1994)
“Begin with loss and see
how the world contradicts you,
how the horizon implies that beyond it
the water is not empty
but full of ships
all docking at another island.”
—Lynn Emanuel (b. 1949)
“The hand I burned and whose skin is shriveled like that of a mummy’s is less sensitive than the other to cold or heat. My soul is the same; it passed through fire.”
—Gustave Flaubert (1821–1880)
“... dependence upon material possessions inevitably results in the destruction of human character.”
—Agnes E. Meyer (1887–1970)
“For those parents from lower-class and minority communities ... [who] have had minimal experience in negotiating dominant, external institutions or have had negative and hostile contact with social service agencies, their initial approaches to the school are often overwhelming and difficult. Not only does the school feel like an alien environment with incomprehensible norms and structures, but the families often do not feel entitled to make demands or force disagreements.”
—Sara Lawrence Lightfoot (20th century)
“My dear young friend ... civilization has absolutely no need of nobility or heroism. These things are symptoms of political inefficiency. In a properly organized society like ours, nobody has any opportunities for being noble or heroic. Conditions have got to be thoroughly unstable before the occasion can arise.”
—Aldous Huxley (1894–1963)