Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“Writing a book I have found to be like building a house. A man forms a plan, and collects materials. He thinks he has enough to raise a large and stately edifice; but after he has arranged, compacted and polished, his work turns out to be a very small performance. The authour however like the builder, knows how much labour his work has cost him; and therefore estimates it at a higher rate than other people think it deserves,”
—James Boswell (1740–1795)
“Knowledge is of two kinds. We know a subject ourselves, or we know where we can find information upon it.”
—Samuel Johnson (1709–1784)
“A gain is no joy, nor a loss any grief.”
—Chinese proverb.
“Sport inevitably creates deadness of feeling. No one could take pleasure in it who was sensitive to suffering; and therefore its pursuit by women is much more to be regretted than its pursuit by men, because women pursue much more violently and recklessly what they pursue at all.”
—Ouida [Marie Louise De La Ramée] (1839–1908)
“The more the specific feelings of being under obligation range themselves under a supreme principle of human dependence the clearer and more fertile will be the realization of the concept, indispensable to all true culture, of service; from the service of God down to the simple social relationship as between employer and employee.”
—Johan Huizinga (1872–1945)
“No punishment has ever possessed enough power of deterrence to prevent the commission of crimes. On the contrary, whatever the punishment, once a specific crime has appeared for the first time, its reappearance is more likely than its initial emergence could ever have been.”
—Hannah Arendt (1906–1975)
“There must be a world revolution which puts an end to all materialistic conditions hindering woman from performing her natural role in life and driving her to carry out man’s duties in order to be equal in rights.”
—Muammar Qaddafi (b. 1938)