Rate of Information Loss and Sensitive Dependence On Initial Conditions
One hallmark of chaotic dynamics is the loss of information as simulation occurs. If we start with information on the first s bits of the initial iterate, then after m simulated iterations (m<s) we only have (s-m) bits of information remaining. Thus we lose information at the exponential rate of one bit per iteration. After s iterations, our simulation has reached the fixed point zero, regardless of the true iterate values; thus we have suffered a complete loss of information. This illustrates sensitive dependence on initial conditions—the mapping from the truncated initial condition has deviated exponentially from the mapping from the true initial condition. And since our simulation has reached a fixed point, for almost all initial conditions it will not describe the dynamics in the qualitatively correct way as chaotic.
Equivalent to the concept of information loss is the concept of information gain. In practice some real-world process may generate a sequence of values {} over time, but we may only be able to observe these values in truncated form. Suppose for example that = .1001101, but we only observe the truncated value .1001 . Our prediction for is .001 . If we wait until the real-world process has generated the true value .001101, we will be able to observe the truncated value .0011, which is more accurate than our predicted value .001 . So we have received an information gain of one bit.
Read more about this topic: Dyadic Transformation
Famous quotes containing the words rate, information, loss, sensitive, dependence, initial and/or conditions:
“At the rate science proceeds, rockets and missiles will one day seem like buffalo—slow, endangered grazers in the black pasture of outer space.”
—Bernard Cooper (b. 1936)
“I have all my life been on my guard against the information conveyed by the sense of hearing—it being one of my earliest observations, the universal inclination of humankind is to be led by the ears, and I am sometimes apt to imagine that they are given to men as they are to pitchers, purposely that they may be carried about by them.”
—Mary Wortley, Lady Montagu (1689–1762)
“The universal social pressure upon women to be all alike, and do all the same things, and to be content with identical restrictions, has resulted not only in terrible suffering in the lives of exceptional women, but also in the loss of unmeasured feminine values in special gifts. The Drama of the Woman of Genius has too often been a tragedy of misshapen and perverted power.”
—Anna Garlin Spencer (1851–1931)
“Violence upon the roads: violence of horses;
Some few have handsome riders, are garlanded
On delicate sensitive ear or tossing mane,
But wearied running round and round in their courses
All break and vanish, and evil gathers head:
Herodias’ daughters have returned again.”
—William Butler Yeats (1865–1939)
“As, therefore, we can have no dependence upon morality without religion;Mso, on the other hand, there is nothing better to be expected from religion without morality;Mnevertheless, ‘tis no prodigy to see a man whose real moral character stands very low, who yet entertains the highest notion of himself, in the light of a religious man.”
—Laurence Sterne (1713–1768)
“Capital is a result of labor, and is used by labor to assist it in further production. Labor is the active and initial force, and labor is therefore the employer of capital.”
—Henry George (1839–1897)
“Under conditions of tyranny it is far easier to act than to think.”
—Hannah Arendt (1906–1975)