Fisher Information Metric - Change in Entropy

Change in Entropy

The action of a curve on a Riemannian manifold is given by

A=\frac{1}{2}\int_a^b \frac{\partial\theta^j}{\partial t} g_{jk}(\theta)\frac{\partial\theta^k}{\partial t} dt

The path parameter here is time t; this action can be understood to give the change in entropy of a system as it is moved from time a to time b. Specifically, one has

as the change in entropy. This observation has resulted in practical applications in chemical and processing industry: in order to minimize the change in entropy of a system, one should follow the minimum geodesic path between the desired endpoints of the process. The geodesic minimizes the entropy, due to the Cauchy–Schwarz inequality, which states that the action is bounded below by the length of the curve, squared.

Read more about this topic:  Fisher Information Metric

Famous quotes containing the words change in, change and/or entropy:

    “That those tribes [the Sac and Fox Indians] cannot exist surrounded by our settlements and in continual contact with our citizens is certain. They have neither the intelligence, the industry, the moral habits, nor the desire of improvement which are essential to any favorable change in their condition.”
    —Andrew Jackson (1767–1845)

    “The more specific idea of evolution now reached is—a change from an indefinite, incoherent homogeneity to a definite, coherent heterogeneity, accompanying the dissipation of motion and integration of matter.”
    —Herbert Spencer (1820–1903)

    “Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.”
    —Václav Havel (b. 1936)