Entropy (statistical Thermodynamics) - Lack of Knowledge and The Second Law of Thermodynamics

Lack of Knowledge and The Second Law of Thermodynamics

We can view Ω as a measure of our lack of knowledge about a system. As an illustration of this idea, consider a set of 100 coins, each of which is either heads up or tails up. The macrostates are specified by the total number of heads and tails, whereas the microstates are specified by the facings of each individual coin. For the macrostates of 100 heads or 100 tails, there is exactly one possible configuration, so our knowledge of the system is complete. At the opposite extreme, the macrostate which gives us the least knowledge about the system consists of 50 heads and 50 tails in any order, for which there are 100,891,344,545,564,193,334,812,497,256 (100 choose 50) ≈ 1029 possible microstates.

Even when a system is entirely isolated from external influences, its microstate is constantly changing. For instance, the particles in a gas are constantly moving, and thus occupy a different position at each moment of time; their momenta are also constantly changing as they collide with each other or with the container walls. Suppose we prepare the system in an artificially highly-ordered equilibrium state. For instance, imagine dividing a container with a partition and placing a gas on one side of the partition, with a vacuum on the other side. If we remove the partition and watch the subsequent behavior of the gas, we will find that its microstate evolves according to some chaotic and unpredictable pattern, and that on average these microstates will correspond to a more disordered macrostate than before. It is possible, but extremely unlikely, for the gas molecules to bounce off one another in such a way that they remain in one half of the container. It is overwhelmingly probable for the gas to spread out to fill the container evenly, which is the new equilibrium macrostate of the system.

This is an example illustrating the Second Law of Thermodynamics:

the total entropy of any isolated thermodynamic system tends to increase over time, approaching a maximum value.

Since its discovery, this idea has been the focus of a great deal of thought, some of it confused. A chief point of confusion is the fact that the Second Law applies only to isolated systems. For example, the Earth is not an isolated system because it is constantly receiving energy in the form of sunlight. In contrast, the universe may be considered an isolated system, so that its total disorder is constantly increasing.

Read more about this topic:  Entropy (statistical Thermodynamics)

Famous quotes containing the words lack of, lack, knowledge and/or law:

    The lack of closeness among friends is a fault that cannot be reprimanded without becoming incurable.
    Friedrich Nietzsche (1844–1900)

    Today I begin to understand what love must be, if it exists.... When we are parted, we each feel the lack of the other half of ourselves. We are incomplete like a book in two volumes of which the first has been lost. That is what I imagine love to be: incompleteness in absence.
    Lying is like alcoholism. You are always recovering.
    Steven Soderbergh (b. 1963)

    The knowledge of God is very far from the love of him.
    Blaise Pascal (1623–1662)

    The basis of good manners is self-reliance. Necessity is the law of all who are not self-possessed.
    Ralph Waldo Emerson (1803–1882)