Structural Information Theory - The Simplicity Principle

The Simplicity Principle

Although visual stimuli are fundamentally multi-interpretable, the human visual system usually has a clear preference for only one interpretation. To explain this preference, SIT introduced a formal coding model starting from the assumption that the perceptually preferred interpretation of a stimulus is the one with the simplest code. A simplest code is a code with minimum information load, that is, a code that enables a reconstruction of the stimulus using a minimum number of descriptive parameters. Such a code is obtained by capturing a maximum amount of visual regularity and yields a hierarchical organization of the stimulus in terms of wholes and parts.

The assumption that the visual system prefers simplest interpretations is called the simplicity principle. Historically, the simplicity principle is an information-theoretical translation of the Gestalt law of Prägnanz, which was based on the natural tendency of physical systems to settle into stable minimum-energy states. Furthermore, just as the later-proposed minimum description length principle in algorithmic information theory (AIT), a.k.a. the theory of Kolmogorov complexity, it can be seen as a formalization of Occam's Razor in which the best hypothesis for a given set of data is the one that leads to the largest compression of the data.

Read more about this topic:  Structural Information Theory

Famous quotes containing the words simplicity and/or principle:

    Both Socrates and Jesus were outstanding teachers; both of them urged and practiced great simplicity of life; both were regarded as traitors to the religion of their community; neither of them wrote anything; both of them were executed; and both have become the subject of traditions that are difficult or impossible to harmonize.
    Jaroslav Pelikan (b. 1932)

    Experimental work provides the strongest evidence for scientific realism. This is not because we test hypotheses about entities. It is because entities that in principle cannot be ‘observed’ are manipulated to produce a new phenomena
    [sic] and to investigate other aspects of nature.
    Ian Hacking (b. 1936)