Genetic Algorithm - The Building Block Hypothesis

The Building Block Hypothesis

Genetic algorithms are simple to implement, but their behavior is difficult to understand. In particular it is difficult to understand why these algorithms frequently succeed at generating solutions of high fitness when applied to practical problems. The building block hypothesis (BBH) consists of:

  1. A description of a heuristic that performs adaptation by identifying and recombining "building blocks", i.e. low order, low defining-length schemata with above average fitness.
  2. A hypothesis that a genetic algorithm performs adaptation by implicitly and efficiently implementing this heuristic.

Goldberg describes the heuristic as follows:

"Short, low order, and highly fit schemata are sampled, recombined, and resampled to form strings of potentially higher fitness. In a way, by working with these particular schemata, we have reduced the complexity of our problem; instead of building high-performance strings by trying every conceivable combination, we construct better and better strings from the best partial solutions of past samplings.
"Because highly fit schemata of low defining length and low order play such an important role in the action of genetic algorithms, we have already given them a special name: building blocks. Just as a child creates magnificent fortresses through the arrangement of simple blocks of wood, so does a genetic algorithm seek near optimal performance through the juxtaposition of short, low-order, high-performance schemata, or building blocks."

Read more about this topic:  Genetic Algorithm

Famous quotes containing the words building, block and/or hypothesis:

    I love art, and I love history, but it is living art and living history that I love.... It is in the interest of living art and living history that I oppose so-called restoration. What history can there be in a building bedaubed with ornament, which cannot at the best be anything but a hopeless and lifeless imitation of the hope and vigour of the earlier world?
    William Morris (1834–1896)

    It is, in both cases, that a spiritual life has been imparted to nature; that the solid seeming block of matter has been pervaded and dissolved by a thought; that this feeble human being has penetrated the vast masses of nature with an informing soul, and recognised itself in their harmony, that is, seized their law. In physics, when this is attained, the memory disburthens itself of its cumbrous catalogues of particulars, and carries centuries of observation in a single formula.
    Ralph Waldo Emerson (1803–1882)

    It is an hypothesis that the sun will rise tomorrow: and this means that we do not know whether it will rise.
    Ludwig Wittgenstein (1889–1951)