Generative Topographic Map - Comparison With Kohonen's Self-organizing Maps

Comparison With Kohonen's Self-organizing Maps

While nodes in the self-organizing map (SOM) can wander around at will, GTM nodes are constrained by the allowable transformations and their probabilities. If the deformations are well-behaved the topology of the latent space is preserved.

The SOM was created as a biological model of neurons and is a heuristic algorithm. By contrast, the GTM has nothing to do with neuroscience or cognition and is a probabilistically principled model. Thus, it has a number of advantages over SOM, namely:

  • it explicitly formulates a density model over the data.
  • it uses a cost function that quantifies how well the map is trained.
  • it uses a sound optimization procedure (EM algorithm).

GTM was introduced by Bishop, Svensen and Williams in their Technical Report in 1997 (Technical Report NCRG/96/015, Aston University, UK) published later in Neural Computation. It was also described in the PhD thesis of Markus Svensen (Aston, 1998).

Read more about this topic:  Generative Topographic Map

Famous quotes containing the words comparison with, comparison and/or maps:

    “Intolerance respecting other people’s religion is toleration itself in comparison with intolerance respecting other people’s art.”
    —Wallace Stevens (1879–1955)

    “In everyone’s youthful dreams, philosophy is still vaguely but inseparably, and with singular truth, associated with the East, nor do after years discover its local habitation in the Western world. In comparison with the philosophers of the East, we may say that modern Europe has yet given birth to none.”
    —Henry David Thoreau (1817–1862)

    “The faces of most American women over thirty are relief maps of petulant and bewildered unhappiness.”
    —F. Scott Fitzgerald (1896–1940)