The Hierarchical Hidden Markov Model
In the hierarchical hidden Markov model (HHMM) each state is considered to be a self-contained probabilistic model. More precisely each state of the HHMM is itself an HHMM. This implies that the states of the HHMM emit sequences of observation symbols rather than single observation symbols as is the case for the standard HMM states.
When a state in an HHMM is activated, it will activate its own probabilistic model, i.e. it will activate one of the states of the underlying HHMM, which in turn may activate its underlying HHMM and so on. The process is repeated until a special state, called a production state, is activated. Only the production states emit observation symbols in the usual HMM sense. When the production state has emitted a symbol, control returns to the state that activated the production state. The states that do not directly emit observations symbols are called internal states. The activation of a state in an HHMM under an internal state is called a vertical transition. After a vertical transition is completed a horizontal transition occurs to a state within the same level. When a horizontal transition leads to a terminating state control is returned to the state in the HHMM, higher up in the hierarchy, that produced the last vertical transition.
Remember that a vertical transition can result in more vertical transitions before reaching a sequence of production states and finally returning to the top level. Thus the production states visited gives rise to a sequence of observation symbols that is "produced" by the state at the top level.
The methods for estimating the HHMM parameters and model structure are more complex than for the HMM and the interested reader is referred to (Fine et al., 1998).
It should be pointed out that the HMM and HHMM belong to the same class of classifiers. That is, they can be used to solve the same set of problems. In fact, the HHMM can be transformed into a standard HMM. However, the HHMM utilizes its structure to solve a subset of the problems more efficiently.
Read more about this topic: Hierarchical Hidden Markov Model
Famous quotes containing the words hierarchical, hidden and/or model:
“Authority is the spiritual dimension of power because it depends upon faith in a system of meaning that decrees the necessity of the hierarchical order and so provides for the unity of imperative control.”
—Shoshana Zuboff (b. 1951)
“Everything I do is done within sight of the Führer, so that my faults or mistakes are never hidden from him. I do my very utmost to live and act in such a manner that the Führer should remain satisfied with me; I am hard-working; but whether I shall always be able to cope with the tasks entrusted to me in the future as well, is an open question.”
—Martin Bormann (1900–1945)
“She represents the unavowed aspiration of the male human being, his potential infidelity—and infidelity of a very special kind, which would lead him to the opposite of his wife, to the “woman of wax” whom he could model at will, make and unmake in any way he wished, even unto death.”
—Marguerite Duras (b. 1914)