Sliding Window Based Part-of-speech Tagging

Sliding window based part-of-speech tagging is used to part-of-speech tag a text.

A high percentage of words in a natural language are words which out of context can be assigned more than one part of speech. The percentage of these ambiguous words is typically around 30%, although it depends greatly on the language. Solving this problem is very important in many areas of natural language processing. For example in machine translation changing the part-of-speech of a word can dramatically change its translation.

Sliding window based part-of-speech taggers are programs which assign a single part-of-speech to a given lexical form of a word, by looking at a fixed sized "window" of words around the word to be disambiguated.

The two main advantages of this approach are:

  • It is possible to automatically train the tagger, getting rid of the need of manually tagging a corpus.
  • The tagger can be implemented as a finite state automaton (Mealy machine)

Read more about Sliding Window Based Part-of-speech Tagging:  Formal Definition, Further Reading

Famous quotes containing the words sliding, window, based and/or tagging:

    Here at the fountain’s sliding foot,
    Or at some fruit-tree’s mossy root,
    Casting the body’s vest aside,
    My soul into the boughs does glide:
    There, like a bird, it sits and sings,
    Then whets and combs its silver wings,
    And, till prepared for longer flights,
    Waves in its plumes the various light.
    Andrew Marvell (1621–1678)

    It is a pleasure to stand upon the shore, and to see ships tossed upon the sea: a pleasure to stand in the window of a castle, and to see a battle and the adventures thereof below: but no pleasure is comparable to standing upon the vantage ground of truth ... and to see the errors, and wanderings, and mists, and tempests, in the vale below.
    Francis Bacon (1561–1626)

    A two-parent family based on love and commitment can be a wonderful thing, but historically speaking the “two-parent paradigm” has left an extraordinary amount of room for economic inequality, violence and male dominance.
    Stephanie Coontz (20th century)

    The 5307th has collapsed. From a medical viewpoint, they’re finished as a fighting unit.... I have never seen human beings in such condition. They’re drained, physically and psychologically drained. I’m not tagging them for specific ailments. I’m simply marking every man in the outfit A.O.E.—accumulation of everything.
    Samuel Fuller, U.S. screenwriter, and Milton Sperling. Samuel Fuller. Doc (Andrew Duggan)