Sliding window based part-of-speech tagging is used to part-of-speech tag a text.
A high percentage of words in a natural language are words which out of context can be assigned more than one part of speech. The percentage of these ambiguous words is typically around 30%, although it depends greatly on the language. Solving this problem is very important in many areas of natural language processing. For example in machine translation changing the part-of-speech of a word can dramatically change its translation.
Sliding window based part-of-speech taggers are programs which assign a single part-of-speech to a given lexical form of a word, by looking at a fixed sized "window" of words around the word to be disambiguated.
The two main advantages of this approach are:
- It is possible to automatically train the tagger, getting rid of the need of manually tagging a corpus.
- The tagger can be implemented as a finite state automaton (Mealy machine)
Read more about Sliding Window Based Part-of-speech Tagging: Formal Definition, Further Reading
Famous quotes containing the words sliding, window, based and/or tagging:
“With these I would be.
And with water: the waves coming forward, without cessation,
The waves, altered by sand-bars, beds of kelp, miscellaneous
driftwood,
Topped by cross-winds, tugged at by sinuous undercurrents
The tide rustling in, sliding between the ridges of stone,
The tongues of water, creeping in, quietly.”
—Theodore Roethke (1908–1963)
“Loach: What happened to your nose, Gittes? Somebody slam a bedroom window on it?
J.J. Gittes: Nope, your wife got excited. She crossed her legs a little too quick.”
—Robert Towne (b. 1936)
“I want relations which are not purely personal, based on purely personal qualities; but relations based upon some unanimous accord in truth or belief, and a harmony of purpose, rather than of personality. I am weary of personality.... Let us be easy and impersonal, not forever fingering over our own souls, and the souls of our acquaintances, but trying to create a new life, a new common life, a new complete tree of life from the roots that are within us.”
—D.H. (David Herbert)
“The 5307th has collapsed. From a medical viewpoint, they’re finished as a fighting unit.... I have never seen human beings in such condition. They’re drained, physically and psychologically drained. I’m not tagging them for specific ailments. I’m simply marking every man in the outfit A.O.E.—accumulation of everything.”
—Samuel Fuller, U.S. screenwriter, and Milton Sperling. Samuel Fuller. Doc (Andrew Duggan)