Sentence boundary disambiguation (SBD), also known as sentence breaking, is the problem in natural language processing of deciding where sentences begin and end. Often natural language processing tools require their input to be divided into sentences for a number of reasons. However sentence boundary identification is challenging because punctuation marks are often ambiguous. For example, a period may denote an abbreviation, decimal point, an ellipsis, or an email address - not the end of a sentence. About 47% of the periods in the Wall Street Journal corpus denote abbreviations. As well, question marks and exclamation marks may appear in embedded quotations, emoticons, computer code, and slang.
Languages like Japanese and Chinese have unambiguous sentence-ending markers.
Read more about Sentence Boundary Disambiguation: Strategies, Software, See Also
Famous quotes containing the words sentence and/or boundary:
“There is then creative reading as well as creative writing. When the mind is braced by labor and invention, the page of whatever book we read becomes luminous with manifold allusion. Every sentence is doubly significant, and the sense of our author is as broad as the world.”
—Ralph Waldo Emerson (1803–1882)
“In the west, Apollo and Dionysus strive for victory. Apollo makes the boundary lines that are civilization but that lead to convention, constraint, oppression. Dionysus is energy unbound, mad, callous, destructive, wasteful. Apollo is law, history, tradition, the dignity and safety of custom and form. Dionysus is the new, exhilarating but rude, sweeping all away to begin again. Apollo is a tyrant, Dionysus is a vandal.”
—Camille Paglia (b. 1947)