Noisy text has been defined as any text obtained through an extraction process (i.e. transcription, OCR) from media other than original electronic texts. The noise can be seen as all the differences between the surface form of a coded representation of the text and the intended, correct, or original text. It can be due to e.g. typographic errors or colloquialisms always present in natural language and usually lowers the data quality in a way that makes the text less accessible to automated processing by computers such as natural language processing.
Language usage over computer mediated discourses, like chats, emails and SMS texts, significantly differs from the standard form of the language. An urge towards shorter message length facilitating faster typing and the need for semantic clarity, shape the structure of this text used in such discourses.
Various business analysts estimate that unstructured data constitutes around 80% of the whole enterprise data. A great proportion of this data comprises chat transcripts, emails and other informal and semi-formal internal and external communications. Usually such text is meant for human consumption, but - given the amount of data - manual processing and evaluation of those resources is not practically feasible anymore. This raises the need for robust text mining methods as described in noisy text analytics.
Read more about Noisy Text: Techniques For Noise Reduction, See Also
Famous quotes containing the words noisy and/or text:
“Whoever feels predestined to see and not to believe will find all believers too noisy and pushy: he guards against them.”
—Friedrich Nietzsche (1844–1900)
“The power of a text is different when it is read from when it is copied out.... Only the copied text thus commands the soul of him who is occupied with it, whereas the mere reader never discovers the new aspects of his inner self that are opened by the text, that road cut through the interior jungle forever closing behind it: because the reader follows the movement of his mind in the free flight of day-dreaming, whereas the copier submits it to command.”
—Walter Benjamin (1892–1940)