Precision (computer Science)
In computer science, precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value.
Read more about Precision (computer Science): Rounding Error
Famous quotes containing the word precision:
“Some authorities hold that the young ought not to lie at all. That, of course, is putting it rather stronger than necessary; still, while I cannot go quite so far as that, I do maintain, and I believe I am right, that the young ought to be temperate in the use of this great art until practice and experience shall give them that confidence, elegance and precision which alone can make the accomplishment graceful and profitable.”
—Mark Twain [Samuel Langhorne Clemens] (1835–1910)