Precision (computer Science)
In computer science, precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value.
Read more about Precision (computer Science): Rounding Error
Famous quotes containing the word precision:
“Women on trains
have a life
that is exactly livable
the precision of days flashing past”
—Audre Lorde (19341992)