Precision (computer Science)
In computer science, precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value.
Read more about Precision (computer Science): Rounding Error
Famous quotes containing the word precision:
“How should the world be luckier if this house,
Where passion and precision have been one
Time out of mind, became too ruinous
To breed the lidless eye that loves the sun?”
—William Butler Yeats (1865–1939)