Precision (computer Science)

Precision (computer Science)

In computer science, precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value.

Read more about Precision (computer Science):  Rounding Error

Famous quotes containing the word precision:

    Women on trains
    have a life
    that is exactly livable
    the precision of days flashing past
    Audre Lorde (1934–1992)