Precision (computer Science)

Precision (computer Science)

In computer science, precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value.

Read more about Precision (computer Science):  Rounding Error

Famous quotes containing the word precision:

    Concision in style, precision in thought, decision in life.
    Victor Hugo (1802–1885)