Given an integer or decimal, this determines the precision and accuracy (scale)

This calculator has 1 input.

This calculator has 1 input.

- The precision of a number is defined by the number of digits in the number
- Accuracy (scale) is the number of digits to the right of the decimal point

For more math formulas, check out our Formula Dossier

- accuracy
- How close a measurement is to the true value
- decimal
- Number in the form a/b where the result is not a whole number
- digit
- Any of the numbers (0, 1, 2, 3, 4, 5, 6, 7, 8, 9) used to construct a number
- place value
- the numerical value that a digit has by its position in a number.
- precision
- number of digits in a number