Enter Number to find the Precision and Scale of

Determine the precision and accuracy (scale) of 45.123679
Take precision first and then accuracy

Precision Definition:

The number of digits in the number

Precision Calculation for 45.123679:

45.123679 has 8 digits listed below
Digit 1 → 4
Digit 2 → 5
Digit 3 → 1
Digit 4 → 2
Digit 5 → 3
Digit 6 → 6
Digit 7 → 7
Digit 8 → 9

Precision = 8

Accuracy Definition:

The number of digits to the right of the decimal point

Accuracy Calculation for 45.123679:

Digit to the right of the decimal place 1 → 1
Digit to the right of the decimal place 2 → 2
Digit to the right of the decimal place 3 → 3
Digit to the right of the decimal place 4 → 6
Digit to the right of the decimal place 5 → 7
Digit to the right of the decimal place 6 → 9

Accuracy = 6

What is the Answer?

Precision = 8
Accuracy = 6

How does the Accuracy and Precision Calculator work?

Free Accuracy and Precision Calculator - Given an integer or decimal, this determines the precision and accuracy (scale)
This calculator has 1 input.

What 2 formulas are used for the Accuracy and Precision Calculator?

The precision of a number is defined by the number of digits in the number
Accuracy (scale) is the number of digits to the right of the decimal point

For more math formulas, check out our Formula Dossier

What 6 concepts are covered in the Accuracy and Precision Calculator?


accuracy: How close a measurement is to the true value
decimal: Number in the form a/b where the result is not a whole number
digit: Any of the numbers (0, 1, 2, 3, 4, 5, 6, 7, 8, 9) used to construct a number
place value: the numerical value that a digit has by its position in a number.
precision: number of digits in a number

Example calculations for the Accuracy and Precision Calculator

Tags:

Add This Calculator To Your Website

Accuracy of 45.123679 and Precision of 45.123679