Glossary of Measurement Quality: Accuracy, Precision, Repeatability, and Reproducibility

Understanding measurement quality is essential in fields from aviation and aerospace to pharmaceuticals, automotive, and advanced manufacturing. The terms accuracy, precision, repeatability, and reproducibility form the foundation of metrology, quality assurance, and regulatory compliance. Here, we provide technical definitions, international standards, real-world examples, and the practical implications of these terms.

Accuracy

Definition and Standards

Accuracy is the degree of closeness between a measured value and the actual (true) value of the quantity being measured, called the measurand. According to the International Vocabulary of Metrology (VIM, ISO/IEC Guide 99:2007), accuracy is qualitative—described as “high” or “low”—and is closely linked to the absence of systematic error or bias.

Technical Explanation

Accuracy reflects how correct a measurement is. Systematic errors—consistent deviations caused by miscalibration, instrument drift, or procedural flaws—reduce accuracy. Mathematically, accuracy is often represented by comparing the mean value of repeated measurements to a reference standard.

Aviation Applications

In aviation, accuracy is critical—for example, in Performance-Based Navigation (PBN), where Required Navigation Performance (RNP) levels specify minimum accuracy thresholds for navigation systems. Calibration of altimeters, ILS, and air data computers ensures compliance and safety.

Precision

Definition and Standards

Precision is the degree to which repeated measurements under unchanged conditions produce similar results. Per ISO/IEC Guide 99:2007, it is “the closeness of agreement between indications or measured quantity values obtained by replicate measurements on the same or similar objects under specified conditions.” Precision is about consistency, not correctness.

Technical Explanation

Precision is primarily affected by random errors—unpredictable fluctuations due to environmental changes, instrument instability, or operator variability. It is quantified using statistical measures such as standard deviation and variance.

Operational Impact

High precision is crucial for quality control and trend monitoring. For example, an aircraft fuel flow sensor that reports consistent readings (even if offset) is highly precise, though not necessarily accurate.

Note:
High precision does not guarantee high accuracy.

Repeatability

Definition and Standards

Repeatability is the degree to which the same measurement process yields the same results when repeated under identical conditions—same operator, equipment, location, and a short time frame (ISO 5725-2).

Technical Explanation

Repeatability is a subset of precision: it assesses the within-lab, short-term stability of a measurement system. Low repeatability signals issues like mechanical wear or inconsistent procedures.

Significance

Repeatability is vital in manufacturing and laboratory settings. For instance, repeated thickness measurements of a metal sheet using the same micrometer should yield nearly identical results to qualify the process as repeatable.

Reproducibility

Definition and Standards

Reproducibility measures the degree to which consistent results are obtained when measurement conditions change—such as different operators, instruments, locations, or times (ISO 5725-2).

Technical Explanation

Reproducibility assesses the robustness of a measurement method across variable conditions, crucial for multi-site operations and regulatory acceptance. It is evaluated by comparing results from different labs, instruments, or personnel.

Importance

Reproducibility ensures that tests and calibrations performed by different teams or in different locations are reliable and accepted by regulators such as ICAO or EASA.

Visual Analogy: The Dartboard Model

The dartboard analogy clearly illustrates these concepts:

• Low Accuracy, Low Precision: Darts scattered, missing the bullseye and each other.
• Low Accuracy, High Precision: Darts tightly grouped away from the bullseye (systematic error).
• High Accuracy, Low Precision: Darts spread around the bullseye (random error dominates).
• High Accuracy, High Precision: Darts tightly grouped at the bullseye—ideal.

Repeatability is shown by one player throwing from the same spot; reproducibility by multiple players using different darts or positions.

Measurement Errors: Systematic vs. Random

• Systematic Errors: Consistent, directional biases (e.g., calibration error); affect accuracy.
• Random Errors: Unpredictable fluctuations (e.g., electrical noise); affect precision.

Measurement Instruments and Calibration

Calibration Fundamentals

Calibration aligns instrument readings with known standards, as mandated by ICAO and ISO. It involves comparison, adjustment, documentation, and interval setting based on drift and criticality.

Ensuring Precision and Repeatability

• Use high-quality, well-maintained instruments.
• Apply standardized procedures (SOPs).
• Train personnel to reduce operator variability.
• Control environmental factors.
• Conduct measurement system analyses (e.g., Gage R&R studies).

Industry Examples

• Aviation: Pitot-static system calibration ensures accurate airspeed and altitude.
• Pharmaceuticals: Regular calibration of balances for dosage accuracy.
• Manufacturing: CMMs are calibrated and checked for repeatability before critical inspections.

Real-World Examples and Use Cases

Laboratory Weighing:
Repeatedly weighing a 10.00 g standard on an analytical balance demonstrates accuracy (mean value matches standard) and precision (low scatter).

Industrial Process Control:
Jet engine sensors must provide accurate, precise readings; reproducibility ensures different teams reach the same results.

Manufacturing Quality Control:
Measuring rivet hole diameters—high precision detects tool wear, high accuracy ensures design compliance.

Metrology Labs:
Gage R&R studies quantify repeatability and reproducibility, supporting measurement system reliability.

Summary Table

Practical Implications

Measurement quality directly impacts safety, compliance, and efficiency:

• Troubleshooting: Identify calibration (accuracy) vs. equipment/procedure (precision/repeatability) issues.
• Regulatory Compliance: ICAO, FAA, and EASA require documented calibration and quality controls.
• Cost Optimization: Balance instrument capability with operational need.
• Reliability: Accurate, precise measurements reduce maintenance and safety risks.

Tips for Reliable Measurements

• Schedule regular calibration.
• Implement standardized procedures and training.
• Control environmental conditions.
• Use Gage R&R for system analysis.
• Maintain traceable records.

Glossary of Related Measurement Terms

• Resolution: Smallest detectable measurement increment.
• Systematic Error: Predictable, repeatable error; impacts accuracy.
• Random Error: Unpredictable variation; impacts precision.
• Linearity: Consistency of response over the instrument range.
• Bias: Average difference from the true value (systematic error).
• Traceability: Linking measurement to standards through an unbroken chain.
• Uncertainty: Dispersion of values attributed to the measurand.
• Calibration Interval: Time between scheduled calibrations.
• Gage R&R: Analysis of measurement system variability.
• Standard Operating Procedure (SOP): Documented, standardized measurement process.
• Metrological Traceability: Documented chain to a reference standard.

References and Further Reading

• ICAO Annex 14 – Aerodrome Design and Operations
• ISO/IEC Guide 99:2007 – International Vocabulary of Metrology
• ISO 5725-1/2 – Accuracy (Trueness and Precision) of Measurement Methods and Results
• FAA Order 8110.4C – Type Certification
• ABB: Are accuracy, precision and repeatability the same thing?
• Precisa: Difference between Accuracy and Precision
• Balluff: Resolution, accuracy, and repeatability/precision
• Advanced Spectral Technology: Precision vs. Accuracy in Metrology
• Test & Measurement World: Accuracy vs. Repeatability