Skip to main content
Journal cover image

A general approach to evaluating agreement between two observers or methods of measurement from quantitative data with replicated measurements.

Publication ,  Journal Article
Haber, M; Barnhart, HX
Published in: Stat Methods Med Res
April 2008

We present a general approach to the definition and estimation of coefficients for evaluating agreement between two fixed methods of measurements or human observers. The measured variable is assumed to be continuous with a finite second moment. No other distributional assumptions are made. We introduce the term ;disagreement function' for the function of the observations that is used to quantify the extent of disagreement between the two measurements made on the same subject. The proposed inter-methods agreement coefficients compare the disagreement between measurements made by different methods on the same subject to the corresponding disagreement between replicated measurements made by the same method. Therefore, the new coefficients require data with replications readings. We propose inter-methods agreement coefficients for two practical situations involving two methods that have a measurement error: 1) comparison of a new method to a gold standard (or a reference method), and 2) comparison of two methods where neither method is considered a gold standard. We consider three disagreement functions based on the differences between two measurements: 1) the mean squared difference, 2) the mean absolute difference and 3) the mean relative difference. We then derive non-parametric estimates for the various agreement coefficients. Our approach is illustrated using data from a study comparing systolic blood pressure measurements by a human observer and an automatic monitor. The performance of the new estimates is assessed via stochastic simulations.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Stat Methods Med Res

DOI

ISSN

0962-2802

Publication Date

April 2008

Volume

17

Issue

2

Start / End Page

151 / 169

Location

England

Related Subject Headings

  • Statistics & Probability
  • Reproducibility of Results
  • Observer Variation
  • 4905 Statistics
  • 4202 Epidemiology
  • 1117 Public Health and Health Services
  • 0104 Statistics
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Haber, M., & Barnhart, H. X. (2008). A general approach to evaluating agreement between two observers or methods of measurement from quantitative data with replicated measurements. Stat Methods Med Res, 17(2), 151–169. https://doi.org/10.1177/0962280206075527
Haber, Michael, and Huiman X. Barnhart. “A general approach to evaluating agreement between two observers or methods of measurement from quantitative data with replicated measurements.Stat Methods Med Res 17, no. 2 (April 2008): 151–69. https://doi.org/10.1177/0962280206075527.
Haber, Michael, and Huiman X. Barnhart. “A general approach to evaluating agreement between two observers or methods of measurement from quantitative data with replicated measurements.Stat Methods Med Res, vol. 17, no. 2, Apr. 2008, pp. 151–69. Pubmed, doi:10.1177/0962280206075527.
Journal cover image

Published In

Stat Methods Med Res

DOI

ISSN

0962-2802

Publication Date

April 2008

Volume

17

Issue

2

Start / End Page

151 / 169

Location

England

Related Subject Headings

  • Statistics & Probability
  • Reproducibility of Results
  • Observer Variation
  • 4905 Statistics
  • 4202 Epidemiology
  • 1117 Public Health and Health Services
  • 0104 Statistics