Weighted least-squares approach for comparing correlated kappa.

Journal Article (Journal Article)

In the medical sciences, studies are often designed to assess the agreement between different raters or different instruments. The kappa coefficient is a popular index of agreement for binary and categorical ratings. Here we focus on testing for the equality of two dependent kappa coefficients. We use the weighted least-squares (WLS) approach of Koch et al. (1977, Biometrics 33, 133-158) to take into account the correlation between the estimated kappa statistics. We demonstrate how the SAS PROC CATMOD can be used to test for the equality of dependent Cohen's kappa coefficients and dependent intraclass kappa coefficients with nominal categorical ratings. We also test for the equality of dependent Cohen's kappa and dependent weighted kappa with ordinal ratings. The major advantage of the WLS approach is that it allows the data analyst a way of testing dependent kappa with popular SAS software. The WLS approach can handle any number of categories. Analyses of three biomedical studies are used for illustration.

Full Text

Duke Authors

Cited Authors

  • Barnhart, HX; Williamson, JM

Published Date

  • December 2002

Published In

Volume / Issue

  • 58 / 4

Start / End Page

  • 1012 - 1019

PubMed ID

  • 12495157

International Standard Serial Number (ISSN)

  • 0006-341X

Digital Object Identifier (DOI)

  • 10.1111/j.0006-341x.2002.01012.x


  • eng

Conference Location

  • United States