Abstract

Cohen’s kappa is the most widely used coefficient for assessing interobserver agreement on a nominal scale. An alternative coefficient for quantifying agreement between two observers is Bangdiwala’s B. To provide a proper interpretation of an agreement coefficient one must first understand its meaning. Properties of the kappa coefficient have been extensively studied and are well documented. Properties of coefficient B have been studied, but not extensively. In this paper, various new properties of B are presented. Category B-coefficients are defined that are the basic building blocks of B. It is studied how coefficient B, Cohen’s kappa, the observed agreement and associated category coefficients may be related. It turns out that the relationships between the coefficients are quite different for 2times 2 tables than for agreement tables with three or more categories.

Highlights

  • In behavioral and social sciences, the biomedical field and engineering, it is frequently required that multiple units are classified by an observer intoM

  • It turns out that the relationships between the coefficients are quite different for 2 × 2 tables than for agreement tables with three or more categories

  • Cohen’s kappa has value 1 when there is perfect agreement between the two observers, and value 0 when agreement is equal to that expected under statistical independence

Read more

Summary

Introduction

In behavioral and social sciences, the biomedical field and engineering, it is frequently required that multiple units (e.g. individuals, objects) are classified by an observer into. Various coefficients have been proposed that can be used to quantify agreement between two observers on a nominal scale (Gwet 2012; Hsu and Field 2003; Krippendorff 2004; Warrens 2010a). The properties presented in these papers help us understand kappa’s behavior in applications and provide new interpretations of coefficient. Muñoz and Bangdiwala (1997) presented statistical guidelines for the interpretation of kappa and B based on simulation studies. B-coefficients for individual categories are defined that are the basic building blocks of B It is studied how coefficient B, Cohen’s kappa, the observed agreement and associated category coefficients may be related. One way to study how coefficients are related to one another, is to attempt to find inequalities between coefficients that hold for all agreement tables of a certain size.

Agreement table
The observed agreement
Kappa coefficients
B-coefficients
Relationships between the B-coefficients
Relationships to other coefficients
A general inequality
Counterexamples
Discussion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.