INTER-RATER AND INTRARATER RELIABILITY OF THREE COMMON CLASSIFICATION SYSTEMS FOR POSTERIOR MALLEOLUS FRACTURES: A MULTICENTRE STUDY

Abstract

A number of classification systems exist for posterior malleolus fractures of the ankle. The reliability of these classification systems remains unclear. The primary aim of this study was to evaluate the reliability of three commonly utilised fracture classification systems of the posterior malleolus.60 patients across 2 hospitals sustaining an unstable ankle fracture with a posterior malleolus fragment were identified. All patients underwent radiographs and computed tomography of their injured ankle. 9 surgeons including pre-ST3 level, ST3-8 level, and consultant level applied the Haraguchi, Rammelt, and Mason & Molloy classifications to these patients, at two timepoints, at least 4 weeks apart. The order was randomised between assessments. Inter-rater reliability was assessed using Fleiss’ kappa and 95% confidence intervals (CI). Intra-rater reliability was assessed using Cohen's Kappa and standard error (SE).Inter-rater reliability (Fleiss’ Kappa) was calculated for the Haraguchi classification as 0.522 (95% CI 0.490 – 0.553), for the Rammelt classification as 0.626 (95% CI 0.600 – 0.652), and the Mason & Molloy classification as 0.541 (95% CI 0.514 – 0.569). Intra-rater reliability (Cohen's Kappa) was 0.764 (SE 0.034) for the Haraguchi, 0.763 (SE 0.031) for the Rammelt, 0.688 (SE 0.035) for the Mason & Molloy classification.This study reports the inter-rater and intra-rater reliability for three classification systems for posterior malleolus fractures. Based on definitions by Landis & Koch (1977), inter-rater reliability was rated as ‘moderate’ for the Haraguchi and Mason & Molloy classifications; and ‘substantial’ for the Rammelt classification. Similarly, the intra-rater reliability was rated as ‘substantial’ for all three classifications.