Inter-rater reliability in a resource-oriented physiotherapeutic examination

Abstract

The primary aim of the study was to examine inter-rater reliability of the resource-oriented body examination method, which includes a physical examination of body posture, respiration, body function, and muscle palpation. A secondary aim was to determine the relationship between percentage of agreement and reliability as assessed by kappa coefficient. Two independent evaluators examined 19 apparently healthy persons, simultaneously and without the knowledge of one another's results. Inter-rater reliability was expressed as kappa coefficient and as percentage of agreement between raters. The median kappa findings for posture, respiration, body function, and muscle palpation, were 0.55, 0.54, 0.42, and 0.27, respectively. The percentage of median agreement for posture, respiration, body function, and muscle palpation were 74%, 82%, 84%, and 72% respectively. Significance of the kappa coefficients was seen for posture in 77%, for respiration in 75%, and for body function and muscle palpation in 45% of the items when tested. There was a positive correlation between significant kappa coefficient and percentage of agreement, rs =. 96, P <. 001, where a kappa coefficient of 0.50 responded to about 74% agreement.