Reliability, Internal Consistency, and Minimal Detectable Change of the American Physical Therapy Association Professionalism in Physical Therapy: Core Values Self-Assessment

Abstract

Introduction. The American Physical Therapy Association identified professionalism as a key component of the professions' growth and advancement in the 21st Century. Physical therapist education programs are using the professionalism in Physical Therapy: Core Values Self-Assessment (PCVSA) for the evaluation of their students and for research. The objective of this study was to determine the extent to which the PCVSA provides a reliable measurement of professionalism in physical therapist students. Methods. The study sample consisted of 267 previously completed PCVSAs from physical therapist (PT) students and 29 paired PCVSAs from a current cohort of PT students. This quantitative, descriptive study examined the reliability, internal consistency, and minimal detectible change of scores from the PCVSA. Scores from previously completed PCVSAs were used to investigate internal consistency reliability using Cronbach's alpha. Scores of PCVSA from current students were used to examine test–retest reliability using the intraclass correlation coefficient (ICC) and standard error of measurement. Minimal detectable change scores were also calculated. Results. The total PCVSA score had excellent score consistency (α = 0.97) and stability (ICC = 0.90; 95% confidence interval [CI] = 0.78–0.95). Standard error of measurement on the total score was 5.4 points. Minimal detectable change score at the 90% CI was 13 points (95% CI was 15 points). Discussion and Conclusion. Utility of the total PCVSA score for formative assessment of professionalism of PT students is supported. Minimal detectable change scores can be used to track professionalism change over time. The PCVSA should not be used for high stakes decisions regarding student progression due to items that may not be appropriate for students.