Psychometric evaluation of the PROMIS Physical Function Computerized Adaptive Test in comparison to the American Shoulder and Elbow Surgeons score and Simple Shoulder Test in patients with rotator cuff disease

Abstract

The Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function Computerized Adaptive Test (PF CAT) is a newly developed patient-reported outcome instrument designed by the National Institutes of Health to measure generalized physical function. However, the measurement properties of the PF CAT have not been compared with established shoulder-specific patient-reported outcomes. Patients with clinical diagnosis of rotator cuff disease completed the American Shoulder and Elbow Surgeons (ASES) score, Simple Shoulder Test (SST), and PF CAT. Responses to each of the 3 instruments were statistically analyzed with a Rasch partial credit model. Associations between instruments, convergent validity, item and person reliability, ceiling and floor effects, dimensionality, and survey length were determined. Responses from 187 patients were analyzed. The PF CAT required fewer questions than the ASES or SST (PF CAT, 4.3; ASES, 11; SST, 12). Correlation between all instruments was moderately high. Item reliability was excellent for all instruments, but person reliability of the PF CAT was superior (0.93, excellent) to the SST (0.71, moderate) and ASES (0.48, fair). Ceiling effects were similar among all instruments (PF CAT, 0.53%; SST, 6.1%; ASES, 2.3%). Floor effects were found in 21% of respondents to the SST but in only 3.2% of PF CAT and 2.3% of ASES respondents. The measurement properties of the PROMIS PF CAT compared favorably with the ASES and SST despite requiring fewer questions to complete. The PROMIS PF CAT had improved person reliability compared with the ASES score and fewer floor effects compared with the SST.