Implementing electronic patient reported outcomes in inflammatory bowel disease: patient participation, score reliability and validity

Abstract

BackgroundPatient-reported outcome measures (PROMs) are recommended for assessing patient-centered outcomes in inflammatory bowel disease (IBD). The main aims were to assess the level of participation in an electronic PROM (ePROM) data collection system among patients with IBD, and evaluate reliability and validity of the resulting scores.MethodsPatients included in the IBD registry of Maccabi Healthcare Services, a state-mandated healthcare provider for over 2.6 million people in Israel, were invited to complete the IBD-Control measure and a general health item, with follow-up ePROMs at 3 and 6 months including a global rating of change item. Descriptive statistics were used to compare patient characteristics by participation rate, and assess survey completion time. Initial scores were assessed for internal consistency reliability using Cronbach's alpha. Test–retest reliability was assessed using the intraclass correlation coefficient from paired scores of patients identified as unchanged between the initial and first follow-up. Construct validity was assessed by the ability of IBD-control scores to discriminate between patient sub-groups in expected ways. Empirical validity was assessed using ePROM score correlations with laboratory markers of disease activity. Score coverage was also assessed.ResultsA total of 13,588 patients were invited to participate [Mean age = 49 years (SD = 17); females = 51%]. Participation rate was 31.5%. Participants compared to non-participants were slightly older, were more likely to be female, to have a history of biologic treatment, to have higher socio-economic status, and to be more experienced in the usage of the digital patient portal. Median survey completion time was approximately 1:30 min. Internal consistency and test–retest reliability were 0.86 and 0.98, respectively. Scores discriminated between patient sub-groups in clinically expected ways, with expected correlations to laboratory markers of disease activity. A notable ceiling effect was observed (> 15%) for IBD-Control scores.ConclusionsFeasibility, reliability, and validity of the ePROM system was supported for measuring the level of perceived disease control in patients diagnosed with IBD in Israel. Additional research is needed to identify ways to increase patient participation, assess clinical implications of the identified measurement ceiling of the IBD-control, and evaluate the added value of the derived scores in support of clinical decision making.