Usability testing of the PRO-CTCAE measurement system in patients with cancer.

Abstract

e17560 Background: Use of electronic Patient-Reported Outcomes (ePROs) are increasingly employed in patient care and oncology research. However, these systems can be difficult to use, preventing adoption and deployment. The objective is to evaluate the patient usability of the National Cancer Institute’s (NCI) Patient Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) Measurement System. Methods: PRO-CTCAE is an item bank of 124 questions evaluating 78 symptomatic adverse events, as well as a software system that includes a web-based and interactive voice response system [IVRS] to administer these items to patients, and electronic features to customize survey creation, schedule survey administration, export data, and generate alerts and reports. A protocol was developed for two rounds of usability testing to evaluate understanding and ease of navigation reported by patients undergoing cancer treatment. Software was refined between rounds and retested. Patients were asked to login and complete PRO-CTCAE items either in clinic or at home, then were immediately debriefed (semi-scripted) by a trained interviewer. Results: 173 patients at 3 cancer centers and affiliated community network sites were enrolled in the study between 1/11-5/12 (45% male; 32% non-white; 26% high school or less). Usability issues identified in Round 1 (N=37) included difficulty in using radio buttons, absence of survey progress indicators, and problems with system login. Modifications included increasing size of buttons, improving the progress bar feature, and simplifying the interface to focus users on survey questions. In Round 2 (N=136), remaining issues were related to general difficulty with Internet use, such as navigating to the URL. IVRS testing indicated high scores of ease of use and completion of items, but users had difficulty adding unique symptoms to the system. Conclusions: Iterative usability testing identified improvements to web-based and IVRS for patient self-reporting and achieved a more favorable user experience. The feasibility of integrating PRO-CTCAE into trials to gather symptomatic adverse events directly from patients is currently being evaluated in the cancer cooperative groups.