Rater perspectives on Applied Training of cognitive Clinical Outcome Assessment (COA) scales delivered by neuropsychology experts

Abstract

AbstractBackgroundCognitive assessments are critical in understanding the effects of investigational therapies, but their use can be vulnerable to variability test administration and scoring. Careful training of raters on proper test administration cognitive tests is crucial to ensure optimal reliability and validity of clinical outcome data (Targum, 2006) and (Jeglic, 2007). Trainee feedback is important in ensuring a training program is comprehensive, well‐delivered and well‐received.MethodPerceived effectiveness of live training videoconferences, with expert neuropsychologists as clinical coaches (referred to as Local Expert Advisors “LEADs”), was evaluated via optional, online “Rater Training Survey” deployed to raters to report on their training experience, trainer, and preparedness for live assessments with study participants.ResultOf 261 survey invitations, 48 (18.4%) raters submitted responses on training sessions with 6 different expert trainers, questions on LEAD Knowledge, LEAD Feedback, and Rater Equipped received 100% positive responses. Additional comments lauded the trainers’ engaging and constructive approach to training delivery with effective preparation for assessments with study subjects.ConclusionThis survey format proved to be a low‐burden approach to quality control of clinical coaches. Raters, trained through this rater training program, reported an overwhelmingly positive training experience with the program overall and with the Applied Training session, specifically. The “personal touch” of live training modalities with expert coaches appears to be an effective training approach for raters’ skill mastery and feeling of preparedness.