Initial Experience of a Digital Training Resource for Modified Rankin Scale Assessment in Clinical Trials

Abstract

The modified Rankin Scale (mRS) is the preferred measure of disability in cerebrovascular clinical trials, but its value is restricted by interobserver variability. Poor reliability reduces the statistical power of clinical trials and leads to underestimation of effect size. Strategies to improve mRS grading are required. Video training has previously improved application of the National Institutes of Health Stroke Scale in clinical research. We developed an mRS training resource in an attempt to minimize interobserver variability. We produced a complete training resource comprising an instructional DVD with accompanying written materials and assessment recordings of patient interviews. Formal assessment of training involved grading of real-life cases. Results of initial training and recertification were collected centrally and scored. Data from 1564 assessments are presented. The majority of assessors were participating in 2 large prospective clinical stroke trials. Assessors represented a mixed group of disciplines and nationalities. After training, most trainees (90%) achieved certification in mRS assessment. The majority (85%) of investigators who did not reach an acceptable score on initial testing achieved certification after further exposure to the package. Mass training in mRS assessment for clinical trials is possible. We outline the development of a video-based training package, including technical issues, patient selection procedures, and methods of scoring and assessment. Certification results suggest that use of the resource can improve mRS grading. Acceptability of the training has been demonstrated by its successful use in 2 international acute stroke trials, SAINT 1 and CHANT.