Open-Access Video-Based Orthopaedic Instructional Content is Inaccurate

Abstract

Objectives:The internet has an increasing role in both patient and physician education. While several recent studies critically appraised the quality and accuracy of web-based written information available to patients, no studies have evaluated such parameters for open access video content designed for provider use. The present study sought to determine utilization of video resources by orthopaedic residents and assess the quality and accuracy of their contentMethods:Surveys were distributed to orthopaedic surgery residents to to determine their use of open access instructional video content. An assessment of quality and accuracy of said video content was performed using the basic shoulder examination as a suragate for the “best-case scenario” due to its widely accepted components that are stable over time. Three search terms (“shoulder”, “examination” and “shoulder exam”) were entered into the four online video resources most commonly accessed by orthopaedic surgery residents (VuMedi, G9MD, Orthobullets, and YouTube). Videos were captured and independently reviewed by three orthopedic surgeons. Quality and accuracy were assessed in accordance with previously published standards.Results:Of the 72 orthopaedic residents surveyed, 70% use open-access videos as a resource monthly and 25% weekly. Over 70% or respondents perceived the video content to be accurate and informative. We reviewed 39 unique video tutorials on physical examination. Of the 39 videos, 61% rated poor (<25% accurate) or fair (<50% accurate). Specific shoulder tests such as Hawkins, O’Brien Sign, and Neer Impingement were accurately demonstrated in only 50%, 36%, and 27% of videos respectively. Inter-rater reliability was excellent (mean Kappa 0.80, range 0.79-0.81).Conclusion:We demonstrated that orthopaedic surgery residents often turn to open-access video tutorials as a supplemental education tool. While the majority residents believed the content is accurate, our results suggest an alarming inaccuracy of these video tutorials. Trainee exposure to inaccurate information has far reaching implications on the education process. As such, training programs should help guide their residents to pre-screened or peer-reviewed video resources.