Evaluating the Diagnostic Inter-rater Reliability Between Virtual and In-person Sick-call Examinations at a Military Dental Treatment Facility

Abstract

ABSTRACT Introduction Teledentistry, also known as “virtual” dental examinations, is an innovative approach to increasing access to care. The objective of this study was to evaluate the diagnostic inter-rater reliability between virtual and in-person examinations for patients seeking emergency dental care (sick call) at a military dental treatment facility. Materials and Methods One hundred subjects received both virtual and in-person examinations on the same day, in random order. The virtual examiner and subject were stationed in separate rooms and used only a laptop equipped with a camera, microphone, and speaker to complete the virtual exam. In contrast, the in-person examiner had access to all standard care modalities in a dental treatment room. After the first encounter, the subject proceeded to the corresponding virtual or in-person exam, and both examiners determined a diagnosis. Inter-rater agreement was determined between the two encounters for both diagnosis specialty category and diagnostic code using the Kappa coefficient. Results The results of the inter-rater analyses showed a Kappa score of 0.644 for the diagnosis specialty category (P < .001) and a Kappa score of 0.714 for diagnostic codes (P < .001). Both analyses indicated “substantial” agreement. Conclusions We conclude that teledentistry can be an effective tool for determining a diagnosis and improving access to care for dental emergencies at military dental treatment facilities.