Real‐time interactive fusion of physical/electronic auscultation simulation and 3D CT/MRI‐based anatomical modeling applied to training in lung sounds detection, discrimination and classification

Abstract

Objective: To test the instructional effectiveness of simultaneous coupling of the spatial detection, discrimination and classification of simulated lung sounds to real‐time viewpoint tracking of displayed digital 3D anatomical models over the current method of auscultation alone. Methods: An integration of a computer‐based clinical training system comprising two complementary functions: 3D anatomical visualizations, and physiological diagnostic sounds simulation using a physical manikin. These functions are linked in real‐time by the student stethoscope's 3D position/orientation in space on the surface of the manikin. Thus, during any given simulation drill using as input a pre‐defined diagnostic lung sound, a student will sample signs from the manikin and simultaneously view the case's prescribed condition or pathology volumetrically reconstructed and visualized from de‐identified patient MRI/CT image sets carefully selected to represent the given abnormality. Expected results: Active student tracking, perception of diagnostic sounds and visualizations of the corresponding anatomical structures will significantly increase student learning over methods using auscultation without visualization.This research is supported by the Department of Anatomy and the Dean's Office, Des Moines University.