Board 158 - Program Innovations Abstract New Comprehensive Visual Model ased on Evidence Based Literature as well as Expert Opinion to Evaluate and Design Simulation-Based Medical Simulation Courses (Submission #1502)

Abstract

Introduction/Background As a result of the identification of substandard care as a leading cause of preventable medical errors, medical education has received a growing interest in the last two decades. However, simulation literature and educational theories are quite extensive, sometimes difficult to understand and Conclusions may be conflicting. The main question for all simulation program developers is, what is the most effective way to train the healthcare professionals coming to their center to improve patient outcome? To answer this question, we have developed a visual model, based on contemporary literature, educational theories and expert opinions. The model provides guidance in the complexity of simulation literature and distils effective elements. It can be used to evaluate and design effective simulation-based medical training. Methods This study is fundamental qualitative research, using literature and focus group sessions to collect data. A literature search for features of effective evidence based medical (EBM) simulation was conducted in Pubmed and Cochrane Database (search terms: medical simulation, effectiveness, review). Based on this literature, several items were selected to become integrated in a visual model. A search for literature supporting these items has also been conducted in Pubmed and References were hand searched. Based on this literature, a questionnaire was developed to facilitate an objective use of the model. The conceptual model was presented on the ECOSIM conference (London 2011) to collect opinions of experts in the field of medical simulation. Besides, 10 separate focus group sessions were held on the conference of the Dutch Society of Simulation in Healthcare (DSSH, Utrecht 2012). We selected two major review articles to define 12 items of effective medical simulation.3,4 The principles of the educational theory of Ericsson “deliberate practice” was used as a background theory to select the following items:5 feedback, repetitive practice, curriculum integration, difficulty range, multiple learning strategies, clinical variation, controlled environment, individualized learning, defined outcome, simulator validity, distributed learning and formal assessment.
These items are integrated in a comprehensive visual model. The model consist of a circle divided into 12 similar pieces. Each item is linked to a piece. A questionnaire, based on EBM literature as well as educational theories,6 was developed, containing three questions for each item with equally weighted scores. Depending on the score of each item on the questionnaire, the coloured piece will grow. In the visual model it is possible to calculate a mean score. Completing the questionnaire will result in an individually tailored visual representation of a simulation-based medical training. Special software has been developed for this visual model. During the two national and international conferences, simulation experts agreed on the usefulness of this model. Results: Conclusion We created a visual model based on the educational theories, EBM literature and expert opinions to evaluate and design simulation-based medical team training. Experts agreed on the usefulness of this tool. However, we would like to stress that each medical simulation training should fit the educational goals of that specific training. Therefore, each simulation course will have its own optimal visual model. The visual model will become accessible online, aiming at increasing the predictive value of the model.