Use of Human Patient Simulation and Validation of the Team Situation Awareness Global Assessment Technique (TSAGAT): A Multidisciplinary Team Assessment Tool in Trauma Education

Abstract

Situation awareness (SA) is a vital construct for decision making in intense, dynamic environments such as trauma resuscitation. Human patient simulation (HPS) allows for a safe environment where individuals can develop these skills. Trauma resuscitation is performed by multidisciplinary teams that are traditionally difficult to globally assess. Our objective was to create and validate a novel tool to measure SA in multidisciplinary trauma teams using a HPS--the Team Situation Awareness Global Assessment Technique (TSAGAT). Memorial University Simulation Centre. Using HPS, 4 trauma teams completed 2 separate trauma scenarios. Student, junior resident, senior resident, and attending staff teams each had 3 members (trauma team leader, nurse, and airway manager). Individual SAGATs were developed by experts in each respective field and contained shared and complimentary knowledge questions. Teams were assessed with SAGAT in real time and with traditional checklists using video review. TSAGAT was calculated as the sum of individual SAGAT scores and was compared with the traditional checklist scores. Shared, complimentary, and TSAGAT scores improved with increasing team experience. Differences between teams for TSAGAT and complimentary knowledge were statistically significant (p < 0.05). Mean checklist differences between teams also reached statistical significance (p < 0.05). TSAGAT scores correlated strongly with traditional checklist scores (Pearson correlation r = 0.996). Interrater reliability for the checklist tool was high (Pearson correlation r = 0.937). TSAGAT is the first valid and reliable assessment tool incorporating SA and HPS for multidisciplinary team performance in trauma resuscitation. TSAGAT could compliment or improve on current assessment methods and curricula in trauma and critical care and provides a template for team assessment in other areas of surgical education.