Teamwork Scale Research Articles

Teamwork training with nursing and medical students: does the method matter? Results of an interinstitutional, interdisciplinary collaboration

ObjectivesThe authors conducted a randomised controlled trial of four pedagogical methods commonly used to deliver teamwork training and measured the effects of each method on the acquisition of student teamwork...

Team Behavior During Trauma Resuscitation: A Simulation-Based Performance Assessment

Trauma resuscitations require a coordinated response from a diverse group of health care providers. Currently, there are no widely accepted methods of assessing team effectiveness in this setting. Simulation affords a method to assess team effectiveness. The purpose of this study was to use a simulation setting to develop a specialized assessment instrument for team response in trauma resuscitation. We developed our assessment instrument using clinical simulation. Four teams of 3 postgraduate year-2 surgical trainees in conjunction with scripted confederates were videotaped enacting 6 separate trauma resuscitation scenarios that mirrored clinical conditions encountered at our level 1 trauma center. Ten of the resulting videotaped scenarios represented a spectrum of team behavior (ineffective to effective) and were scored by 8 experienced clinicians using the Mayo High Performance Teamwork Scale. Based in part on the Mayo High Performance Teamwork Scale, we created a prototype trauma team assessment tool consisting of 7 attributes that we scored in binary fashion (present/absent). We validated this prototype by assigning a normalized ranking score to each of the 10 scenarios based on the score supplied by each rater. The presence/absence of the 7 attributes varied significantly among scenarios (52.5% to 93.8%; P < .001). Median scores differed significantly comparing the 5 lowest-ranking scenarios with the 5 highest-ranking scenarios (P < .001). Our prototype instrument may be effective at assessing team effectiveness during trauma resuscitations. This instrument may prove useful for assessing team competency skills, providing timely feedback to teams, and examining the relationship between effective team function and clinically important outcomes. Further, it may be applicable to other high-acuity, time-sensitive clinical situations.

Use of High Fidelity Operating Room Simulation to Assess and Teach Communication, Teamwork and Laparoscopic Skills: Initial Experience

Structured opportunities for learning communication, teamwork and laparoscopic principles are limited for urology residents. We evaluated and taught teamwork, communication and laparoscopic skills to urology residents in a simulated operating room. Scenarios related to laparoscopy (insufflator failure, carbon dioxide embolism) were developed using mannequins, urology residents and nurses. These scenarios were developed based on Accreditation Council for Graduate Medical Education core competencies and performed in a simulation center. Between the pretest scenario (insufflation failure) and the posttest scenario (carbon dioxide embolism) instruction was given on teamwork, communication and laparoscopic skills. A total of 19 urology residents participated in the training that involved participation in at least 2 scenarios. Performance was evaluated using validated teamwork instruments, questionnaires and videotape analysis. Significant improvement was noted on validated teamwork instruments between scenarios based on resident (pretest 24, posttest 27, p = 0.01) and expert (pretest 16, posttest 25, p = 0.008) evaluation. Increased teamwork and team performance were also noted between scenarios on videotape analysis with significant improvement for adherence to best practice (p = 0.01) and maintenance of positive rapport among team members (p = 0.02). Significant improvement in the setup of the laparoscopic procedure was observed (p = 0.01). Favorable face and content validity was noted for both scenarios. Teamwork, intraoperative communication and laparoscopic skills of urology residents improved during the high fidelity simulation course. Face and content validity of the individual sessions was favorable. In this study high fidelity simulation was effective for assessing and teaching Accreditation Council for Graduate Medical Education core competencies related to intraoperative communication, teamwork and laparoscopic skills.

Validation of a Tool to Measure and Promote Clinical Teamwork

Human factors and teamwork are major contributors to sentinel events. A major limitation to improving human factors and teamwork is the paucity of objective validated measurement tools. Our goal was to develop a brief tool that could be used to objectively evaluate teamwork in the field during short clinical team simulations and in everyday clinical care. A pilot validation study. Standardized videos were created demonstrating poor, average, and excellent teamwork among an obstetric team in a common clinical scenario (shoulder dystocia). Three evaluators all trained in Crew Resource Management, and unaware of assigned teamwork level, independently reviewed videos and evaluated teamwork using the Clinical Teamwork Scale (CTS). Statistical analysis included calculation of the Kappa statistic and Kendall coefficient to evaluate agreement and score concordance among raters, and Interclass Correlation Coefficient (ICC) to evaluate interrater reliability. The reliability of the tool was further evaluated by estimating the variance of each component of the tool based on generalizability theory. There was substantial agreement (Kappa 0.78) and score concordance (Kendall coefficient 0.95) among raters, and excellent interrater reliability (interclass correlation coefficient 0.98). The highest percentage of variance in scores among raters was because of rater/item interaction. The CTS was developed to efficiently measure key clinical teamwork skills during simulation exercises and in everyday clinical care. It contains 15 questions in 5 clinical teamwork domains (communication, situational awareness, decision-making, role responsibility, and patient friendliness). It is easy to use and has construct validity with median ratings consistently corresponding with the intended teamwork level. The CTS is a brief, straightforward, valid, reliable, and easy-to-use tool to measure key factors in teamwork in simulated and clinical settings.

Risk-Adjusted Morbidity in Teaching Hospitals Correlates with Reported Levels of Communication and Collaboration on Surgical Teams but Not with Scale Measures of Teamwork Climate, Safety Climate, or Working Conditions

Since the Institute of Medicine patient safety reports, a number of survey-based measures of organizational climate safety factors (OCSFs) have been developed. The goal of this study was to measure the impact of OCSFs on risk-adjusted surgical morbidity and mortality. Surveys were administered to staff on general/vascular surgery services during a year. Surveys included multiitem scales measuring OCSFs. Additionally, perceived levels of communication and collaboration with coworkers were assessed. The National Surgical Quality Improvement Program was used to assess risk-adjusted morbidity and mortality. Correlations between outcomes and OCSFs were calculated and between outcomes and communication/collaboration with attending and resident doctors, nurses, and other providers. Fifty-two sites participated in the survey: 44 Veterans Affairs and 8 academic medical centers. A total of 6,083 surveys were returned, for a response rate of 52%. The OCSF measures of teamwork climate, safety climate, working conditions, recognition of stress effects, job satisfaction, and burnout demonstrated internal validity but did not correlate with risk-adjusted outcomes. Reported levels of communication/collaboration with attending and resident doctors correlated with risk-adjusted morbidity. Survey-based teamwork, safety climate, and working conditions scales are not confirmed to measure organizational factors that influence risk-adjusted surgical outcomes. Reported communication/collaboration with attending and resident doctors on surgical services influenced patient morbidity. This suggests the importance of doctors' coordination and decision-making roles on surgical teams in providing high-quality and safe care. We propose risk-adjusted morbidity as an effective measure of surgical patient safety.

The Mayo High Performance Teamwork Scale: Reliability and Validity for Evaluating Key Crew Resource Management Skills

To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.