Non-technical Performance Research Articles

Video analysis of real-life shoulder dystocia to assess technical and non-technical performance.

Managing obstetric shoulder dystocia requires swift action using correct maneuvers. However, knowledge of obstetric teams' performance during management of real-life shoulder dystocia is limited, and the impact of non-technical skills has not been adequately evaluated. We aimed to analyze videos of teams managing real-life shoulder dystocia to identify clinical challenges associated with correct management and particular non-technical skills correlated with high technical performance. We included 17 videos depicting teams managing shoulder dystocia in two Danish delivery wards, where deliveries were initially handled by midwives, and consultants were available for complications. Delivery rooms contained two or three cameras activated by Bluetooth upon obstetrician entry. Videos were captured 5 min before and after activation. Two obstetricians assessed the videos; technical performances were scored as low (0-59), average (60-84), or high (85-100). Two other assessors evaluated non-technical skills using the Global Assessment of Team Performance checklist, scoring 6 (poor) to 30 (excellent). We used a spline regression model to explore associations between these two score sets. Inter-rater agreement was assessed using interclass correlation coefficients. Interclass correlation coefficients were 0.71 (95% confidence interval 0.23-0.89) and 0.82 (95% confidence interval 0.52-0.94) for clinical and non-technical performances, respectively. Two teams had low technical performance scores; four teams achieved high scores. Teams adhered well to guidelines, demonstrating limited head traction, McRoberts maneuver, and internal rotation maneuvers. Several clinical skills posed challenges, notably recognizing shoulder impaction, applying suprapubic pressure, and discouraging women from pushing. Two non-technical skills were associated with high technical performance: effective patient communication, with teams calming the mother and guiding her collaboration during internal rotational maneuvers, and situation awareness, where teams promptly mobilized all essential personnel (senior midwife, consultant, pediatric team). Team communication, stress management, and task management skills were not associated with high technical performance. Videos capturing teams managing real-life shoulder dystocia are an effective tool to reveal challenges with certain technical and non-technical skills. Teams with high technical performance are associated with effective patient communication and situational awareness. Future training should include technical skills and non-technical skills, patient communication, and situation awareness.

A Customizable Digital Cognitive Aid for Neonatal Resuscitation: A Simulation-Based Randomized Controlled Trial.

Adherence to the International Liaison Committee on Resuscitation (ILCOR) algorithm optimizes the initial management of critically ill neonates. In this randomized controlled trial, we assessed the impact of a customizable sequential digital cognitive aid (DCA), adapted from the 2020 ILCOR recommendations, compared with a poster cognitive aid (standard of care [SOC]), on technical and nontechnical performance of junior trainees during a simulated critical neonatal event at birth. For this prospective, bicentric video-recorded study, students were recruited on a voluntary basis, and randomized into groups of 3 composed of a pediatric resident and two midwife students. They encountered a simulated cardiac arrest at birth either (1) with DCA use and ILCOR algorithm poster displayed on the wall (intervention group) or (2) with sole ILCOR algorithm poster (poster cognitive aid [SOC]). Technical and nontechnical skills (NTS) between the two groups were assessed using a standardized scoring of videotaped performances. A neonate specific NTS score was created from the adult Team score. 108 students (36 groups of three) attended the study, 20 groups of 3 in the intervention group and 16 groups of 3 in the poster cognitive aid (SOC) group. The intervention group showed a significant improvement in the technical score ( P < 0.001) with an average of 24/27 points (24.0 [23.5-25.0]) versus 20.8/27 (20.8 [19.9-22.5]) in poster cognitive aid (SOC) group. No nontechnical score difference was observed. Feedback on the application was positive. During a simulated critical neonatal event, use of a DCA was associated with higher technical scores in junior trainees, compared with the sole use of ILCOR poster algorithm.

Patient and Operational Factors Do Not Substantively Affect the Annual Departmental Quality of Anesthesiologists' Clinical Supervision and Nurse Anesthetists' Work Habits.

Although safety climate, teamwork, and other non-technical skills in operating rooms probably influence clinical outcomes, direct associations have not been shown, at least partially due to sample size considerations. We report data from a retrospective cohort of anesthesia evaluations that can simplify the design of prospective observational studies in this area.Associations between non-technical skills in anesthesia, specifically anesthesiologists' quality of clinical supervision and nurse anesthetists' work habits, and patient and operational factors were examined. Eight fiscal years of evaluations and surgical cases from one hospital were included. Clinical supervision by anesthesiologists was evaluated daily using a nine-item scale. Work habits of nurse anesthetists were evaluated daily using a six-item scale. The dependent variables for both groups of staff were binary, whether all items were given the maximum score or not. Associations were tested with patient and operational variables for the entire day. There were 40,718 evaluations of faculty anesthesiologists by trainees, 53,772 evaluations of nurse anesthetists by anesthesiologists, and 296,449 cases that raters and ratees started together. Cohen's d values were small (≤0.10) for all independent variables, suggesting a lack of any clinically meaningful association between patient and operational factors and evaluations given the maximum scores. For supervision quality, the day's count of orthopedic cases was a significant predictor of scores (P = 0.0011). However, the resulting absolute marginal change in the percentage of supervision scores equal to the maximum was only 0.8% (99% confidence interval: 0.2% to 1.4%), i.e., too small to be of clinical or managerial importance. Neurosurgical cases may have been a significant predictor of work habits (P = 0.0054). However, the resulting marginal change in the percentage of work habits scores equal to the maximum, an increase of 0.8% (99% confidence interval: 0.1% to 1.6%), which was again too small to be important. When evaluating the effect of assigning anesthesiologists and nurse anesthetists with different clinical performance quality on clinical outcomes, supervision qualityand work habits scores may be included as independent variables without concern that their effects are confounded by association with the patient or case characteristics. Clinical supervision and work habits are measures of non-technical skills. Hence, these findings suggest that non-technical performance can be judged by observing the typical small sample size of cases. Then, associations can be tested with administrative data for a far greater number of patients because there is unlikely to be a confounding association between patient and case characteristics and the clinicians' non-technical performance.

Relationship Between Resuscitation Team Members' Self-Efficacy and Team Competence During In-Hospital Cardiac Arrest.

Inadequate self-efficacy of resuscitation team members may impair team performance, but high self-efficacy does not guarantee competence. We evaluated the relationship between individual self-efficacy and resuscitation team competence. Secondary analysis of a randomized controlled trial. High-fidelity in situ in-hospital cardiac arrest simulations at seven hospitals in Utah. Multidisciplinary cardiac arrest resuscitation team members. None. Resuscitation team members completed surveys evaluating resuscitation self-efficacy (confidence in resuscitation role, difficulty thinking clearly, and concerns about committing errors) after each simulation. The primary outcome was event-level chest compression hands-on fraction greater than 75%. Secondary outcomes included other measures of resuscitation quality, advanced cardiac life support protocol adherence, and nontechnical team performance. Analyses employed the Datta-Satten rank-sum method to account for response clustering within simulation events. Of 923 participants in 76 analyzable simulations, 612 (66%) submitted complete surveys and 33 (43%) resuscitation teams achieved hands-on fraction greater than 75%. Event-level chest compression hands-on fraction greater than 75% versus less than or equal to 75% was not associated with the percentage of resuscitation team members reporting confidence in their team role (n = 213 [74%] vs. n = 251 [77%], respectively, p = 0.18), lack of difficulty thinking clearly (n = 186 [65%] vs. n = 214 [66%], p = 0.92), or lack of worry about making errors (n = 155 [54%] vs. n = 180 [55%], p = 0.41). Team members' confidence was also not associated with secondary outcomes, except that teams with confident members had better values for composite (3.55 [interquartile range, IQR 3.00-3.82] vs. 3.18 [IQR 2.57-3.64], p = 0.024) and global (8 [7-9] vs. 8 [6-8], p = 0.029) scales measuring nontechnical team performance. Team members' self-efficacy was not associated with most team-level competence metrics during simulated cardiac arrest resuscitation. These data suggest that self-efficacy should have a limited role for evaluation of resuscitation training programs and for initial certification and monitoring of individual resuscitation team members' competence.

Influence of the embedded participant on learners’ performance during high-fidelity simulation sessions in healthcare

BackgroundThe embedded participant (EP) plays a key role during a full scale/high-fidelity simulation (HFS) session. He/she is expected to guide the learner towards the achievement of the educational objectives of the scenario. However, his/her influence on learners’ performance stands undetermined and this effect remains briefly addressed in the literature. This study primarily aims to assess whether the EP could have an influence on the performance of the learner during a HFS scenario. The secondary aim was to establish an inventory of the EP practices in France.MethodsThis retrospective study was conducted in Lyon Claude Bernard University Health Simulation Centre (France). Anaesthesia and critical care residents in postgraduate years 1 to 5 who were scheduled for their HFS sessions during the 2016 to 2021 academic years were included. Two investigators independently evaluated the resident performance regarding both technical and non-technical skills from video recordings. In addition, a nationwide survey was sent out by email through the networks of the Francophone Healthcare Simulation Society (SoFraSimS, Société Francophone de Simulation en Santé) to collect information on EP practices in French-speaking Simulation centres.ResultsFrom a total of 344 HFS videos analysed, a cohort of 19 experienced EPs was identified. The EPs had an influence on the technical and non-technical performances of the learners. The 147 responses to the survey showed that predefined rules of EP good practice existed in only 36% of the simulation centres and 65% of respondents believed that specific EP training would be justified.ConclusionThe EP can exert an influence on the performance of the learners during HFS. For acting as an EP, a great variability of practices and a lack of training are reported by professionals working in simulation centres. These results suggest that more attention must be paid to EP training and attitudes during simulation, especially if summative simulations are extensively developed.

Teaching Professionalism during and Posta Pandemic to Surgical Trainees: A Survey of the Impact of a Workshop on Trainers and Trainees.

Focussed professionalism training improves surgical trainees' communication, information gathering, and counselling skills. This study reviews the impact of a professionalism workshop for surgical trainees within a large trust in the United Kingdom developed during the pandemic to support the trainees and help them develop resilience and appropriate behaviours during the time of increased pressure. A workshop involving case-based discussions and reflections on professionalism was developed from the themes and methods of training noted to be effective on a literature search of Medline, EMBASE, and PsycINFO databases carried out in May 2020. The impact of Covid on surgical trainees and educator's professionalism training and the techniques of training preferred by trainees was evaluated by a survey of trainees and trainers after the intervention to evolve future training initiatives. During the workshop, a behavioural marker checklist was used to improve feedback on the observed behaviours. 83 trainers and trainees were surveyed following a professional behaviour workshop training 63 surgeons at various stages of training. Surgical list availability had reduced by at least 5-10 a month for all the trainees within the trust during the pandemic. Most trainees surveyed (49 (60%)) felt that this had reduced the opportunities to train technical skills and develop professional non-technical skills like teamwork and communication skills, adversely impacting the trainee's clinical performance. The increased support offered by the workshop helped 50 trainees (80%) to improve non-technical skill performance objectively by referencing to behavioural markers and this was felt to have become embedded in practice when surveyed 4 weeks later in 38 trainees (60%). The majority of those surveyed (47 (75%)) felt trainers and trainees had acted professionally during the pandemic and subsequently. The workshop discussions also helped (56 (67%)) trainers and trainees to consider how best to engage professionally with new ways of working as work, and training switched to virtual or telemedicine platforms during the pandemic. Professionalism-based education facilitates surgical trainee development, making them stronger team members and helping to restore team working skills and embrace new working practices.

Application of the Team Emergency Assessment Measure Scale in undergraduate medical students and interprofessional clinical teams: validity evidence of a Spanish version applied in Chile.

Teamwork is one of the competencies necessary for physicians to work effectively in health systems and is a competency that can be developed with simulation in professionals and medicine students. The Team Emergency Assessment Measurement (TEAM) was created to evaluate the non-technical performance of team members during resuscitation events in real teams. The TEAM scale includes items to assess leadership, teamwork, situational awareness, and task management. An objective evaluation tool in Spanish is valuable for training health professionals at all undergraduate and continuing education levels. This study aimed to generate evidence of the validity of the Team Emergency Assessment Measure (TEAM) in Spanish to measure the performance of medical students and adult, pediatric, and obstetric emergency clinical teams in simulated emergencies as a self-assessment tool. To develop the Spanish version of the instrument, a forward and backward translation process was followed by independent translators, native and fluent in English and Spanish, and a review by a panel of Chilean experts comprising three trained simulation instructors to verify semantics and cultural equivalence. High-fidelity simulations with debriefing were conducted with 5th-year medical students, in which students and instructors applied the Spanish version of the TEAM scale. In the second stage, adult, pediatric, and obstetric emergency management simulations were conducted using the TEAM scale for real clinical teams as a self-assessment tool. By applying the overall TEAM scale to medicine students and clinical teams, Cronbach's alpha was 0.921. For medical students' self-assessment, we obtained Cronbach's alpha of 0.869. No significant differences were found between the overall scores and the scores by dimensions evaluated by instructors and students (p > 0.05). In the case of clinical team training, Cronbach's alpha was 0.755 for adult emergency teams, 0.797 for pediatric emergency teams, and 0.853 for obstetric emergency teams. The validated instrument is adequate for evaluating teamwork in medical student simulations by instructors and peers and for self-assessment in adult, pediatric, and obstetric emergency clinical teams.

Implementation of an Online Intraoperative Assessment of Technical Performance for Surgical Trainees

IntroductionAssessment of surgical resident technical performance is an integral component of any surgical training program. Timely assessment delivered in a structured format is a critical step to enhance technical skills, but residents often report that the quality and quantity of timely feedback received is lacking. Moreover, the absence of written feedback with specificity can allow residents to seemingly progress in their operative milestones as a junior resident, but struggle as they progress into their postgraduate year 3 and above. We therefore designed and implemented a web-based intraoperative assessment tool and corresponding summary "dashboard" to facilitate real-time assessment and documentation of technical performance. Materials and methodsA web form was designed leveraging a cloud computing platform and implementing a modified Ottawa Surgical Competency Operating Room Evaluation instrument; this included additional, procedure-specific criteria for select operations. A link to this was provided to residents via email and to all surgical faculty as a Quick Response code. Residents open and complete a portion of the form on a smartphone, then relinquish the device to an attending surgeon who then completes and submits the assessment. The data are then transferred to a secure web-based reporting interface; each resident (together with a faculty advisor) can then access and review all completed assessments. ResultsThe Assessment form was activated in June 2021 and formally introduced to all residents in July 2021, with residents required to complete at least one assessment per month. Residents with less predictable access to operative procedures (night float or Intensive Care Unit) were exempted from the requirement on those months. To date a total of 559 assessments have been completed for operations performed by 56 trainees, supervised by 122 surgical faculty and senior trainees. The mean number of procedures assessed per resident was 10.0 and the mean number per assessor was 4.6. Resident initiation of Intraoperative Assessments has increased since the tool was introduced and scores for technical and nontechnical performance reliably differentiate residents by seniority. ConclusionsThis novel system demonstrates that an online, resident-initiated technical assessment tool is feasible to implement and scale. This model's requirement that the attending enter performance ratings into the trainee's electronic device ensures that feedback is delivered directly to the trainee. Whether this aspect of our assessment ensures more direct and specific (and therefore potentially actionable) feedback is a focus for future study. Our use of commercial cloud computing services should permit cost-effective adoption of similar systems at other training programs.

A new standardized tool for quantification of closed-loop communication in trauma care: CAST Grid reliability study

BackroundThe CAST Grid has been developed to evaluate the use of closed-loop communication (CLC) in the trauma bay. MethodsThe CAST Grid and two validated non-technical team performance assessment tools (the TEAM and T-NOTECHS grids) were completed by 2 independent reviewers based on trauma care simulation videos from a French Level 1 trauma center. Intra- and inter-rater agreements were evaluated for CLC parameters and non-technical performance, and correlations between these parameters were analyzed. ResultsThe study analyzed 11 videos. The intra- and inter-rater agreement for the number of CLC per minute (CLC/min) was moderate and good, respectively, based on Lin's concordance correlation coefficient [95%CI] (0.57 [−0.40;0.94] and 0.77 [0.33;0.94]). However, the agreement was poor for the percentage of CLC (0.37 [−0.58;0.89] and -0.36 [−0.71;0.14], respectively). The study found that a lower number of CLC/min was correlated with an increased duration of the simulation (r = −0.75 [−0.93; −0.25]). ConclusionThe CAST Grid showed a relatively good inter-rater agreement to quantify the number of CLC/min which was inversely correlated with the duration of care. This tool opens up the possibility of quantifying CLC and allows for new analyses of team functioning and interactions.

The need for non-technical skills education in orthopedic surgery

BackgroundThe issue of surgical safety has increased significantly over the last few decades. Several studies have established that it is linked to non-technical performance, rather than clinical competencies. Non-technical skills can be blended with technical training in the surgical profession to improve surgeons’ abilities and enhance patient care and procedural skills. The main goal of this study was to determine orthopedic surgeons’ requirements of non-technical skills, and to identify the most pressing issues.MethodsWe conducted a self-administered online questionnaire survey in this cross-sectional study. The questionnaire was piloted, validated, pretested, and clearly stated the study’s purpose. After the pilot, minor wording and questions were clarified before starting the data collection. Orthopedic surgeons from the Middle East and Northern Africa were invited. The questionnaire was based on a five-point Likert scale, the data were analyzed categorically, and variables were summarized as descriptive statistics.ResultsOf the 1713 orthopedic surgeons invited, 60% completed the survey (1033 out of 1713). The majority demonstrated a high likelihood of participating in such activities in the future (80.5%). More than half (53%) of them preferred non-technical skills courses to be part of major orthopedic conferences, rather than independent courses. Most (65%) chose them to be face-to-face. Although 97.2% agreed on the importance of these courses, only 27% had attended similar courses in the last three years. Patient safety, infection prevention and control, and communication skills were ranked at the top as topics to be addressed. Moreover, participants indicated they would most likely attend courses on infection prevention and control, patient safety and teamwork, and team management.ConclusionThe results highlight the need for non-technical skills training in the region and the general preferences regarding modality and setting. These findings support the high demand from orthopedic surgeons’ perspective to develop an educational program on non-technical skills.

Utilizing Eye Tracking to Assess Medical Student Non-Technical Performance During Scenario-Based Simulation: Results of a Pilot Study.

Non-technical skills (NTS) are essential for safe surgical patient management. However, assessing NTS involves observer-based ratings, which can introduce bias. Eye tracking (ET) has been proposed as an effective method to capture NTS. The purpose of the current study was to determine if ET metrics are associated with NTS performance. Participants wore a mobile ET system and participated in two patient care simulations, where they managed a deteriorating patient. The scenarios featured several challenges to leadership, which were evaluated using a 4-point Likert scale. NTS were evaluated by trained raters using the Non-Technical Skills for Surgeons (NOTSS) scale. ET metrics included percentage of fixations and visits on areas of interest. Ten medical students participated. Average visit duration on the patient was negatively correlated with participants' communication and leadership. Average visit duration on the patient's intravenous access was negatively correlated with participants' decision making and situation awareness. Our preliminary data suggests that visual attention on the patient was negatively associated with NTS and may indicate poor comprehension of the patient's status due to heightened cognitive load. In future work, researchers and educators should consider using ET to objectively evaluate and provide feedback on their NTS.

Success factors of evidence-based training for pilots

Training pilots is a long-lasting and important task for the aviation safety and proper operation of airlines. Evidence-Based Training (EBT) is proposed as one of the best alternatives for pilot training. This study identified the need of EBT in terms of non-technical performance training for pilots. The purpose of this paper is to identify the need to introduce a new training system, the EBT model, and to assess and verify its performance by operating airlines to assist in decision making by airlines considering the introduction of EBT. A total of 1003 people were subjected to the study, including 557 captains and 446 co-pilots of each model who responded to the survey conducted after EBT. Results of the survey were analyzed through multiple regression analysis to confirm the validity of this model, and the pilots who were trained were also satisfied with EBT. The results show that the training program information and the system quality have a positive effect on the satisfaction of the trainee and the enhancement of the trainee's perceived ability. The results of this research contribute a positive basis for EBT. The implication of this study is that the proper provision of training program and the better system could support the performance of training for pilots.

Identifying positive and negative use of non-technical skills by anesthesiologists in the clinical operating room: An exploratory descriptive study

BackgroundTeamwork is a critical competency in high-risk settings like the operating room (OR). While conventional approaches focus on describing and learning from negative performance, there may be value in learning from high-performing behaviour, particularly in specialties where serious safety events are relatively rare. This study aimed to explore both the positive and negative use of non-technical skills by anesthesia practitioners in the OR and situate them within the clinical OR context. MethodsThis study employed a prospective observational design. Following research ethics approval, a sample of surgical cases in a tertiary hospital were recorded using the OR Black Box®. Data related to surgical phase timing, non-technical skills, team factors, and environmental factors were identified by analysts according to a modified Systems Engineering Initiative for Patient Safety model. We performed descriptive statistics and qualitative description of these observations. ResultsWe observed 25 surgical cases capturing 242 instances of positive non-technical skills among anesthesiologists in the operating room and 9 instances of negative demonstrations. Situational awareness was most frequently (n = 160) observed, followed by communication and teamwork skills (n = 82), and were most often demonstrated in the context of potential environmental distractions (e.g., doors opening, unnecessary interruptions). The least common category of positive non-technical skills observed was leadership (n = 3). ConclusionsOur findings show anesthesiologists are doing a lot “right” and there may be many opportunities for learning from positive practice in the clinical setting. These findings can inform future work to better understand and standardize best practices for non-technical performance in anesthesia.

Computer-assisted simulated workplace-based assessment in surgery: application of the universal framework of intraoperative performance within a mixed-reality simulation

ObjectivesWorkplace-based assessment (WBA) is a key requirement of competency-based medical education in postgraduate surgical education. Although simulated workplace-based assessment (SWBA) has been proposed to complement WBA, it is insufficiently adopted...

Can Different Admissions to Medical School Predict Performance of Non-Technical Skill Performance in Simulated Clinical Settings?

Non-technical skills (NTS) in medical care are essential to ensure patient safety. Focussing on applicants' NTS during medical school admission could be a promising approach to ensure that future physicians master NTS at a high level. Next to pre-university educational attainment, many selection tests have been developed worldwide to facilitate and standardise the selection process of medical students. The predictive validity of these tests regarding NTS performance in clinical settings has not been investigated (yet). Therefore, we explored the predictive validities and prognosis of the Hamburg MMI (HAM-Int), HAM-Nat, PEA, and waiting as well as other quota (as example) designated by the Federal Armed Forces) for NTS performance in clinical emergency medicine training of medical students. During 2017 and 2020, N = 729 second, third, and fourth year students were enrolled within the study. The mean age of participants was 26.68 years (SD 3.96) and 49% were female students. NTS of these students were assessed during simulation scenarios of emergency training with a validated rating tool. Students admitted via waiting quota and designated by the Armed Forces performed significantly better than students admitted by excellent PEA (p = 0.026). Non-EU students performed significantly inferior (p = 0.003). Our findings provide further insight to explain how and if admission to medical school could predict NTS performance of further physicians.

The Effect of Novel Decision Support Tools on Technical and Non-Technical Performance of Teams in Managing Emergencies.

Cognitive aids have been shown to facilitate adherence to evidence-based guidelines and improve technical performance of teams when managing simulated critical events. Few studies have explored the effect of cognitive aids on non-technical skills, such as teamwork and communication. The current study sought to explore the effects of different decision support tools (DST), a type of cognitive aid, on the technical and non-technical performance of teams. The current study represents a randomized, blinded, control trial of the effects of three versions of an electronic DST on team performance during multiple simulations of perioperative emergencies. The DSTs included a version with only technical information, a version with only non-technical information and a version with both technical and non-technical information. The technical performance of teams was improved when they used the technical DST and the combined technical and non-technical DST when compared to memory alone. The technical performance of teams was significantly worse when using the non-technical DST. All three versions of the DST had a negligible effect on the non-technical performance of teams. The technical performance of teams in the current study was affected by different versions of a DST, yet there was no effect on the teams' non-technical performance. The use of a DST, including those that focused on non-technical information, did not impact the non-technical performance of the teams.

High-Fidelity Simulation to Assess Task Load Index and Performance: A Prospective Observational Study.

Objective:The NASA Task Load Index is a questionnaire widely used in aviation. This index might help for attesting the quality of a scenario in high-fidelity simulation in healthcare. The main purpose of this study was to observe whether NASA Task Load Index for critical care-simulated scenarios, designed for residents, was consistent with the literature. The second purpose was to describe relationships between NASA Task Load Index, performance and generated stress during high-fidelity simulation.Methods:All residents in anaesthesia and intensive care undergoing high-fidelity simulation were included. The primary endpoint was the task load generated by each scenario assessed by NASA Task Load Index. Based on the literature, the NASA Task Load Index scores between 39 and 61 were considered an acceptable level. Stress level (Visual Analogue Scale) and specific technical and non-technical skills performances (Team Emergency Assessment Measure) were also assessed.Results:Totally 53 residents actively participated in 1 of 10 different scenarios, between June and December 2017. The median NASA Task Load Index score of scenarios was 61 [48-65]. Five scenarios generated acceptable task load levels. There was no association between the NASA Task Load Index score and technical or non-technical skills performance scores, but an association between NASA Task Load Index and the stress level (rho = 4.7, P = .001) was observed.Conclusion:Simulation scenarios generate different task loads for residents; the task load was deemed acceptable for half of the scenarios. The NASA Task Load Index could be considered as a tool to assess the pedagogic adequacy of scenarios. Scenario and generated stress level, but not task load, can modify residents’ performance during simulation. This should be considered when planning normative simulation.

High-fidelity hybrid simulation not only optimizes skills acquisition but improves nontechnical skills

ObjectiveKnee arthrocentesis is frequently performed as a diagnostic or therapeutic procedure. Although considered a key competency for medical doctors, most students never execute the procedure during their training. We aimed to assess technical and nontechnical skills for knee arthrocentesis through high-fidelity hybrid simulation.DesignTrainees received educational documentation prior to training. Trainees took a medical history and obtained informed consent from a patient-actor, then encountered a simulated knee to execute the procedure. We adapted a direct observation scale to assess technical and nontechnical skill performance. Personalized feedback was received after each session. Performance among trainees (learning curves) and between trainees and experts was compared using a mixed-effects model.SettingPontifical Catholic University of Chile Simulation Center.ParticipantsMedical students and general physicians were recruited for training; orthopedic surgeons were recruited as experts.ResultsTrainees significantly improved from the first session to the second and third. The third session was the learning curve plateau. Performance obtained in the third and fourth sessions were similar to expert performance. The assessment tool evaluated technical and nontechnical skills with high internal consistency and showed high interobserver reliability.DiscussionLearning curve analysis showed that high-fidelity simulation allowed trainees to become proficient in technical and nontechnical skills required to perform a safe knee arthrocentesis.Level of evidenceLevel II (prospective cohort study).

Who trains the trainers? Gamification of flight instructor learning in evidence-based training scenarios

Despite all the technological improvements currently available in aeronautical training, most accidents still have non-technical skills as contributing factors. In recent years, the International Civil Aviation Organization has been promoting a new training paradigm for crew performance that integrates all kinds of relevant skills, both technical and non-technical. The content of each training session is adapted to the specific improvement needs of each pilot, based on the data obtained in both real operations and simulations, instead of using stereotyped training scripts. This paradigm is called Evidence-Based Training. The assessment of non-technical pilot performance in these changing scenarios is complex, being highly dependent on the experience of the flight instructor. In this paper, we present a Flight Instructor Simulator that aims to gamify the learning process of instructors who have to work under this new training paradigm. A proof of concept of such an application has been created and tested by aviation personnel directly involved in this type of training. The results show that the use of gamification for flight instructors training in the assessment of pilot’s non-technical competencies is a promising line of work. Furthermore, some recommendations are extracted from this study that can serve as design guidelines for similar projects.

Implementing mindfulness meditation in hand surgery training: a feasibility study

BackgroundSurgery can be stressful, requiring decision-making and performance under pressure. The COVID-19 pandemic has further challenged surgeons’ well-being and training. Excess stress adversely affects well-being, technical and non-technical performance, and, by extension, patient care. Little emphasis has been placed on interventions to improve individual surgeons’ stress resilience despite mindfulness training being robustly linked to resilience, well-being, and improved executive function and performance. This feasibility study aimed to evaluate the effect and acceptability of a mindfulness meditation session on a group of surgical trainees during a hand fracture fixation course.MethodsAll participants of a single-day hand fracture fixation course were invited to take part in the study, and randomised into two groups. The intervention group experienced a 10-min guided meditation session before their assessment, while the control group did not. Basic demographics, inherent ‘trait’ mindfulness, change in mood, and perceived acceptability were compared between the two groups.ResultsThe 17 participants were demographically similar, as were their self-reported mood scores until after the meditation, where they diverged significantly (p < .01, t-test), with the meditation group feeling more relaxed and calm. Meditation as an intervention was considered largely acceptable.ConclusionsMindfulness meditation is established in improving stress resilience, relevant to surgeon well-being, performance, and patient care. This feasibility study suggests benefit and acceptability, and potential for further research in designing a targeted programme for surgeons, to reduce stress sensitivity, and improve performance, joy, and well-being within surgical training.Level of evidence: Level III, Therapeutic study.Supplementary InformationThe online version contains supplementary material available at 10.1007/s00238-022-01962-1.