Evaluation Of Team Performance Research Articles

Design of the safety climate thermometer to promote team dialogue in surgical teams, using a thematic literature review and international expert panel study

Abstract Introduction A safe work climate benefits patients and healthcare professionals. Most instruments for evaluating safety climate are lengthy questionnaires focusing on either measuring and benchmarking, or identifying areas for improvement. We aimed to design a communication instrument promoting team discussion about safety in surgical teams: the safety climate thermometer (SCT). Method First, a literature study was conducted to identify important safety themes, which were then organized into eight safety climate themes. Behavior-based assessment statements were drafted per theme. Second, an expert panel study with international experts was conducted, soliciting feedback on our initial SCT design. Their feedback led to a redesign into the SCT prototype presented in this study. Results The literature search yielded twelve existing instruments and three reviews. Twenty-two experts participated in the panel study. The final SCT prototype framed eight safety climate themes and is organized into two parts. In Part I, team members individually and anonymously evaluate team performance per theme by responding to a single statement to quickly assess global perceptions of that theme. Based on their collective scores, the team chooses one safety climate area to investigate further by scoring one set of eight in-depth statements. In Part II, a structured interdisciplinary team discussion takes place aiming to pinpoint a work floor issue and set actionable goals for improvement. Discussion/conclusion The SCT is a communication instrument for surgical teams that first focuses on identifying opportunities for improvement, and then structuring team discussion and follow-up, aiming to improve safety climate.

The Application of the Myers-Briggs Type Indicator to Human Resource Management System in China

Abstract: The Myers-Briggs Type Indicator has long been an important personality assessment instrument in human resource management. It helps managers to recruit employees, assign tasks, build employee relations and measure performance. With the economic reform and opening-up policy that accelerated worldwide coordination, it was introduced in China. The study, taking a literature review approach and comparative approach, aims to explore how the Myers-Briggs Type Indicator is used in Chinas human resource management system. And through the analysis of the development and status of Chinas human resource management, and the comparison with Self-directed Search and Big Five Personality Theory, to see if there is room for improvement in its use in the future. The result shows that most of the research and use of the Myers-Briggs Type Indicator in China is about recruiting. It can be developed in team building and performance evaluation in the future, like The Big Five Personality Theory. And also in assigning tasks.

Feasibility of trauma video review for the collection of medication-related information for research and quality improvement.

In an effort to expedite the publication of articles, AJHP is posting manuscripts online as soon as possible after acceptance. Accepted manuscripts have been peer-reviewed and copyedited, but are posted online before technical formatting and author proofing. These manuscripts are not the final version of record and will be replaced with the final article (formatted per AJHP style and proofed by the authors) at a later time. Trauma video review (TVR) involves reviewing video recordings of team-based trauma response to evaluate team performance, identify improvement opportunities, and assess procedures, but the feasibility of using TVR to gather medication-related information is unknown. We aimed to assess the feasibility of using TVR for data collection of medication-related variables for research and quality improvement by comparing and describing differences between TVR and electronic medical record (EMR) review. This was an observational study of level I/II trauma patients treated between November 2022 and March 2023. Patients with video recording started within 1 minute of arrival, at least 1 medication administered, and with pharmacist participation in care were included. The number of variables able to be collected by TVR or EMR review were compared and reported in the categories of medication administration, indicators of adverse drug events (ADEs), medication errors, and communication. The numbers and types of discrepancies between data collection modalities were quantified and described. Agreement between TVR and EMR review was assessed and reported as an intraclass correlation coefficient (ICC). Twenty-five patients were included; 758 and 1,011 variables collected by TVR and EMR review, respectively. In total, 689 variables were collected by both methods, and data collection modalities matched exactly in 4 of 25 patients (16%); ICC, 0.677 (moderate level of agreement). There were 46 (6.7%) discrepancies; 84% involved communication related variables. TVR missed more variables than EMR review, mostly medication errors and inability to assess ADEs but captured more communication-related variables. TVR and EMR review together offer a greater source of medication-related information for data collection compared to either alone. EMR review collected medication administration, ADE, and medication errors variables more often than TVR and TVR was better able to collect communication-related variables. When designing studies/quality improvement efforts related to medication use during trauma resuscitation (e.g., pharmacist impact on time to administration), combined data collection modalities should be used, when available.

Penerapan Root Assessment Method dan Pembobotan ROC untuk Evaluasi Kinerja Tim Penjualan

The performance of the sales team is one of the important indicators of a company's success, which is measured through the achievement of sales targets, negotiation skills, and efficiency in managing customer relationships. Problems in the appraisal of sales team performance often arise due to various factors that affect objectivity and fairness in evaluation. One of the main problems is the lack of consistent assessment standards, where each team member may be assessed with different assessment opinions, leading to bias in evaluation results. The application of the Root Assessment Method and ROC Weighting in the performance evaluation of the sales team is an innovative and effective approach to improve productivity and team performance. The combination of these two methods not only facilitates in-depth analysis of individual and team performance, but also supports strategic decision-making in the continuous development and improvement of sales team capabilities. The results of the sales team's performance evaluation assessment ranking, Team J ranked first with a final score of 4.3981, showing the most superior performance among the entire team. In second place, Team G obtained a score of 4.388, followed by Team D in third place with a score of 4.3752. These results provide a comprehensive picture of each team's performance rankings, with Team J showing top performance, while Team F needs further improvement.

Assessing Team Performance in a Longitudinal Neonatal Resuscitation Simulation Training Program: Comparing Validity Evidence to Select the Best Tool.

Introduction Neonatal resuscitation is a high-acuity, low-occurrence event that requires ongoing practice by interprofessional teams to maintain proficiency.Simulation provides an ideal platform for team training and evaluation of team performance. Our simulation center supports a longitudinal in situ simulation training program for delivery room teams. In addition to adherence to the Neonatal Resuscitation Program standards, team performance assessment is an essential component of program evaluation and participant feedback. Multiple published teamwork assessment tools exist. Our objective was to select the tool with the best validity evidence for our program's needs. Methods We used Messick's framework to assess the validity of evidence for potential teamwork assessment tools. Four possible tools were identified from the literature: the Mayo High Performance Teamwork Scale (Mayo), Team Performance Observation Tool (TPOT), Clinical Teamwork Scale (CTS), and Team Emergency Assessment Measure (TEAM). Relevant context included team versus individual focus, external evaluator versus self-evaluation, and ease of use (which included efficiency, clarity of interpretation, and overall assessment). Three simulation experts identified consensus anchors for each tool and independently reviewed and scored 10 pre-recorded neonatal resuscitation simulations. Raters assigned each tool a rating according to efficiency, ease of interpretation, and completeness of teamwork assessment. Interrater reliability (IRR) was calculated using intraclass correlation for each tool across the three raters. Average team performance scores for each tool were correlated with neonatal resuscitation adherence scores for each video using Spearman's rank coefficient. Results There was a range of IRR between the tools, with Mayo having the best (single 0.55 and multi 0.78). Each of the three raters ranked Mayo optimally in terms of efficiency (mean 4.66 + 0.577) and ease of use (4+1). However, TPOT and CTS scored highest (mean 4.66 ± 0.577) for overall completeness of teamwork assessment. There was no significant correlation to NRP adherence scores for any teamwork tool. Conclusion Of the four tools assessed, Mayo demonstrated moderate IRR and scored highest for its ease of use and efficiency, though not completeness of assessment. The remaining three tools had poor IRR, which is not an uncommon problem with teamwork assessment tools. Our process emphasizes the fact that assessment tool validity is contextual. Factors such as a relatively narrow (and high) performance distribution and clinical context may have contributed to reliability challenges for tools that offered a more complete teamwork assessment.

A Comparative Evaluation of Ad Hoc Team Performance, Effectiveness, and Interactions in Modern Collaborative Technology

The current study utilizes a mixed-method approach to investigate the efficacy and affordances of three modern collaborative technologies (Slack, Google Hangouts, and Microsoft Teams). Distributed teams of three participants collaborated to plan a simulated trip with various requirements using one of three modern collaborative technologies (Slack, Google Hangouts, Microsoft Teams). The study elicited team performance, perceived platform usability, and qualitative focus group data. Quantitative results show that Microsoft Teams resulted in significantly worse team performance than Slack and Google Hangouts; additionally, only Slack was positively associated with its usability and team members’ perceptions of team effectiveness. Two themes were identified regarding how these technologies afforded and shaped team practices and social interactions: (a) technology leads to a loosely defined (or no) leadership, and (b) technology promotes the sense of team and trust in ad hoc teams performing fast-paced and time-sensitive tasks.

The Influence of Educational Background and Work Experience on Employee Work Ethic

Human resources play the most important and potential role in the success of a company. Therefore, in order to make a greater contribution to the Company, human resources must be managed well. Educational background and work experience of employees are factors that influence work ethic. This research aims to examine the influence of educational background and work experience on employee work ethic. The sample used in this research is a purposive sample, the sample in this research is 39 employees. The data collection technique used is a questionnaire. The results of this research test are that educational background has a positive effect on work ethic, work experience has a positive effect on work ethic. Simultaneously, educational background and work experience have a positive effect on work ethic. Managerial implications that may arise are human resource planning, recruitment and selection processes, employee development and team management, performance evaluation and organizational culture development.

The influence of meteorological factors on the technical performance of football teams during matches.

This study explored the impact of the meteorological factors air temperature, relative humidity, and wind speed on teams' technical performance during the Union of European Football Associations Champions League (UCL). Technical match statistics were collected for five seasons (2016/2017-2020/2021). Thirty-one technical actions and events were categorized into three groups (goal scoring, offense, and defence). Meteorological data were collected from the official UEFA website (air temperature (°C): 11.59 ± 6.87, relative humidity (%): 71.40 ± 17.82, wind speed (km/h): 11.52 ± 7.02). LASSO regression analysis was employed to identify important indicators that affect match outcomes, while separate Poisson regression models were used in generalized linear modelling to determine the effects of meteorological factors on key technical performance indicators. The results revealed that offensive variables were instrumental in distinguishing match outcomes (winning, drawing, and losing), with meteorological factors significantly influencing these variables. Notably, "shot from counter attack" was the most significantly affected variable, being exclusively influenced by air temperature (OR = 0.55, 95% CI: 0.30 to 0.98). Two technical indicators, "dribbles won" and "shots from the 6-yard box," were both significantly influenced by two meteorological factors. "Cards per foul," an understudied variable, displayed a close association with all the three meteorological factors. These findings offer valuable insights for coaches and analysts in comprehending the influence of meteorological conditions on crucial technical variables during the performance evaluation of teams. Moreover, they provide valuable information to help coaches devise appropriate tactics for players before or during a match, considering the potential changes in meteorological conditions.

Winning With Chaos in Association Football: Spatiotemporal Event Distribution Randomness Metric for Team Performance Evaluation

Winning With Chaos in Association Football: Spatiotemporal Event Distribution Randomness Metric for Team Performance Evaluation

Being at one with each other: leader–follower (in)congruence in transformational leadership and team performance

PurposeThe purpose of this study is to examine the impact of the (in)congruence between team leader self-evaluation and follower evaluation about the leader's transformation leadership (TL) on team performance, as well as the conditions under which the impact can be strengthened or weakened.Design/methodology/approachThis study adopts a survey method to collect data from matched sales team leaders and sales team members in 81 teams. A multi-level polynomial regression analysis was conducted.FindingsTeam performance was higher in teams with balanced or high TL than with balanced or low TL. Among the teams with incongruence, no difference was found between leader underestimation and leader overestimation. TL congruence plays a moderating role in the relationship between team follower evaluation of TL and team performance, such that the relationship is stronger when team leader self-evaluation and follower evaluation are congruent than incongruent.Originality/valueThis study extends the authors' current understanding of TL literature by combining and contrasting the different perceptions of TL from both the leaders themselves and the followers towards leaders. The findings highlight the importance of congruence versus incongruence rather than just the high or low levels of follower TL evaluation. It provides a more complete understanding of the TL and team performance relationship than the traditional view that promotes a linear relationship between TL and performance.

A machine learning framework for quantifying in-game space-control efficiency in football

Analysis of player tracking and event data in football matches is used by the coaching staff to evaluate team performance and to inform tactical decision-making, whereas using Machine Learning methods to gain useful insights from the data is still an open research question. The objective of our research is to discover the football team's space-control efficiency using a novel Machine Learning approach and evaluate the team performance based on its space-control efficiency. We develop a novel Possession Evaluation Model through deep generative machine learning to predict the football team's space-control capability utilising tracking and event data. The developed model is used to quantify the efficiency of attacking and defending for a given sequence of play. Performance analysis results demonstrate that this novel method of space-control efficiency quantification is objective and precise. The superior performance of the model is attributed to the utilization of deep generative modelling on image datasets and conditioning in the prediction with contextual factors. This study presents a novel approach to football analysis in evaluating team performance and providing tactical insights for the coach to make data-informed adjustments.

Performance Evaluation of Oral Health Teams in Brazil: An Item Response Theory Approach

Access to quality healthcare is an essential component of health policy. This cross-sectional study describes the actions performed by Brazilian Oral Health Teams (OHTs) analyzed in the National Program for Improving Access and Quality of Primary Care and the relationship of contextual aspects. A total of 22,993 OHTs that participated in the third cycle of the referred program were evaluated using a structured questionnaire. Thirteen procedures (items) related to spontaneous dental care and preventive, surgical, restorative, prosthetic, and oral cancer prevention or diagnosis were assessed. Item response theory was used to estimate the performance scores of OHTs, based on 13 items. The relationship between performance scores and contextual variables in Brazilian regions was analyzed by thematic maps and Spearman correlation (p < 0.05). The highest difficulty parameters were for questions related to prosthetics (b = 0.879) and actions for oral cancer (b = 2.922). The 13 items were more appropriate to discriminate the teams with lower performance and relatively ineffective in differentiating those with better performance. A direct relationship with the Human Development Index (rs = 0.249; p = 0.004) and an indirect relationship with the Gini Index (rs = −0.482; p < 0.001) were found. Contextual aspects presented a relationship with the performance of the Brazilian OHTs. The evaluated items showed some potential to discriminate the performance of OHTs since many of the evaluated dental procedures are performed by most of the teams.

Exploring objective measures for assessing team performance in healthcare: an interview study

IntroductionEffective teamwork plays a critical role in achieving high-performance outcomes in healthcare. Consequently, conducting a comprehensive assessment of team performance is essential for providing meaningful feedback during team trainings and enabling comparisons in scientific studies. However, traditional methods like self-reports or behavior observations have limitations such as susceptibility to bias or being resource consuming. To overcome these limitations and gain a more comprehensive understanding of team processes and performance, the assessment of objective measures, such as physiological parameters, can be valuable. These objective measures can complement traditional methods and provide a more holistic view of team performance. The aim of this study was to explore the potential of the use of objective measures for evaluating team performance for research and training purposes. For this, experts in the field of research and medical simulation training were interviewed to gather their opinions, ideas, and concerns regarding this novel approach.MethodsA total of 34 medical and research experts participated in this exploratory qualitative study, engaging in semi-structured interviews. During the interview, experts were asked for (a) their opinion on measuring team performance with objective measures, (b) their ideas concerning potential objective measures suitable for measuring team performance of healthcare teams, and (c) their concerns regarding the use of objective measures for evaluating team performance. During data analysis responses were categorized per question.ResultsThe findings from the 34 interviews revealed a predominantly positive reception of the idea of utilizing objective measures for evaluating team performance. However, the experts reported limited experience in actively incorporating objective measures into their training and research. Nevertheless, they identified various potential objective measures, including acoustical, visual, physiological, and endocrinological measures and a time layer. Concerns were raised regarding feasibility, complexity, cost, and privacy issues associated with the use of objective measures.DiscussionThe study highlights the opportunities and challenges associated with employing objective measures to assess healthcare team performance. It particularly emphasizes the concerns expressed by medical simulation experts and team researchers, providing valuable insights for developers, trainers, researchers, and healthcare professionals involved in the design, planning or utilization of objective measures in team training or research.

Expected goals in football: Improving model performance and demonstrating value.

Recently, football has seen the creation of various novel, ubiquitous metrics used throughout clubs' analytics departments. These can influence many of their day-to-day operations ranging from financial decisions on player transfers, to evaluation of team performance. At the forefront of this scientific movement is the metric expected goals, a measure which allows analysts to quantify how likely a given shot is to result in a goal however, xG models have not until this point considered using important features, e.g., player/team ability and psychological effects, and is not widely trusted by everyone in the wider football community. This study aims to solve both these issues through the implementation of machine learning techniques by, modelling expected goals values using previously untested features and comparing the predictive ability of traditional statistics against this newly developed metric. Error values from the expected goals models built in this work were shown to be competitive with optimal values from other papers, and some of the features added in this study were revealed to have a significant impact on expected goals model outputs. Secondly, not only was expected goals found to be a superior predictor of a football team's future success when compared to traditional statistics, but also our results outperformed those collected from an industry leader in the same area.

Measuring the Technical Efficiency of Hockey Players: Empirical Evidence from Czech Hockey Competition

Ice hockey is a very popular sport in the Czech Republic. Nowadays, hockey player efficiency analysis is a useful tool that helps sports managers with player selection, team composition and team performance evaluation. The literature offers only a limited number of scientific studies that deal with the evaluation of the efficiency of hockey players or clubs. The aim of this research is to use data envelopment analysis to help Czech hockey clubs, managers and coaches to evaluate the efficiency of their players. This research evaluates the technical efficiency of Czech hockey players using three data envelopment analysis models, ranks the best players based on their super-efficiency scores, and then tries to uncover the main sources of player inefficiency. The models are empirically applied to players playing in the Tipsport extraliga in the 2021/22 season. The evaluation used in this paper attempts to incorporate greater objectivity into decision making and thus may be an important step in developing a systematic methodology for evaluating hockey players.

Physiological Synchrony Predict Task Performance and Negative Emotional State during a Three-Member Collaborative Task.

Evaluation of team performance in naturalistic contexts has gained popularity during the last two decades. Among other human factors, physiological synchrony has been adopted to investigate team performance and emotional state when engaged in collaborative team tasks. A variety of methods have been reported to quantify physiological synchrony with a varying degree of correlation with the collaborative team task performance and emotional state, reflected in the inconclusive nature of findings. Little is known about the effect of the choice of synchrony calculation methods and the level of analysis on these findings. In this research work, we investigate the relationship between outcomes of different methods to quantify physiological synchrony, emotional state, and team performance of three-member teams performing a collaborative team task. The proposed research work employs dyadic-level linear (cross-correlation) and team-level non-linear (multidimensional recurrence quantification analysis) synchrony calculation measures to quantify task performance and the emotional state of the team. Our investigation indicates that the physiological synchrony estimated using multidimensional recurrence quantification analysis revealed a significant negative relationship between the subjectively reported frustration levels and overall task performance. However, no relationship was found between cross-correlation-based physiological synchrony and task performance. The proposed research highlights that the method of choice for physiological synchrony calculation has direct impact on the derived relationship of team task performance and emotional states.

Partially constrained group variable selection to adjust for complementary unit performance in American college football

Given the importance of accurate team rankings in American college football (CFB) – due to heavy title and playoff implications – strides have been made to improve metrics for team performance evaluation, going from basic averages (e.g. points scored per game) to metrics that adjust for a team's strength of schedule, but one aspect that's yet to be accounted for is the ability of team's offense and defense to complement one another, termed ‘complementary football’. American football is unique because the same team's offensive and defensive units typically consist of separate player sets that don't share the field simultaneously, which tempts one to evaluate them independently. Yet, some aspects of your team's defensive (offensive) performance may directly impact the complementary unit, e.g. turnovers forced by your defense could lead to easier scoring chances for your offense. Our main goal is to identify the most consistently influential features of complementary football in a data-driven way, subsequently adjusting each team's offensive (defensive) performance for that of their complementary unit. To achieve that, for the 2009–2019 CFB seasons, we incorporate natural splines with group penalty approaches, conducting partially constrained optimization to guarantee the full adjustment for the strength of schedule and home-field factor.

Play the Game: Evaluation of Psychological Capital, Emotional Intelligence, and Virtual Team Performance among Online Gaming Teams

Virtual teams are becoming ubiquitous with the contemporary work environment. Shutdowns due to the COVID-19 pandemic necessitated many to reconceive the workplace whereby people accomplished work no longer located in immediate proximity, leading many teams to engage online in virtual spaces. Even in a post-lockdown world, virtual teams have remained widely used within the workplace. Online gaming has exploded in popularity, it allows people to interact with others from across the world. Numerous parallels exist between online gaming teams and problem-solving teams often used in the contemporary workplace: 1) pursuing a shared goal; 2) identifying member roles; and 3) collaborating together to accomplish a task. The purpose of our research is to examine the role that psychological capital and emotional intelligence play in team success within an online gaming team challenge. Participants will compete in an online video game event, where their goal, as a 6-player team, is to solve a set of challenges within 24 hours. The researchers will conduct a content analysis of participant recordings from the event. Findings and implications will be discussed. Understanding member interaction among online gaming teams has potential implications for how workplace teams can interact more effectively together.

Analysis of higher education management strategy based on entropy and dissipative structure theory

Abstract In order to explore the analysis of educational management strategies in Colleges and universities, a method based on entropy and dissipative structure theory is proposed. Firstly, we determine the connection length B, which refers to the shortest path between two elements in the structure diagram. The length of direct connection is 1, and the length of each transfer is added by 1. Secondly, calculate the total number of microscopic states of the system, A 1, A 1 = ∑∑ Lab, Third, calculate the probability value of the realization of the micro state of each connection: P ( a , b ) = L a b A a P\left( {a,b} \right) = {{{L_{ab}}} \over {{A_a}}} . Finally, the entropy of organizational structure between any two elements of the system at the same level vertically and horizontally is calculated: H 1(ab) = −Pa (ab)lnPa (ab). The experimental results show that student satisfaction is considered to be an important dimension of management team performance evaluation. Through the survey of student satisfaction, it is found that the student satisfaction rate of two teams is 100%, the student satisfaction rate of two teams is 99%, and the satisfaction rate of one team is 98.5%, which shows that the management team has good performance. It is proved that the theory of entropy and dissipative structure can effectively improve the educational management strategy of colleges and universities.

Performance evaluation of teams in business simulation games with weight restricted data envelopment analysis models

Business simulation games are widely used in higher education, management training, and executive management development programmes. The evaluation of the performance of participants is generally subjective and is based on the trainer's perception of the importance of several evaluation criteria. In this paper, data envelopment analysis (DEA) is proposed for such evaluation. Input-oriented constant return-to-scale DEA models are used for evaluating the performance of teams participating in business simulation games. A car engine manufacturing game played by MBA master students is used to illustrate the proposed method. Weight restrictions are applied to obtain efficiency scores which can be used as an alternative to financial measures. The relationship between the efficiency measure and the financial measure is statistically analysed. The main conclusion of the presented research is that if weight restriction parameters are properly set, DEA results can provide reliable and detailed information about participants' performance, about the shortcomings of decisions made during the games, and about possible ways to improve performance.