Assessment Of Skills Research Articles

A STUDY ON ROLE OF HRM PRACTICES OF EMPLOYEE PERFORMANCE IN LARSEN & TOUBRO CONSTRUCTION

The project conducted at L&T Construction aimed to understand employee views on HRM practices impacting employee performance. It examined key areas such as Recruitment and Selection, Training and Development, Performance Appraisal, Compensation, Employee Benefits and Employee Engagement Initiatives. The primary goal was to analyze how these HRM practices influence performance within Larsen and Toubro Construction. Secondary objectives included evaluating employee perceptions of the recruitment process, average selection time and talent acquisition effectiveness. Surveys were administered to L&T Construction employees in Chennai, with primary data collected via questionnaires. Secondary data was gathered from various sources. Analysis involved percentage analysis, correlation analysis, chi square tests and ANOVA using SPSS software. Results revealed that L&T utilizes several methods like merit-based systems, campus interviews, talent searches, consultancy services, language proficiency and job specific skills assessments to enhance employee performance. The study will offer recommendations based on the findings. Keywords: HRM Practices, Employee Performance, Analysis.

Development and acceptability of a culturally competent skills and knowledge assessment tool for patients with diabetes mellitus

BackgroundPatients newly diagnosed with type 2 diabetes mellitus (DM) and newly prescribed insulin need to learn essential self-care and management skills quickly. To optimize teaching, clinicians need to assess a patient’s basic understanding of DM and their skills. While DM patient assessments exist, this study reports the development of an assessment of patient DM management skills and knowledge, using feedback from DM clinicians, patients, and caregivers. Research Design and MethodsA systematic search of Pubmed/Medline and Scopus (1980–2017) of DM knowledge assessments was performed. Twenty-four studies were identified. Content from the existing assessments was adapted to create a 12 item DM-Skills Knowledge Assessment (SKA) to assess a patient’s DM management skills and knowledge. To assess cultural humility, modified cognitive interviews were conducted in individual user sessions and semi-structured focus groups. Audio-transcripts of the interviews/focus groups were independently coded, and codes were grouped into key themes. Participant demographic characteristics were assessed. ResultsFive focus groups and eleven key informant interviews were conducted, including 10 DM clinicians, 12 patients/caregivers, and 15 laypersons. All 10 clinicians reported that the DM-SKA addresses the key domains of DM education deemed to be of highest importance during the transition from hospital to home and that their patients would be willing to complete the assessment. More than half of the patient/caregiver/layperson participants self-reported race/ethnicity other than non-Hispanic white and performed similarly to non-Hispanic white participants in understanding each item, willingness to complete the DM-SKA, and perception that family or community members would be willing to complete the DM-SKA. The DM-SKA has a baseline Flesch reading score of 81.3, indicating low complexity language. ConclusionDM clinicians agreed that the DM-SKA assesses all essential DM management skills. For patients/caregivers, it has acceptable literacy, cognitive validity, and culturally acceptable for racial/ethnic minority populations in the study, including elderly persons.

Exploring the Impact of the Integrated Think-Pair Share and Active Learning Management on Non-Credentialed Teacher Learning Assessment Competency

This study investigates the effectiveness of an integrated approach combining think-pair share and active learning management in enhancing non-credentialed teachers' assessment competency and compares their learning achievement in educational assessment across pre, post, and delayed examination phases. Utilizing a one-group experimental design, 29 participants were selected through cluster sampling. Instruments included an integrated think-pair-share and active learning management system, along with assessments evaluating participants' assessment knowledge, skills, and attributes. Data analysis involved mean scores, standard deviation, effectiveness index (E1/E2), One - way repeated measure ANOVA, and pairwise comparisons. Results indicate that the integrated learning management plan effectively facilitated teaching assessment competency to non-credentialed teachers at the graduate level, leading to the attainment of expected learning levels within the class. Additionally, it significantly enhanced participants' competency compared to their baseline levels, with sustained effectiveness demonstrated over time.

The underlying neuropsychological and neural correlates of the impaired Chinese reading skills in children with attention deficit hyperactivity disorder.

Impaired basic academic skills (e.g., word recognition) are common in children with Attention Deficit Hyperactivity Disorder (ADHD). The underlying neuropsychological and neural correlates of impaired Chinese reading skills in children with ADHD have not been substantially explored. Three hundred and two children with ADHD (all medication-naïve) and 105 healthy controls underwent the Chinese language skill assessment, and 175 also underwent fMRI scans (84 ADHD and 91 controls). Between-group and mediation analyses were applied to explore the interrelationships of the diagnosis of ADHD, cognitive dysfunction, and impaired reading skills. Five ADHD-related brain functional networks, including the default mode network (DMN) and the dorsal attention network (DAN), were built using predefined regions of interest. Voxel-based group-wise comparisons were performed. The ADHD group performed worse than the control group in word-level reading ability tests, with lower scores in Chinese character recognition (CR) and word chains (WS) (all P < 0.05). With full-scale IQ and sustained attention in the mediation model, the direct effect of ADHD status on the CR score became insignificant (P = 0.066). The underlying neural correlates for the orthographic knowledge (OT) and CR differed between the ADHD and the control group. The ADHD group tended to recruit more DMN regions to maintain their reading performance, while the control group seemed to utilize more DAN regions. Children with ADHD generally presented impaired word-level reading skills, which might be caused by impaired sustained attention and lower IQ. According to the brain functional results, we infer that ADHD children might utilize a different strategy to maintain their orthographic knowledge and character recognition performance.

Multi-informant Assessment of Organizational Skills: Psychometric Characteristics of the Children’s Organizational Skills Scale (COSS)

AbstractOrganization, time management, and planning (OTMP) skills are behavioral manifestations of executive functioning linked to academic outcomes. Interventions to improve OTMP skills have shown favorable outcomes. The Children’s Organizational Skills Scale parent and teacher forms (COSS-P, COSS-T) are widely used for assessing OTMP skills, but there is limited research on this scale. This study examined the factor structure and construct validity of the COSS in a non-clinical and clinical sample of students in grades 2–8 (Study 1; n = 1138 COSS-T; 1155 COSS-P), and teacher-referred students with OTMP deficits in grades 3–5 (Study 2; n = 184). In Study 1, a bifactor model with a general factor and three subfactors demonstrated good fit for the COSS-P (RMSEA = .057) and COSS-T (RMSEA = .052). This model was replicated in Study 2. The general factor on both versions demonstrated an acceptable to high level of internal reliability. An acceptable degree of reliability was also identified for subfactor 1 (Task Planning). The COSS was shown to be effective in differentiating children with ADHD from a comparison group drawn primarily from the non-clinical sample (AUC = .84 COSS-P; .85 COSS-T). Sex differences of medium magnitude were identified on the total score of both COSS versions. Correlations between the COSS-P and COSS-T were variable across samples. The findings provide strong evidence for using the total score on the COSS-P and COSS-T as an index of overall OTMP skills deficits. Given variable cross-informant correlations on the COSS, multi-informant assessment of OTMP skills is strongly indicated.

Skill assessment and sources of predictability for the leading modes of sub-seasonal Eastern Africa short rains variability

Skill assessment and sources of predictability for the leading modes of sub-seasonal Eastern Africa short rains variability

Development and psychometric evaluation of a Total Worker Health® practice scale.

Occupational Safety and Health (OSH) professionals increasingly need to assess and mitigate a broad scope of worker safety, health, and well-being concerns that extend beyond traditional OSH training curricula. Work-related and non-work-related psychosocial hazards, chronic physical and mental health conditions, and changing work arrangements call for an integrative, public health approach to occupational risk management; this approach has been called, "Total Worker Health®" by United States public health authorities (Schulte et al. 2019). OSH professionals need education to ensure that Total Worker Health (TWH) practice approaches are consistently and effectively applied. This study sought to develop a valid, reliable scale that could be used to assess TWH skills gaps that can be addressed with tailored, competency-based curricula. We developed a survey scale to assess professional competency for specific TWH practice approaches described in prior literature (Lee et al. 2016; Punnett et al. 2020). The scale contained 11 statements and used a 5-point scale (not skilled to highly skilled) to rate the level of competency. We pre-tested and refined the statements for face validity then administered the scale with a convenience sample of 258 professionals from mixed OSH disciplines. A total of 210 OSH professionals (31% safety, 17% industrial hygiene, 12% occupational nurses, 11% occupational physicians, 29% other) who completed 50% or more of the questions were included in the analysis. Scale reliability was assessed with a Cronbach's alpha test. Scale validity and structure were assessed with exploratory factor analysis (EFA). The 11-item scale had high internal consistency (Cronbach's α = 0.92). The initial EFA solution suggested 2 factors that explained 65.3% of variance, with one cross-loaded question. A final 10-item, 2-factor scale was developed that accounted for 66.0% of variance with no cross-loaded items (Cronbach's alpha α = 0.91). Factor 1 (6 items) contributed to 55.5% of the variance and captured skills related to TWH program leadership (e.g. leader commitment, integrating program systems, engaging with other program leaders and workers). Factor 2 (4 items) contributed to 10.5% of the variance and captured technical skills related to hazard identification and control (e.g. identifying hazards, designing work to reduce hazards). Internal consistency was very good for both TWH program leadership (Cronbach α = 0.89) and TWH risk assessment and control (Cronbach α = 0.80) subscales. A novel 10-item TWH skill scale to assess specific TWH practice approaches was developed with very good reliability. Factor analysis revealed 2 latent constructs: TWH leadership skills and TWH risk assessment and control skills. This study offers an evidence-based tool to assess competency for specific TWH practices among OSH professionals. The results of this study contribute to the broader research base needed to formalize a TWH competency framework, as advocated by other scholars interested in TWH workforce education (Newman et al. 2020).

Examining Coping Skills, Anxiety, and Depression Dynamics Amidst the COVID-19 Pandemic

This cross-sectional study, conducted amid the COVID-19 pandemic, delves into the intricate connections between coping strategies and levels of anxiety and depression, presenting vital implications for medical, clinical, and broader societal contexts. As crises like the pandemic highlight the importance of adaptive coping, this investigation underscores the imperative to comprehend and address maladaptive coping strategies. The study utilized a diverse sample of 386 participants during the pandemic's peak, employing online platforms for recruitment and ensuring broad demographic representation. Data were collected through self-report measures, including the Patient Health Questionnaire-4 (PHQ-4) for depression and anxiety symptoms and the Brief Coping Orientation to Problems Experienced (COPE) inventory to assess coping skills across various domains. The coping skills assessment measured strategies such as Self-Distraction, Active Coping, Denial, Substance Use, Emotional and Instrumental Support, Behavioral Disengagement, Venting, Positive Reframing, Planning, Humor, Acceptance, Religion, and Self-Blame. The Colorado Multiple Institutional Review Board prioritized and approved ethical considerations, and participants provided informed consent. Data analysis involved rigorous cleaning, recoding, and quantitative analysis using SPSS. Descriptive statistics, regression analyses, and correlation analyses were employed to uncover nuanced relationships between coping strategies and mental health outcomes, contributing to understanding the phenomena under investigation within the context of the pandemic. The findings highlight the pivotal role of individualized approaches and the potential of humor as an essential coping mechanism, emphasizing the need for tailored interventions during crises.

Quantitative assessment and objective improvement of the accuracy of neurosurgical planning through digital patient-specific 3D models.

Neurosurgical patient-specific 3D models have been shown to facilitate learning, enhance planning skills and improve surgical results. However, there is limited data on the objective validation of these models. Here, we aim to investigate their potential for improving the accuracy of surgical planning process of the neurosurgery residents and their usage as a surgical planning skill assessment tool. A patient-specific 3D digital model of parasagittal meningioma case was constructed. Participants were invited to plan the incision and craniotomy first after the conventional planning session with MRI, and then with 3D model. A feedback survey was performed at the end of the session. Quantitative metrics were used to assess the performance of the participants in a double-blind fashion. A total of 38 neurosurgical residents and interns participated in this study. For estimated tumor projection on scalp, percent tumor coverage increased (66.4 ± 26.2%-77.2 ± 17.4%, p = 0.026), excess coverage decreased (2,232 ± 1,322 mm2-1,662 ± 956 mm2, p = 0.019); and craniotomy margin deviation from acceptable the standard was reduced (57.3 ± 24.0 mm-47.2 ± 19.8 mm, p = 0.024) after training with 3D model. For linear skin incision, deviation from tumor epicenter significantly reduced from 16.3 ± 9.6 mm-8.3 ± 7.9 mm after training with 3D model only in residents (p = 0.02). The participants scored realism, performance, usefulness, and practicality of the digital 3D models very highly. This study provides evidence that patient-specific digital 3D models can be used as educational materials to objectively improve the surgical planning accuracy of neurosurgical residents and to quantitatively assess their surgical planning skills through various surgical scenarios.

A prospective randomized comparative study of effectiveness of simulation-based training in improving the performance of non-technical skill among postgraduate students during anaesthesia crisis resource management

Background Non-technical skills are pivotal in ensuring patient safety during anaesthesia crisis resource management. Simulation-based training has emerged as a promising educational approach for enhancing these skills. This study protocol outlines a prospective randomised comparative study aimed at assessing the impact of simulation-based training on the performance of anaesthesia residents during anaesthesia crisis resource management, with a focus on task management, teamwork, situational awareness, and decision-making skills, using the Assessment of Non-Technical Skills (ANTS) scoring system. Methods Anesthesia residents in postgraduate years 1 and 2 from the Department of Anesthesia at Acharya Vinoba Bhave Rural Hospital will be included as study participants. Informed consent will be obtained, and no exclusion criteria will be applied. Participants will undergo an orientation session covering essential crisis management and simulation knowledge. The study will employ advanced simulation equipment, including a Human Patient Simulator (HPS) mannequin, an anaesthesia machine, and a simulated operating room. Faculty members have selected six distinct perioperative emergency scenarios for simulation sessions. Participants will be grouped in pairs and exposed to three scenarios during each session. Debriefing and feedback will follow each scenario, reinforcing non-technical skills. Experienced staff anesthesiologists, trained in the Assessment of Non-Technical Skills (ANTS) scoring system, will serve as assessors to evaluate participant performance. Expected outcomes Data collected will include ANTS scores, debriefing feedback, and post-test results. Statistical analysis will be employed to assess the effectiveness of simulation-based training in enhancing non-technical skills among anaesthesia residents during anaesthesia crisis resource management.

Structured feedback and operative video debriefing with critical view of safety annotation in training of laparoscopic cholecystectomy: a randomized controlled study.

The learning curve in minimally invasive surgery (MIS) is lengthened compared to open surgery. It has been reported that structured feedback and training in teams of two trainees improves MIS training and MIS performance. Annotation of surgical images and videos may prove beneficial for surgical training. This study investigated whether structured feedback and video debriefing, including annotation of critical view of safety (CVS), have beneficial learning effects in a predefined, multi-modal MIS training curriculum in teams of two trainees. This randomized-controlled single-center study included medical students without MIS experience (n = 80). The participants first completed a standardized and structured multi-modal MIS training curriculum. They were then randomly divided into two groups (n = 40 each), and four laparoscopic cholecystectomies (LCs) were performed on ex-vivo porcine livers each. Students in the intervention group received structured feedback after each LC, consisting of LC performance evaluations through tutor-trainee joint video debriefing and CVS video annotation. Performance was evaluated using global and LC-specific Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores. The participants in the intervention group had higher global and LC-specific OSATS as well as global and LC-specific GOALS scores than the participants in the control group (25.5 ± 7.3 vs. 23.4 ± 5.1, p = 0.003; 47.6 ± 12.9 vs. 36 ± 12.8, p < 0.001; 17.5 ± 4.4 vs. 16 ± 3.8, p < 0.001; 6.6 ± 2.3 vs. 5.9 ± 2.1, p = 0.005). The intervention group achieved CVS more often than the control group (1. LC: 20 vs. 10 participants, p = 0.037, 2. LC: 24 vs. 8, p = 0.001, 3. LC: 31 vs. 8, p < 0.001, 4. LC: 31 vs. 10, p < 0.001). Structured feedback and video debriefing with CVS annotation improves CVS achievement and ex-vivo porcineLC training performance based on OSATS and GOALS scores.

Assessment of adults with low literacy skills: a review of methods

The paper reviews the methods for assessing different components of reading skills in adults with reading difficulties, along with functional reading skills. We are particularly interested in the assessment methods available to researchers and practitioners, developed predominantly in the research context, and not available solely in English. We discuss the large-scale international study, PIAAC, as an example of a framework for such assessments. Furthermore, we cover the following types of assessment tools: (1) self-assessment questionnaires, probing into comprehension difficulties and reading habits; (2) measures of print exposure, such as author recognition tests, correlating with other reading-related skills; (3) measures of word recognition and decoding, including reading aloud of words and pseudowords, as well as silent lexical decision tasks; (4) fill-in-the-blank tasks and sentence reading tasks, measuring predominantly local comprehension, entangled with decoding skills; (5) comprehension of longer reading passages and texts, focusing on functional texts. We discuss comprehension types measured by tests, text types, answer formats, and the dependence problem, i.e., reading comprehension tests that can be solved correctly without reading. Finally, we tap into the new ideas emerging from the AI systems evaluation, e.g., using questions generated from news articles or Wikipedia or asked directly by search engines users. In the concluding section, we comment on the significance of incorporating background information, motivation, and self-efficacy into the assessment of adult literacy skills.

Therapeutic radiographer prescribing practices in the United Kingdom: Questionnaire survey

IntroductionNon-medical professionals in the United Kingdom (UK) have been granted prescribing rights to improve patient care quality and cost-effectiveness. There is limited evidence on how therapeutic radiographer prescribers have impacted medicine management or patient services. MethodsAn online survey was conducted amongst non-medical prescribing therapeutic radiographers in the UK between 2019 and 2022. The study teams initially analysed the individual data sets, subsequently combined, and secondary analysis was performed to provide a UK perspective, to understand the services provided and identify areas for improvement. Data was analysed using descriptive statistics from Microsoft Excel® and SPSS®. Results74 non-medical prescribing therapeutic radiographers who were predominantly over 40 years old and in full-time work participated. The main job categories were consultant radiographers (n = 23, 31.1%) and advanced practice practitioners (n = 18, 24.3%). Many use their prescribing qualifications (87.5%, n = 62), issuing a mean of 15 independent and seven items by supplementary and prescribing per week. Most received assessment and diagnostic skills training before prescribing courses (91.6%, n = 67). Respondents prescribed from a median of six areas, with the highest being in GI (82%), skin (68%), infections (58%), urinary tract disorders (55%) and ear, nose, and oropharynx conditions (54%). ConclusionThis study presents the first report on therapeutic radiographers prescribing in the UK, offering insights into current practices and highlighting the success of non-medical prescribing. Therapeutic radiographers’ roles continue to expand into advanced practice and medicine-prescribing responsibilities, contributing to holistic and patient-centred care. Implications for practiceThe results are relevant for nations grappling with oncology workforce shortages and contemplating similar roles for therapeutic radiographers. The study can be a valuable resource for policymakers and healthcare organisations worldwide.

An Integrative Approach to STEM Workforce Preparation in a Biomedical Science Course [Quality Improvement

Successful retention of STEM majors that then successfully transition into the U.S. STEM workforce is a major challenge for institutions of higher education. The present work represents a quality improvement study of a custom-designed professional development course for undergraduate students characterized by an innovative integration of workforce preparation activities into a STEM content knowledge course. The QI study investigated the student-perceived impact of participation in goal setting and skill assessment utilizing an individual development plan and whether participation in the custom-designed training course increased student proficiency in STEM workforce-relevant skills. Program evaluation data was used to address the professional development needs of undergraduate STEM students, who are members of underrepresented groups in biomedical science. Evaluation data was used to design the professional development course to target and customize structures to support student success planning and goal attainment. Analysis of reported outcomes indicates that most students benefited from participation in the course and experienced a positive impact on their proficiency in workforce relevant skills and goal setting. This integrated approach to workforce preparation in STEM may address some of the persistence and retention challenges that threaten the size and diversity of the future STEM workforce within the U.S.

Pre-Admission Skills Assessment of BA English Language Aspirants in a Public University

Pre-Admission Skills Assessment of BA English Language Aspirants in a Public University

Montage Mastery Revolutionizes Global Children's Motor Skills

This study examines the effectiveness of Pictorial Montage activities in enhancing fine motor skills among 5-6-year-old children in group B. Conducted through Classroom Action Research (CAR) with iterative cycles, the research involved 11 students from TK Tunas Bangsa Sukodono. Data collection included observation, interviews, and documentation. Results showed a gradual increase from 47% in pre-cycle to 90.1% in cycle II, indicating success in improving fine motor skills. These findings underscore the importance of engaging methods like Pictorial Montage for effective motor skill development in early childhood education. Highlight: Montage enhances motor skills in children. Iterative CAR method for skill assessment. Notable improvement in fine motor proficiency. Keyword: Fine motor skills, Pictorial Montage, Early childhood education, Classroom Action Research, Skill enhancement

Relationships Among Parental Self‐Efficacy, Home Learning Activities, and Child Skills

AbstractObjectiveTo investigate relationships among parental self‐efficacy, home learning activities, and children's socioemotional and language skills for preschool children.BackgroundHigher parental self‐efficacy is often related to better child skills and with more home learning activities. However, the relationships between parental self‐efficacy, home learning activities, and children's skills have not yet been investigated.MethodThe path models draw on data from 727 parents of preschool children (full sample: 85.1% female, 50.9% employed, 24.8% non‐German family language) and a subsample of 108 parents of preschool children who soon transition to elementary school in Germany. The self‐report data come from the German evaluation study “Language Daycare Centers.”ResultsWe found significant positive links among (a) general parental self‐efficacy with home learning activities and children's language skills, (b) language supporting parental self‐efficacy with home learning activities and children's socioemotional skills, and (c) a negative link between language supporting parental self‐efficacy and children's socioemotional problems.ConclusionThe more self‐efficacious parents felt, the more often they offered home learning activities and the higher they rated their children's language skills at age 5 years.ImplicationThe findings highlight the importance of parental self‐efficacy for engaging with children and the positive parental assessment of children's skills. Promoting parental self‐efficacy might stimulate home learning activities and improve the home learning environment.

Teledidactic Versus Hands-on Teaching of Abdominal, Thoracic, and Thyroid Ultrasound-The TELUS II Study.

The worldwide COVID-19 pandemic has initiated a change in medical education and the development of new teaching concepts has become inevitable to maintain adequate training. This pilot study aims to compare teledidactic teaching with traditional face-to-face teaching for abdominal, thoracic, and thyroid ultrasound. Concurrently, a teledidactic and a face-to-face ultrasound course were held. The students completed seven 90-min modules using mobile ultrasound probes (Butterfly IQ). Each module consisted of a lecture, a demonstration of probe guidance, and independent training. A total of thirty medical students took part in the study and were randomly assigned to a teledidactic and a face-to-face group. An objective structured assessment of ultrasound skills (OSAUS) was performed as a pre-test and as the final exam and ultrasound images obtained during the exam were evaluated using the brightness mode quality ultrasound imaging examination (B-QUIET) scale. No significant difference between the two cohorts on the OSAUS final exam was shown (p > 0.05 in all modules). There was a significant difference in the assessment of the images in the focused assessment with sonography for trauma (FAST) (p 0.015) and aorta (p 0.017) modules. Students in the teledidactic group performed better in both modules, scoring 33.59 (± 2.61) out of 44 in the module FAST (face-to-face group 30.95 (± 1.76)) and aortic images averaged 35.41 (± 2.61) points (face-to-face group 32.35 (± 3.08)). A teledidactic course for abdominal and thoracic ultrasound examinations is equally effective to traditional face-to-face teaching in this pilot study. Digital implementation with a portable ultrasound machine could be a great opportunity to promote ultrasound education worldwide and over great distances.

Objective assessment tools in laparoscopic or robotic-assisted gynecological surgery: A systematic review.

There is a growing emphasis on proficiency-based progression within surgical training. To enable this, clearly defined metrics for those newly acquired surgical skills are needed. These can be formulated in objective assessment tools. The aim of the present study was to systematically review the literature reporting on available tools for objective assessment of minimally invasive gynecological surgery (simulated) performance and evaluate their reliability and validity. A systematic search (1989-2022) was conducted in MEDLINE, Embase, PubMed, Web of Science in accordance with PRISMA. The trial was registered with the Prospective Register of Systematic Reviews (PROSPERO) ID: CRD42022376552. Randomized controlled trials, prospective comparative studies, prospective single-group (with pre- and post-training assessment) or consensus studies that reported on the development, validation or usage of assessment tools of surgical performance in minimally invasive gynecological surgery, were included. Three independent assessors assessed study setting and validity evidence according to a contemporary framework of validity, which was adapted from Messick's validity framework. Methodological quality of included studies was assessed using the modified medical education research study quality instrument (MERSQI) checklist. Heterogeneity in data reporting on types of tools, data collection, study design, definition of expertise (novice vs. experts) and statistical values prevented a meaningful meta-analysis. A total of 19 746 titles and abstracts were screened of which 72 articles met the inclusion criteria. A total of 37 different assessment tools were identified of which 13 represented manual global assessment tools, 13 manual procedure-specific assessment tools and 11 automated performance metrices. Only two tools showed substantive evidence of validity. Reliability and validity per tool were provided. No assessment tools showed direct correlation between tool scores and patient related outcomes. Existing objective assessment tools lack evidence on predicting patient outcomes and suffer from limitations in transferability outside of the research environment, particularly for automated performance metrics. Future research should prioritize filling these gaps while integrating advanced technologies like kinematic data and AI for robust, objective surgical skill assessment within gynecological advanced surgical training programs.

One-shot skill assessment in high-stakes domains with limited data via meta learning

Deep Learning (DL) has achieved robust competency assessment in various high-stakes fields. However, the applicability of DL models is often hampered by their substantial data requirements and confinement to specific training domains. This prevents them from transitioning to new tasks where data is scarce. Therefore, domain adaptation emerges as a critical element for the practical implementation of DL in real-world scenarios. Herein, we introduce A-VBANet, a novel meta-learning model capable of delivering domain-agnostic skill assessment via one-shot learning. Our methodology has been tested by assessing surgical skills on five laparoscopic and robotic simulators and real-life laparoscopic cholecystectomy. Our model successfully adapted with accuracies up to 99.5 % in one-shot and 99.9 % in few-shot settings for simulated tasks and 89.7 % for laparoscopic cholecystectomy. This study marks the first instance of a domain-agnostic methodology for skill assessment in critical fields setting a precedent for the broad application of DL across diverse real-life domains with limited data.