Global Operative Assessment Of Laparoscopic Skills Score Research Articles

Analysis of the Educational Value of YouTube Laparoscopic Appendectomy Videos.

PurposeTo evaluate the educational value of laparoscopic appendectomy (LA) videos on YouTube for surgical trainees.MethodsThe search term “Laparoscopic appendectomy” was used on YouTube. The top 100 videos sorted by the number of views were evaluated. Each YouTube account was analyzed, and only videos uploaded by medical physicians were included in this study. Video quality was evaluated using an arbitrary appendectomy scoring system. Video characteristics and Global Operative Assessment of Laparoscopic Skills (GOALS) scores were analyzed regarding video quality and upload source.ResultsThe video quality of 14 (25.0%) videos was graded as good, 36 (64.3%) moderate, and 6 (10.7%) of poor quality. Video characteristic analysis showed no differences in video quality according to the upload source (p=0.573). Video quality and upload source were not related to video length, total views, days online, number of likes, number of dislikes, number of comments, or GOALS score. Among the factors analyzed, only appendicitis severity was found to be associated with video grade (p=0.049).ConclusionThe quality of LA YouTube videos varied. Categories considered as viewer feedback were not associated with video grade or upload source. Responsible video uploading by academic institutions, and appropriate censorship by YouTube seems necessary. Further research with objective data on actual application to surgical trainees is necessary.

Validity Assessment of the Laparoscopic Radical Nephrectomy Module of the LapVision® Virtual Reality Simulator

Background: Virtual reality (VR) simulators allow trainees to perform repeated practice, and provide objective dexterity metrics regarding their performance, which means that VR-based surgical training is becoming a vital part in initial learning of basic laparoscopic surgical skills. However, its educational role of learning advanced procedures remains undetermined. We evaluated the validity of the laparoscopic radicalnephrectomy module of the LapVision® virtual reality simulator. Methods: Urologists, medical students, and junior resident voluntarily participated in the present study and they performed a laparoscopic left radical nephrectomy module. For construct validation, dexterity metrics calculated in the simulator, and mean score of Global Operative Assessment of Laparoscopic Skills (GOALS) evaluated by two experts’ video review were compared according to the certification of Japanese Endoscopic Surgical Skill Qualification (ESSQ) or previous surgical experience. Results: Ten experts (>50 laparoscopic surgeries), 9 intermediates (11-49), and 14 novices (0-10) voluntarily joined the present study. Regarding the construct validity, there was a significant difference in the total number of errors, blood loss, and GOALS score among the groups for both the ESSQ status and previous surgical experience. Conclusions: The present study demonstrated good construct validity for the LapVision® nephrectomy module. Furthermore, global skill assessment could be possible by experts’ reviews, which means the usefulness of VR procedural module for skill assessment tool. VR-based procedural simulation has marked potential to become a vital part of integrated laparoscopic training programs.

One or two trainees per workplace for laparoscopic surgery training courses: results from a randomized controlled trial.

There are no standards for optimal utilization of workplaces in laparoscopic training. This study aimed to define whether laparoscopy training should be done alone or in pairs (known as dyad training). This was a three-arm randomized controlled trial with laparoscopically naïve medical students (n = 100). Intervention groups participated alone (n = 40) or as dyad (n = 40) in a multimodality training curriculum with e-learning, basic, and procedural skills training using box and VR trainers. The control group (n = 20) had no training. Post-performance of a cadaveric porcine laparoscopic cholecystectomy (LC) was measured as the primary outcome by blinded raters using the objective structured assessment of technical skills (OSATS). Global operative assessment of laparoscopic skills (GOALS), time for LC, and VR performances were secondary outcomes. There were no differences between groups for performance scores [OSATS: alone (40.2 ± 9.8) vs. dyad (39.8 ± 8.6), p = 0.995; alone vs. control (37.1 ± 7.4), p = 0.548; or dyad vs. control, p = 0.590; and GOALS score: alone (10.6 ± 3.0) vs. dyad (10.0 ± 2.7), p = 0.599; alone vs. control (10.1 ± 3.0), p = 0.748; or dyad vs. control, p = 0.998]. Dyad finished LC faster than control [median = 62.5min (CI 58.0-73.0) vs. 76.5min (CI 72.0-80+); p = 0.042], while there were no inter-group differences between alone vs. control [median = 69.0min (CI 62.0-76.0) vs. control; p = 0.099] or alone vs. dyad (p = 0.840). Dyad and alone showed superior performance on the VR trainer vs. control for time, number of movements, and path length, but not for complications and application of cautery. The curriculum provided trainees with the laparoscopic skills needed to perform LC safely, irrespective of the number of trainees per workplace. Dyad training reduced the operation time needed for LC. Therefore, dyad training seems to be a promising alternative, especially if training time is limited and resources must be used as efficiently as possible. Trial registration German Clinical Trials Register: DRKS00004675.

Single-Incision Laparoscopic-Assisted Anorectoplasty Versus Three-Port Laparoscopy in Treatment of Persistent Cloaca: A Midterm Follow-up.

Purpose: The aim of this study was to compare the safety and efficacy of single-incision laparoscopic-assisted anorectoplasty (SILAARP) to that of traditional three-port laparoscopic-assisted anorectoplasty (3-PLAARP) for persistent cloaca (PC) patients with mid to high rectal pouches in midterm follow-up. Materials and Methods: A study comparing 13 SILAARPs and 12 3-PLAARPs performed by a single surgeon from November 2005 to May 2016 was presented (laparoscopy was performed for anorectoplasty, and urethra vaginoplasty was performed perineally). Data including demographics and perioperative and midterm outcomes were retrospectively compared. Operative performances between the groups were compared using the Global Operative Assessment of Laparoscopic Skills (GOALS). Results: The two groups were comparable in terms of demographics. No significant difference was observed between SILAARP and 3-PLAARP groups in terms of median operative time, transfusion rates, intraoperative complications, time to resume diet, postoperative hospital stays, and GOALS scores. Postoperative outcomes included 1 patient with incomplete intestinal obstruction (SILAARP group), 1 patient requiring intermittent catherization to remain dry (3-PLAAR group), 2 patients with occasional urine incontinence (one in each group), and 5 girls with mild mucosal prolapse (2 and 3 in the SILAARP and 3-PLAAR groups, respectively); however, these did not differ significantly between groups. Trocar-related scars of the patient who was undergoing SILAARP were almost invisible. After 18 months follow-up, the rates of soiling and constipation were similar in both groups. Conclusion: The midterm outcomes of SILAARP were comparable to those of 3-PLAARP. It appears to be a safe and effective procedure with better cosmetic results for mid to high rectal pouches in PC children.

LapTrain: multi-modality training curriculum for laparoscopic cholecystectomy-results of a randomized controlled trial.

Multiple training modalities for laparoscopy have different advantages, but little research has been conducted on the benefit of a training program that includes multiple different training methods compared to one method only. This study aimed to evaluate benefits of a combined multi-modality training program for surgical residents. Laparoscopic cholecystectomy (LC) was performed on a porcine liver as the pre-test. Randomization was stratified for experience to the multi-modality Training group (12h of training on Virtual Reality (VR) and box trainer) or Control group (no training). The post-test consisted of a VR LC and porcine LC. Performance was rated with the Global Operative Assessment of Laparoscopic Skills (GOALS) score by blinded experts. Training (n = 33) and Control (n = 31) were similar in the pre-test (GOALS: 13.7 ± 3.4 vs. 14.7 ± 2.6; p = 0.198; operation time 57.0 ± 18.1 vs. 63.4 ± 17.5min; p = 0.191). In the post-test porcine LC, Training had improved GOALS scores (+ 2.84 ± 2.85 points, p < 0.001), while Control did not (+ 0.55 ± 2.34 points, p = 0.154). Operation time in the post-test was shorter for Training vs. Control (40.0 ± 17.0 vs. 55.0 ± 22.2min; p = 0.012). Junior residents improved GOALS scores to the level of senior residents (pre-test: 13.7 ± 2.7 vs. 18.3 ± 2.9; p = 0.010; post-test: 15.5 ± 3.4 vs. 18.8 ± 3.8; p = 0.120) but senior residents remained faster (50.1 ± 20.6 vs. 25.0 ± 1.9min; p < 0.001). No differences were found between groups on the post-test VR trainer. Structured multi-modality training is beneficial for novices to improve basics and overcome the initial learning curve in laparoscopy as well as to decrease operation time for LCs in different stages of experience. Future studies should evaluate multi-modality training in comparison with single modalities. German Clinical Trials Register DRKS00011040.

Time crunch: increasing the efficiency of assessment of technical surgical skill via brief video clips

BackgroundVideo review for assessment of surgical performance is gaining popularity but is time consuming for busy expert reviewers, making review delays inevitable. Decreasing review time and including nonexpert reviewers may facilitate more timely reviews. We hypothesized that a shorter duration video clip would not affect the quality of expert ratings compared with full-length review. A secondary aim was to examine the reliability between expert and novice raters and how it was affected by video clip duration. MethodsVideos of laparoscopic suturing performed on a live porcine model by premedical students, surgery residents, and fully trained surgeons were edited into 3 different durations: full, part, and 30-second versions. Video clips (n = 36) were reviewed by experienced surgeons (n = 3) and novice volunteers (n = 4) using the validated Global Operative Assessment of Laparoscopic Skills (GOALS) assessment. Videos were assigned randomly during 3 review cycles held 1 week apart. Each cycle included 1 iteration of the 12 performance videos. We assessed the impact of the duration of the video on reviewer scores and inter-rater reliability. ResultsVariance in scores for 2 of 4 GOALS domains was dependent on the duration of the video clip (P < .05). Total GOALS scores were greater for part and 30-second clips compared with full clips (P < .05). Inter-rater reliability was greatest for full clips (intraclass correlation = 0.68) and decreased significantly for shorter clips. ConclusionOur hypothesis was rejected as shorter video durations for surgical performance assessment led to inflated reviewer ratings both for expert and novice reviewers. Shortening duration of the video cannot be recommended for accurate performance assessment.

Box- or Virtual-Reality Trainer: Which Tool Results in Better Transfer of Laparoscopic Basic Skills?—A Prospective Randomized Trial

Simulation training improves laparoscopic performance. Laparoscopic basic skills can be learned in simulators as box- or virtual-reality (VR) trainers. However, there is no clear recommendation for either box or VR trainers as the most appropriate tool for the transfer of acquired laparoscopic basic skills into a surgical procedure. Both training tools were compared, using validated and well-established curricula in the acquirement of basic skills, in a prospective randomized trial in a 5-day structured laparoscopic training course. Participants completed either a box- or VR-trainer curriculum and then applied the learned skills performing an ex situ laparoscopic cholecystectomy on a pig liver. The performance was recorded on video and evaluated offline by 4 blinded observers using the Global Operative Assessment of Laparoscopic Skills (GOALS) score. Learning curves of the various exercises included in the training course were compared and the improvement in each exercise was analyzed. Surgical Skills Lab of the Department of General and Visceral Surgery, University Hospital Muenster. Surgical novices without prior surgical experience (medical students, n = 36). Posttraining evaluation showed significant improvement compared with baseline in both groups, indicating acquisition of laparoscopic basic skills. Learning curves showed almost the same progression with no significant differences. In simulated laparoscopic cholecystectomy, total GOALS score was significantly higher for the box-trained group than the VR-trained group (box: 15.31 ± 3.61 vs. VR: 12.92 ± 3.06; p = 0.039; Hedge׳s g* = 0.699), indicating higher technical skill levels. Despite both systems having advantages and disadvantages, they can both be used for simulation training for laparoscopic skills. In the setting with 2 structured, validated and almost identical curricula, the box-trained group appears to be superior in the better transfer of basic skills into an experimental but structured surgical procedure.

Laparoscopic skill assessment of practicing surgeons prior to enrollment in a surgical trial of a new laparoscopic procedure.

Outcomes of surgical trials hinge on surgeon selection and their underlying expertise. Assessment of expertise is paramount. We investigated whether surgeons' performance measured by the fundamentals of laparoscopic surgery (FLS) assessment program could predict their performance in a surgical trial. As part of a prospective multi-institutional study of minimally invasive inguinal lymphadenectomy (MILND) for melanoma, surgical oncologists with no prior MILND experience underwent pre-trial FLS assessment. Surgeons completed MILND training, began enrolling patients, and submitted videos of each MILND case performed. Videos were scored with the global operative assessment of laparoscopic skills (GOALS) tool. Associations between baseline FLS scores and participant's trial performance metrics were assessed. Twelve surgeons enrolled patients; their median total baseline FLS score was 332 (range 275-380, max possible 500, passing >270). Participants enrolled 87 patients in the study (median 6 per surgeon, range 1-24), of which 72 (83%) videos were adequate for scoring. Baseline GOALS score was 17.1 (range 9.6-21.2, max possible score 30). Inter-rater reliability was excellent (ICC=0.85). FLS scores correlated with improved GOALS scores (r=0.57, p=0.05) and with decreased operative time (r=-0.6, p=0.02). No associations were found with the degree of patient recruitment (r=0.02, p=0.7), lymph node count (r=0.01, p=0.07), conversion rate (r=-0.06, p=0.38) or major complications(r=-0.14, p=0.6). FLS skill assessment of surgeons prior to their enrollment in a surgical trial is feasible. Although better FLS scores predicted improved operative performance and operative time, other trial outcome measures showed no difference. Our findings have implications for the documentation of laparoscopic expertise of surgeons in practice and may allow more appropriate selection of surgeons to participate in clinical trials.

Assessment of Surgical Competence: Development and Validation of Rating Scales Used for Laparoscopic Supracervical Hysterectomy

ObjectiveTo develop a procedure-specific rating scale for laparoscopic supracervical hysterectomy (LSH), and to compare the construct validity and reliability with a general rating scale in laparoscopic surgery, global operative assessment of laparoscopic skills (GOALS). DesignProspective interobserver study. In collaboration with an expert group, we developed the procedure-specific rating scale, competence assessment tool for laparoscopic supracervical hysterectomy (CAT-LSH). LSH was performed by gynecologists with different levels of surgical competence levels (13 procedures were performed by inexperienced trainees, 13 by intermediate experienced, and 15 by laparoscopic experts). All procedures were video-recorded. Surgical performance was evaluated in all procedures using both CAT-LSH and GOALS by the surgical assistant, as well as by 2 blinded observers evaluating the video recordings. SettingUniversity teaching hospital. ParticipantsLaparoscopic experts, consultants and gynecological registrars from the Department of Gynecology. ResultsThere were significant differences between the 3 proficiency groups in both the rating scales. Mean GOALS score evaluated by the operating assistant and the 2 observers were for inexperienced surgeons 16.4 vs. 13.6 (p < 0.01), for surgeons with intermediate experienced 22.6 vs. 19.5 (p < 0.05) and for expert surgeons 26.1 vs. 22.4 (p < 0.01), respectively. Corresponding results for the CAT-LSH scores were 41.0/34.6 (p < 0.01), 49.2/43.1 (p < 0.01), and 58.7/51.1 (p < 0.01), respectively. The interrater reliability measured by the interclass correlation coefficient between the surgical assistant and the 2 blinded observers for GOALS and CAT-LSH were 0.71 and 0.75, respectively. ConclusionsThe GOALS and CAT-LSH appear to have construct validity and high interrater reliability. Assessment of surgical competence during LSH is feasible in daily practice with objective rating scales like CAT-LSH and GOALS.

Reliable assessment of operative performance

BackgroundThere is no consensus regarding the number of intraoperative assessments required to reliably measure trainee performance. This study used generalizability theory (GT) to describe factors contributing to score variance and to estimate the number of assessments needed to achieve high standards of reliability. MethodsWhile performing laparoscopic procedures, trainees were assessed by the attending surgeon using Global Operative Assessment of Laparoscopic Skills (GOALS). Data were collected prospectively (2-month intervals), assessing each trainee multiple times. Reliability coefficient was calculated using trainees, cases, and raters as factors. ResultsEighteen trainees were included for a total of 65 assessments. Total variance in scores was accounted for as follows: 66.1% by trainees, 31.6% by the interaction between trainees and cases, and 2.3% by raters. At least 3 cases are required for reliable scores using GOALS. ConclusionsTrainees accounted for most of the variance in GOALS scores with a minimum of 3 cases required to improve the reliability of the scores obtained. These data may guide the implementation of performance assessments in surgical training programs.

Training model for laparoscopic Heller and Dor fundoplication: a tool for laparoscopic skills training and assessment—construct validity using the GOALS score

Laparoscopic training demands practice. The transfer of laparoscopic skills from training models to real surgical procedures has been proven. The global operative assessment of laparoscopic skills (GOALS) score is a 5-item global rating scale developed to evaluate laparoscopic skills by direct observation. This scale has been used to demonstrate construct validity of several laparoscopic training models. Here, we present a low-cost model of laparoscopic Heller-Dor for advanced laparoscopic training. The aim of this study was to determine the capability of a training model for laparoscopic Heller-Dor to discriminate between different levels of laparoscopic expertise. The performance of two groups with different levels of expertise, novices (<30 laparoscopic procedures PGY1-2) and experts (>300 laparoscopic procedures PGY4-5) was assessed. All participants were instructed to perform two tasks (esophageal myotomy and fundoplication). All the performances were recorded in a digital format. A laparoscopic expert who was blinded to subject's identity evaluated the recordings using the GOALS score. Autonomy, one of the five items of GOALS, was removed since the evaluator and the trainee did not have interaction. The time required to finish each task was also recorded. Performance was compared using the Mann-Whitney U test (p<0.05 was significant). Twenty subjects were evaluated: ten in each group, using the GOALS score. The mean total GOALS score for novices was 7.5 points (SD: 1.64) and 13.9 points (SD: 1.66) for experts (p<0.05).The expert group was superior in each domain of the GOALS score compared to novices: depth perception (mean: 3.3 vs 2 p<0.05), bimanual dexterity (mean 3.4 vs 2.1 p<0.05), efficiency (mean 3.4 vs 1.7 p<0.05) and tissue handling (mean 3.6 vs 1.7 p<0.05). With regard to time, experts were superior in task 1 (mean 9.7 vs 14.9min p<0.05) and task 2 (mean 24 vs 47.1min p<0.05) compared to novices. The laparoscopic Heller-Dor training model has construct validity. The model may be used as a tool for training of the surgical resident.

The Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics may not correlate with operative performance in a novice cohort

BackgroundConsiderable resources have been invested in both low- and high-fidelity simulators in surgical training. The purpose of this study was to investigate if the Fundamentals of Laparoscopic Surgery (FLS, low-fidelity box trainer) and LapVR (high-fidelity virtual reality) training systems correlate with operative performance on the Global Operative Assessment of Laparoscopic Skills (GOALS) global rating scale using a porcine cholecystectomy model in a novice surgical group with minimal laparoscopic experience.MethodsFourteen postgraduate year 1 surgical residents with minimal laparoscopic experience performed tasks from the FLS program and the LapVR simulator as well as a live porcine laparoscopic cholecystectomy. Performance was evaluated using standardized FLS metrics, automatic computer evaluations, and a validated global rating scale.ResultsOverall, FLS score did not show an association with GOALS global rating scale score on the porcine cholecystectomy. None of the five LapVR task scores were significantly associated with GOALS score on the porcine cholecystectomy.ConclusionsNeither the low-fidelity box trainer or the high-fidelity virtual simulator demonstrated significant correlation with GOALS operative scores. These findings offer caution against the use of these modalities for brief assessments of novice surgical trainees, especially for predictive or selection purposes.

Validity and Reliability of Global Operative Assessment of Laparoscopic Skills (GOALS) in Novice Trainees Performing a Laparoscopic Cholecystectomy

Global Operative Assessment of Laparoscopic Skills (GOALS) assessment has been designed to evaluate skills in laparoscopic surgery. A longitudinal blinded study of randomized video fragments was conducted to estimate the validity and reliability of GOALS in novice trainees. In total, 10 trainees each performed 6 consecutive laparoscopic cholecystectomies. Sixty procedures were recorded on video. Video fragments of (1) opening of the peritoneum; (2) dissection of Calot's triangle and achievement of critical view of safety; and (3) dissection of the gallbladder from the liver bed were blinded, randomized, and rated by 2 consultant surgeons using GOALS. Also, a grade was given for overall competence. The correlation of GOALS with live observation Objective Structured Assessment of Technical Skills (OSATS) scores was calculated. Construct validity was estimated using the Friedman 2-way analysis of variance by ranks and the Wilcoxon signed-rank test. The interrater reliability was calculated using the absolute and consistency agreement 2-way random-effects model intraclass correlation coefficient. A high correlation was found between mean GOALS score (r = 0.879, p = 0.021) and mean OSATS score. The GOALS score increased significantly across the 6 procedures (p = 0.002). The trainees performed significantly better on their sixth when compared with their first cholecystectomy (p = 0.004). The consistency agreement interrater reliability was 0.37 for the mean GOALS score (p = 0.002) and 0.55 for overall competence (p < 0.001) of the 3 video fragments. The validity observed in this randomized blinded longitudinal study supports the existing evidence that GOALS is a valid tool for assessment of novice trainees. A relatively low reliability was found in this study.

The Animal Model in Advanced Laparoscopy Resident Training

Laparoscopic surgery is recognized as an established technique for several abdominal disorders. Aim of the present investigation was to assess the level of expertise of senior residents and to evaluate the role of the animal model on advanced laparoscopic training. Overall, 60 residents underwent a training session on a porcine model under the guidance of experienced laparoscopic surgeons. Of these, 30 residents underwent a box-trainer preparation before starting the surgical procedure on the animal model, while a group of 20 repeated the course 3 months after the first session. Global Operative Assessment of Laparoscopic Skills (GOALS) was used to evaluate technical proficiency. Senior residents presented low mean scores for all the GOALS domains for both for the minor and major surgical procedure. The box-trainer led to an improvement in suturing skills (P<0.001). Comparison of the mean GOALS scores from the first to the second laparoscopic session demonstrated a significant improvement on the duration of the procedures (P<0.05), onset of major complications (P=0.01), need of the tutor (P=0.08), and confidence in treating intraoperative bleeding (P=0.01). National Resident Training Programs should take into consideration the present quality of training and attempt to develop alternative methods of training for laparoscopic surgery, such as, the animal model laboratory.

Construct validity of an inanimate training model for laparoscopic appendectomy.

The use of training models in laparoscopic surgery allows the surgical team to practice procedures in a safe environment. The aim of this study was to determine the capability of an inanimate laparoscopic appendectomy model to discriminate between different levels of surgical experience (construct validity). The performance of 3 groups with different levels of expertise in laparoscopic surgery--experts (Group A), intermediates (Group B), and novices (Group C)--was evaluated. The groups were instructed of the task to perform in the model using a video tutorial. Procedures were recorded in a digital format for later analysis using the Global Operative Assessment of Laparoscopic Skills (GOALS) score; procedure time was registered. The data were analyzed using the analysis of variance test. Twelve subjects were evaluated, 4 in each group, using the GOALS score and time required to finish the task. Higher scores were observed in the expert group, followed by the intermediate and novice groups, with statistically significant difference. Regarding procedure time, a significant difference was also found between the groups, with the experts having the shorter time. The proposed model is able to discriminate among individuals with different levels of expertise, indicating that the abilities that the model evaluates are relevant in the surgeon's performance. Construct validity for the inanimate full-task laparoscopic appendectomy training model was demonstrated. Therefore, it is a useful tool in the development and evaluation of the resident in training.

Remote evaluation of laparoscopic performance using the global operative assessment of laparoscopic skills

Although numerous assessment tools currently exist to evaluate laparoscopic surgical skills, no studies have demonstrated the reliability of such tools when used with telementoring technology. This study aimed to determine the reliability of the Global Operative Assessment of Laparoscopic Skills (GOALS) rating scale for assessing laparoscopic skills remotely and to identify how factors unique to remote assessment such as bandwidth and image quality influence its reliability. Four trained observers evaluated 19 participants for their technical performance during a laparoscopic cholecystectomy using the GOALS assessment tool. One observer assessed the study participants directly in the operating room, whereas the three remaining observers were randomly assigned and blinded to a high- (1.5 Mbps), medium- (256 kbps), or low- (64.4 kbps) bandwidth restriction and observed remotely via Skype. The Maryland Visual Comfort Scale was used to evaluate the video quality of the respective connections. The intraclass correlation coefficient (ICC) calculated for the total GOALS score demonstrated a statistically significant correlation of high, medium, and low bandwidths respectively with ICC 0.693 (95 % confidence interval [CI], 0.226-0.883), 0.518 (95 % CI 0.089-0.783), and 0.499 (95 % CI 0.025-0.781). There was a statistically significant difference in the overall perceived visual quality between the high/low (Z = -3.222; P = 0.001) and the medium/low (Z = -3.567; P < 0.001) bandwidth comparison but no difference between the high/medium bandwidths (Z = -0.610; P = 0.542). The data suggest that the GOALS assessment tool retains its reliability for intraoperative assessment of laparoscopic skills when used remotely. This is a key requirement in telesimulation programs allowing for structured feedback between the mentor and the mentee. This study quantifies the effect that bandwidth has on the reliability of remote assessment, demonstrating that higher bandwidths improve the utility of these tools.

Structured Training on Box Trainers for First Year Surgical Residents: Does It Improve Retention of Laparoscopic Skills? A Randomized Controlled Study

Structured training on box trainers in laparoscopic skills in the initial years of residency has been used and found to be effective. Although there are studies that confirm immediate improvement after training, there is a lack of well-designed trials addressing the crucial issue of retention of these skills over time. The purpose of this study is to assess improvement in laparoscopic skills of surgical trainees after structured training on box trainers, compared with traditional training (observing and assisting laparoscopic procedures in the operation rooms) immediately and after 5 months. Forty surgical residents in their first 2 months of residency training were randomized to either structured training on box trainers, in addition to traditional training, or to traditional training alone. Groups were equivalent with regards to demographics, previous operative experience, and baseline skills. Structured training consisted of 4 sessions with 6 tasks on box trainers under supervision and self practice. Task-based objective structured practical examinations (OSPE) were completed before and after each task. At the end of the training, residents were assessed by a blinded faculty member with the global operative assessment of laparoscopic skills (GOALS) rating scale. Residents also completed a satisfaction questionnaire. Focus group discussions were conducted for both groups. The GOALS were repeated for both the groups at the end of 5 months to assess retention of skills. The mean GOALS score was significantly higher for the structured training group (mean/SD 20.35 + 0.74) compared with the traditional training group (mean/SD 16.35 + 1.75, p < 0.01) at the end of 5 months. The mean global rating scale (GRS) score was significantly higher (Pre 7.55 + 0.99 vs. Post 16.4 + 0.68, p < 0.01) for the structured training group at the end of course. Residents in the structured training group had significantly improved skills immediately after the training and had better retention of skills at the end of five months. Structured training on box trainers, in addition to traditional training, compared with traditional training alone, leads to better skills and improved confidence of residents. There is significant retention of skills at the end of 5 months. These results provide support for incorporation of structured training with box trainers for laparoscopic skills into surgical training programs.

A global assessment tool for evaluation of intraoperative laparoscopic skills

Background There is a pressing need for an intraoperative assessment tool that meets high standards of reliability and validity to use as an outcome measure for different training strategies. The aim of this study was to develop a tool specific for laparoscopic skills and to evaluate its reliability and validity. Methods The Global Operative Assessment of Laparoscopic Skills (GOALS) consists of a 5-item global rating scale. A 10-item checklist and 2 visual analogue scales (VAS) for competence and case difficulty were also used. During laparoscopic cholecystectomy, 21 participants were evaluated by the attending surgeon, by 2 trained observers and by self-assessment while dissecting the gallbladder from the liver bed. Results The intraclass correlation coefficient (ICC) for the total GOALS score was .89 (95% confidence interval [CI] .74 to .95) between observers, .82 (95% CI .67 to .92) between observers and attending surgeons, and .70 (95% CI .37 to .87) between participants and attending surgeons. The ICCs (observers) for the VAS (competence) and the checklist were .69 and .70, respectively. The mean total GOALS score (observers) for novices (postgraduate years [PGYs] 1 through 3) was 13 (95% CI 10.3 to 15.7) compared with 19.4 (95% CI 17.2 to 21.5) for experienced (PGY 4 through attending surgeons, P = .0006). The VAS demonstrated a difference in scores between novice and experienced participants ( P = .001); however, the task checklist did not ( P = .09). Conclusions These data indicate that GOALS is feasible, reliable, and valid. They also suggest that it is superior to the task checklist and VAS for evaluation of technical skill by experienced raters. The findings support the use of GOALS in the training and evaluation of laparoscopic skills.