Non-expert Groups Research Articles

(Invited) Synthetic Strategies to Lower the Barrier for Making High Quality Quantum Dot Probes

Quantum dot (QD)-based bioimaging requires QDs with exceptional optical quality and well-controlled surface properties. Although extensive research has been carried out to produce high-quality nanocrystals and to design biocompatible ligands, significant expertise is required to synthesize the best quality QDs and ligands reported. Commercially available QDs often fail to meet the required quality and suffer from irreproducibility in their performance. These restrictions have limited the wide adoption of QDs for biomedical imaging in non-expert groups. My group strives to lower the barrier to preparing high-quality QD probes in a wide range of wavelengths. In this talk, I will discuss the synthetic strategies that we have developed to systematically grow high-quality nanocrystals of various sizes and materials with minimal human intervention and simplify the synthesis of polyimidazole ligands without compromising their quality. By lowering the synthetic barrier to high-quality QDs, we envision unleashing the full potential of QDs in various fields.

The effect of expertise in music reading: cross-modal competence

We hypothesize that the fundamental difference between expert and learner musicians isthe capacity to efficiently integrate cross-modal information. This capacity might be anindex of an expert memory using both auditory and visual cues built during many years oflearning and extensive practice. Investigating this issue through an eye-tracking experiment, two groups of musicians, experts and non-experts, were required to report whether afragment of classical music, successively displayed both auditorily and visually on a computer screen (cross-modal presentation) was same or different. An accent mark, associated on a particular note, was located in a congruent or incongruent way according to musical harmony rules, during the auditory and reading phases. The cross-modal competence of experts was demonstrated by shorter fixation durations and less errors. Accent mark appeared for non-experts as interferences and lead to incorrect judgments. Results are discussed in terms of amodal memory for expert musicians that can be supported within the theoretical framework of Long-Term Working Memory (Ericsson and Kintsch, 1995).

Linked color imaging improves colorectal lesion detection especially for low performance endoscopists: An international trial in Asia.

Linked color imaging (LCI) is an image-enhanced endoscopy technique that accentuates the color difference between red and white, potentially improving the adenoma detection rate (ADR). However, it remains unclear whether LCI performance in detecting colorectal lesions differs based on endoscopists' experience levels. We aimed to evaluate the differences in LCI efficacy based on the experience levels of endoscopists by conducting an exploratory analysis. In this post hoc analysis of an international randomized controlled trial comparing the detection of adenoma and other lesions using colonoscopy with LCI and high-definition white light imaging (WLI), we included patients from 11 institutions across four countries/regions: Japan, Thailand, Taiwan, and Singapore. We retrospectively reviewed differences in the lesion detection of LCI according to endoscopists' colonoscopy history or ADR. We included 1692 and 1138 patients who underwent colonoscopies performed by 54 experts (experience of ≥5000 colonoscopies) and by 43 non-experts (experience of <5000 colonoscopies), respectively. Both expert and non-expert groups showed a significant improvement in ADR with LCI compared to WLI (expert, 61.7% vs 46.4%; P<0.001; non-expert, 56.6% vs 46.4%; P<0.001). LCI had no effect on sessile serrated lesion detection rate in non-experts (3.1% vs 2.5%; P=0.518). LCI significantly improved detection rates in endoscopists with relatively low detection performance, defined as an ADR<50%. This exploratory study analyzed data from a previous trial and revealed that LCI is useful for both experts and non-experts and is even more beneficial for endoscopists with relatively low detection performance using WLI.

Assessing the Effectiveness of Textual Recommendations in KoopaML

Artificial intelligence (AI) integration, notably in healthcare, has been significant, yet effective implementation in critical areas requires expertise. KoopaML, a previously developed visual platform, aims at bridging this gap, enabling users with limited AI knowledge to build ML pipelines. Its core is a heuristic-based ML task recommender, offering guidance and contextual explanations. The authors compared the use of KoopaML with two non-expert groups: one with the recommender system enabled and the other without. Results showed KoopaML's intuitiveness benefits all but emphasized that textual guidance doesn't substitute for fundamental ML understanding. This underscores the need for educational components in such tools, especially in critical fields like healthcare. The paper suggests future KoopaML enhancements include educational modules, making ML accessible, and ensuring users develop a solid AI foundation. This is crucial for quality outcomes in sectors like healthcare, leveraging AI's potential through enhanced non-expert user capability.

Annotator bias and its effect on deep learning segmentation of uncured composite micrographs

This study demonstrated substantial agreement between groups of experts and non-experts in labelling image regions required for semantic segmentation of X-ray micrographs of uncured composite prepregs. Twelve participants, six experts and six non-experts, were given a 1-h training session covering the three different image regions that are present in an uncured composite micrograph: voids, dry fibre areas, and filled fibre areas. High consensus was observed in the centre of objects, but disagreement in labelling between the groups was observed at the interphase regions where the grey level intensity becomes ambiguous in these low-contrast images, such as at the edges of the dry fibre areas and voids. Also, labelling small interlaminar voids caused disagreement. The participants highlighted the role of software by reporting a preference to defining the vertices of a polygon over colouring-in regions of image segments. The resulting Deep Learning segmentation with expert and non-expert group labels were in almost perfect agreement, as measured by the Fleiss Kappa coefficient, and was able to segment voids and dry fibre areas better than thresholding.

Inter-Observer and Intra-Observer Reliability Assessment of the Established Classification Systems for Periprosthetic Shoulder Fractures.

This study evaluated the reliability and comprehensiveness of the Unified classification system (UCPF), Wright & Cofield, Worland and Kirchhoff classifications and related treatment recommendations for periprosthetic shoulder fractures (PPSFx). Two shoulder arthroplasty specialists (experts) and two orthopaedic residents (non-experts) assessed 20 humeral-sided and five scapula-sided cases of PPSFx. We used the unweighted Cohen's Kappa (κ) for measuring the intra-observer reliability and Krippendorff's alpha (α) for measuring the inter-observer reliability. The inter-rater reliabilities for the Wright & Cofield and Worland classifications were substantial for all groups. The expert and non-expert groups for UCPF also showed substantial inter-rater agreement. The all-rater group for the UCPF and the expert and non-expert group for the Kirchhoff classification revealed moderate inter-rater reliability. For the Kirchhoff classification, only fair inter-rater reliability was found for the non-expert group. Almost perfect intra-rater reliability was measured for all groups of the Wright & Cofield classification and the all-rater and expert groups of the UCPF. All groups of the Kirchhoff and Worland classifications and the group of non-experts for the UCPF had substantial intra-rater reliabilities. Regarding treatment recommendations, substantial inter-rater and moderate intra-rater reliabilities were found. Simple classification systems for PPSFx (Wright & Cofield, Worland) show the highest inter- and intra-observer reliability but lack comprehensiveness as they fail to describe scapula-sided fractures. The complex Kirchhoff classification shows limited reliability. The UCPF seems to offer an acceptable combination of comprehensiveness and reliability.

An empirical evaluation of the effectiveness of attack graphs and MITRE ATT&CK matrices in aiding cyber attack perception amongst decision-makers

Decision-makers struggle to understand cyber-security reports, sometimes leading to inadequate cyber-attack responses. Attack modelling techniques (AMTs) can aid cyber-attack perception, but their effectiveness in improving comprehension amongst non-experts is still under-researched. Attack graphs are the most popular AMT amongst academics, while MITRE ATT&CK is becoming the most popular tool amongst practitioners. This research evaluates the effectiveness of attack graphs and MITRE ATT&CK in aiding cyber-attack perception after an attack has taken place. 157 participants were divided into expert and non-expert groups and further subdivided within respective groups. Participants underwent a test designed to demonstrate their comprehension of two cyber-attacks. Participants were also required to express personal preferences, in particular outlining which of the two AMTs was better at aiding their cyber-attack perception. Paired T-Tests reveal that both groups performed better with the attack graph compared to MITRE ATT&CK. Furthermore, both groups outlined a personal preference for the attack graph over MITRE ATT&CK.

An In-Office Hysteroscopy VR/Haptic Simulation Platform for Training in Spatial Navigation and Passage of the Cervical Canal

Hysteroscopy is a type of gynecological procedure that enables diagnosis and treatment of intrauterine pathologies using a minimally-invasive approach. Recent advancements, especially in optics, made it possible to perform this procedure in an ambulatory, outpatient setting without anaesthesia. Yet, such approach introduces additional challenges to gynecologists, as the surgical instruments have to pass through the cervix, a narrow curved canal. This process can be traumatic and even cause tissue damage or rupture. Current training curricula mainly focus on general minimally-invasive surgical skills or on inpatient hysteroscopy. This paper describes the first virtual reality training system designed purposely for in-office hysteroscopy training featuring both passive and active haptic feedback. Design requirements were defined through a literature review and a survey of clinical experts. A dedicated platform was developed and tested with clinicians and medical students. The results of the conducted experiments verified the skill acquisition capabilities of the platform showing a.o. shorter execution time and path length, lower integral forces in most of non-expert participants. The results also demonstrated the capability of the system to differentiate between experts and non-expert groups. Reported findings suggest that the platform has the potential to evolve into an effective solution for in-office hysteroscopy training.

Ultrasound-Guided Right Internal Jugular Vein Cannulation by Operators of Different Experience: A Randomized, Pilot Study.

Background and aim: Currently, ultrasound-guided (US-guided) internal jugular vein (IJV) cannulation is the recommended technique. However, it has a learning curve and might be unsafe in inexperienced hands. The present study aimed to compare the performance and complications with two levels of experience in performing US-guided right IJV cannulation.Methods: With informed consent, 108 procedures were performed after random allocation into two groups based on operator experience. An operator with experience in performing 30 or more ultrasound-guided IJV cannulation was considered an expert. The rate of successful cannulation, the time needed, number of attempts, and complication rate were measured. Quantitative continuous variables were compared using the unpaired student's t-test, and the chi-square test or Fisher's-exact test was used for the comparison of qualitative variables; P-value < 0.05 was considered significant.Results: The successful cannulation rates were 100% versus 94.44% in the expert and non-expert groups, respectively; (P=0.0803). The mean time for successful cannulation and the percentage of patients who required ≥ two attempts were significantly lower in the expert group (33.28 seconds and 12.96% versus 95.42 seconds and 61.12%). Although the incidence of carotid artery puncture and hematoma (7.4% and 5.56%) was higher in the non-expert group, it was not statistically different; (P=1.00).Conclusion: US-guided right IJV cannulation has a learning curve, and procedures as many as 30 US-guided IJV cannulation need to be observed and performed under the guidance to achieve it.

A study on factors that affect error rates in handwriting examinations of Korean characters by forensic document examiners and non-experts

Forensic handwriting examinations are often considered important in trials, and especially those related to property issues. There is also increasing demand by courts for the quantification of handwriting examination results. Notably, in forensic science, error rates in forensic handwriting examinations should be carefully quantified in order to ensure their reliability as evidence. The present study examined error rates in forensic handwriting examinations conducted by both forensic document examiners (FDEs) and non-experts. To this end, four FDEs affiliated with forensic science institutes and a group of 20 laypersons were asked to perform a forensic handwriting examination of Korean characters in various forms (long text, short text, and signature samples) in blind test settings; i.e., specific information about the test was not given. The test was composed of 180 questions. The results showed that the incorrect answers are much higher in the non-expert group than the expert group though; however, the percentage of “inconclusive opinion” answers was higher in the expert group. It was also found that, in the expert group, error rates could be lowered by allowing a joint examination (or a peer review) to be performed. Meanwhile, the expert group showed relatively high error rates when dealing with handwriting samples simulated or disguised, rather than those that contained a small number of characters, such as signature samples. In the non-expert group, financial reward did not contribute to increasing the correct answers (%) of handwriting examination but rather encouraged examiners not to choose “inconclusive opinion” answers. This result indicates that a financial reward may unintentionally affect the examination results. The major findings of the present study are of significance in that this study is the first attempt to specifically examine error rates in forensic handwriting examinations of Korean characters conducted by both expert and non-expert groups. This study also demonstrated that the exchange of opinions among FDEs affected the resultant error rates and overall examination results. It was also found that financial reward may affect handwriting examination results as well.

Distributing Authorship at a Localised Scale: Developing public engagement in sound mapping

Sound maps, particularly the web-based examples that have proliferated since the early 2000s, have proven compelling and valuable as means of conveying diverse perspectives of urban, rural and wilderness sound environments, while opening the creative process of mapping through field recording to non-expert user groups. As such, sound maps hold the promise of broad public engagement with everyday sonic experience and spatial typologies. Yet this straightforward participatory aim is prone to complication in terms of participatory frameworks and scale of analysis. Drawing on a catalogue of sound maps by the author, this article problematises the participatory norms of sound mapping and, in tandem, calls for a more nuanced approach to scale than typically seen to date in sound maps based on geospatial mapping APIs. A sound mapping workshop in Lisbon with a multidisciplinary participant group provided the opportunity to ‘re-prototype’ sound maps at the scale of a local neighbourhood using multimodal means of representation; the results highlighted questions of form, scale, representation, authorship and purpose in sound mapping and demonstrated its continuing potential as a participatory practice.

Sanat Eğitimi ve Uzmanlık: Bir Göz İzleme Çalışması

The impact of education and expertise in art on the process of examining a work of art has been studied in the present study via eye tracking method. The main purpose of the study was to compare a group of experts and non-experts in art with regard to eye tracking measurements, artwork analyses and recall performance. In this research, expert and non-expert groups were compared in terms of eye tracking measurements, heat maps, artwork analysis and the recall performances. Heat maps were demonstrated that experts viewed Early Renaissance and Fauvism movements, artworks more while non-experts viewed Fauvist artworks more in comparison with AOIs. However, it was indicated that there is no statistically significant difference between the expert and non-expert groups for each artwork about eye metrics and recall performance during art-work analysis. On the other hand, artwork analysis grades of the experts were deter-mined to be higher at a statistically significant level in comparison with the non-experts.

Feasibility and safety of colonoscopy performed by nonexperts for acute lower gastrointestinal bleeding: post hoc analysis.

Background and study aims It remains unclear whether the experience of endoscopists affects clinical outcomes for acute lower gastrointestinal bleeding (ALGIB). We aimed to determine the feasibility and safety of colonoscopies performed by nonexperts using secondary data from a randomized controlled trial for ALGIB. Patients and methods We analyzed clinical outcomes in 159 patients with ALGIB who underwent colonoscopies performed by two groups of endoscopists: experts and nonexperts. We compared endoscopy outcomes, including identification of stigmata of recent hemorrhage (SRH), successful endoscopic treatment, adverse events (AEs), and clinical outcomes between the two groups, including 30-day rebleeding, transfusion, length of stay, thrombotic events, and 30-day mortality. Results Expert endoscopists alone performed colonoscopies in 96 patients, and nonexperts performed colonoscopies in 63 patients. The use of antiplatelets and warfarin was significantly higher in the expert group. The SRH identification rate (24.0 and 17.5 %), successful endoscopic treatment rate (95.0 and 100 %), rate of AEs during colonoscopy (0 and 0 %), transfusion rate (6.3 and 4.8 %), length of stay (8.0 and 6.4 days), rate of thrombotic events (0 and 1.8 %), and mortality (0 and 0 %) were not different between the expert and nonexpert groups. Rebleeding within 30 days occurred more often in the expert group than in the nonexpert group (14.3 vs. 5.4 % P = 0.0914). Conclusions The performance of colonoscopies for ALGIB by nonexperts did not result in worse clinical outcomes, suggesting that its use could be feasible for nonexperts for diagnosis and treatment of ALGIB.

Toward a Universal Readout for 18F-Labeled Amyloid Tracers: The CAPTAINs Study.

To date, 3 18F-labeled PET tracers have been approved for assessing cerebral amyloid plaque pathology in the diagnostic workup of suspected Alzheimer disease (AD). Although scanning protocols are relatively similar across tracers, U.S. Food and Drug Administration- and the European Medicines Agency-approved visual rating protocols differ among the 3 tracers. This proof-of-concept study assessed the comparability of the 3 approved visual rating protocols to classify a scan as amyloid-positive or -negative, when applied by groups of experts and nonexperts to all 3 amyloid tracers. Methods: In an international multicenter approach, both expert (n = 4) and nonexpert raters (n = 3) rated scans acquired with 18F-florbetaben, 18F-florbetapir and 18F-flutemetamol. Scans obtained with each tracer were presented for reading according to all 3 approved visual rating protocols. In a randomized order, every single scan was rated by each reader according to all 3 protocols. Raters were blinded for the amyloid tracer used and asked to rate each scan as positive or negative, giving a confidence judgment after each response. Percentage of visual reader agreement, interrater reliability, and agreement of each visual read with binary quantitative measures (fixed SUV ratio threshold for positive or negative scans) were computed. These metrics were analyzed separately for expert and nonexpert groups. Results: No significant differences in using the different approved visual rating protocols were observed across the different metrics of agreement in the group of experts. Nominal differences suggested that the 18F-florbetaben visual rating protocol achieved the highest interrater reliability and accuracy especially under low confidence conditions. For the group of nonexpert raters, significant differences between the different visual rating protocols were observed with overall moderate-to-fair accuracy and with the highest reliability for the 18F-florbetapir visual rating protocol. Conclusion: We observed high interrater agreement despite applying different visual rating protocols for all 18F-labeled amyloid tracers. This implies that the results of the visual interpretation of amyloid imaging can be well standardized and do not depend on the rating protocol in experts. Consequently, the creation of a universal visual assessment protocol for all amyloid imaging tracers appears feasible, which could benefit especially the less-experienced readers.

Study of Preference of Stereo Recording Techniques on Kendang Instruments in Jazz Ensembles

Kendang plays an important role in Simak Dialog, a jazz ensemble group that brings jazz and Sundanese music together This study aims to analyze the preferences of the stereo recording technique of kendang in a jazz ensemble. This research was done by conducting a subjective test of 16 audio samples of kendang which were recorded using the stereo technique XY 90o, XY 120o, ORTF, and AB with two variable distances and angles between microphones. 28 respondents consisting of expert and non-expert groups were asked to fill out a questionnaire to determine most prefered audio samples. Furthermore, interviews were conducted to identify aspects that determine the selection of audio samples. This study has identified that the expert group focused on stereo image, subjective frequency characteristics, and the balance between instruments in the ensemble, while the non-expert group more focused on clarity of kendang in terms of spectral characteristics and transients. The two groups focus on two different things. The expert group pays more attention to the the balance between the drums and other instruments. The non-expert group paid more attention to timbre and clarity. This indicates that spatial aspects, timbre, sound quality and defacts are critical aspects to form recording quality of kendang in a jazz ensemble.

The Role of Symmetry in the Aesthetics of Residential Building Façades Using Cognitive Science Methods

Symmetry is an important visual feature for humans and its application in architecture is completely evident. This paper aims to investigate the role of symmetry in the aesthetics judgment of residential building façades and study the pattern of eye movement based on the expertise of subjects in architecture. In order to implement this in the present paper, we have created images in two categories: symmetrical and asymmetrical façade images. The experiment design allows us to investigate the preference of subjects and their reaction time to decide about presented images as well as record their eye movements. It was inferred that the aesthetic experience of a building façade is influenced by the expertise of the subjects. There is a significant difference between experts and non-experts in all conditions, and symmetrical façades are in line with the taste of non-expert subjects. Moreover, the patterns of fixational eye movements indicate that the horizontal or vertical symmetry (mirror symmetry) has a profound influence on the observer’s attention, but there is a difference in the points watched and their fixation duration. Thus, although symmetry may attract the same attention during eye movements on façade images, it does not necessarily lead to the same preference between the expert and non-expert groups.

Adapting Action Learning Strategies to Operationalize Reflection in the Workplace

The ProblemOrganizations and human resources development (HRD) leaders are challenged to rethink and adapt learning and development strategies to address current and future needs. Yet, performance demands—as well as limited space, time, and resources—mean employees need to learn on their own. Not everyone knows how to do that well. The question arises: How can HRD better support employee learning?The SolutionReflective learning practices based on action learning (AL) support work-based learning. AL “tools” help peers learn by working together in diverse groups of nonexperts on real tasks to gain new perspectives and learn to frame and solve challenges.The StakeholdersThis article shows, through a review of existing reflective processes and tools, how HRD practitioners can adapt these practices to help groups of peers and teams learn while working, to support the organization and its members in fast-changing environments.

Tu1060 COLORECTAL ENDOSCOPIC SUBMUCOSAL DISSECTION BY NON-EXPERTS AS A RISK FACTOR FOR THE ONSET OF POST-ESD ELECTROCOAGULATION SYNDROME

Colorectal endoscopic submucosal dissection (ESD) is technically more difficult than gastric or esophageal ESD from the viewpoint of anatomy, and post-ESD complications, such as postoperative hemorrhage and perforation, have been reported. In particular, a post-ESD complication, post-ESD electrocoagulation syndrome (PECS), may lead to delayed perforation. Previous studies reported that risk factors for PECS included female sex, a long operative time, sample diameter, tumor diameter, and fractional excision. However, considering these risk factors, most patients require strict postoperative management, and it has been necessary to establish simpler risk factors. Our aim was to clarify risk factors for PECS after colorectal ESD and establish satisfactory postoperative management. We conducted a retrospective cohort study involving 164 patients with colorectal tumors (170 lesions) who had undergone colorectal ESD at our hospital between May 2013 and September 2018. Physicians who had experienced ≥1,000 sessions of colonoscopy were assigned to the expert group, and those who had experienced <1,000 sessions of colonoscopy were assigned to the non-expert group. We analyzed 156 patients. There were 107 males (68.5%). The mean age was 67 years (39-92 years). The expert group consisted of 102 patients and the non-expert group consisted of 54 patients. Based on univariate analysis, the operative time (expert and non-expert groups: 60 vs. 161 minutes, respectively), incidence of PECS (3.9 vs. 24.0%, respectively), and C-reactive protein level (0.480 vs. 1.615 mg/dL, respectively) were significantly higher in the non-expert group (p<0.001). According to multivariate analysis, the operative time (odds ratio: 1.01, 95%CI: 1.00-1.01, p=0.013) and incidence of PECS (odds ratio: 4.00, 95%CI: 1.01-15.9, p=0.049) were significantly higher in the non-expert group. Colorectal ESD is technically difficult, requiring high-level skills. This study demonstrated that treatment by non-experts required a long operative time, increasing the incidence of PECS. At most medical institutions, the admission period for colorectal ESD is established in a protocol, and it is important to predict risk factors for PECS before ESD. The operative time, sample diameter, tumor diameter, and fractional excision become known after ESD, but ESD treatment by non-experts is an index that can be predicted. Therefore, for colorectal ESD by non-experts, postoperative management in consideration of the onset of PECS is necessary.

Both the Observer's Expertise and the Subject's Facial Symmetry Can Affect Anatomical Position of the Head

It is easier to judge facial deformity when the patient's head is in anatomic position. The purposes of this study were to determine 1) whether a group of expert observers would agree more than a group of nonexperts on what is the correct anatomic position of the head, 2) whether there would be more variation in the alignment of an asymmetrical face compared with a symmetrical one, and 3) whether the alignments of experts would be more repeatable than those of nonexperts. Thirty-one orthodontists (experts) and 31 dental students (nonexperts) were recruited for this mixed-model study. They were shown randomly oriented 3-dimensional head photographs of an adult with a symmetrical face and an adolescent with an asymmetrical face. In viewing software, the observers oriented the images into anatomic position. They repeated the orientations 4weeks later. Data were analyzed using a generalized linear model and Bland-Altman plots. The primary predictor variables were experience and symmetry status. The outcome variable was the anatomic position of the head. The other variables of interest included time and orientation direction. There was a statistically significant difference between measurements completed by experts and nonexperts (F1,60=14.83; P<.01). The interaction between expertise and symmetrical status showed a statistically significant difference between symmetrical and asymmetrical faces in the expert and nonexpert groups (F1,60=9.93; P=.003). The interaction between expertise and time showed a statistically significant difference in measurement over time in the expert and nonexpert groups (F1,60=4.66; P=.03). The study shows that experts can set a head into anatomic position better than nonexperts. In addition, facial asymmetry has a profound effect on the ability of an observer toalign a head in the correct anatomic position. Moreover, observer-guided alignment is not reproducible.

Assessment of Competence in EVAR Stent Graft Sizing and Selection

The aims of this study were to develop a test of competence in endovascular aortic repair (EVAR) stent graft sizing and selection; to examine the test for evidence of validity; and to explore the experience required for the task. The test was developed based on a literature review resulting in 22 anatomical assessment points and a graft selection. Validity evidence was explored in an international cross sectional study. Twenty-two consultants with varying levels of experience in the field (novices, intermediates, and experts) were presented with computed tomography angiography of the aortic vessels from three patients. Test scores were based on summed z-scores using the anatomical measurements and graft choices of the experts as a reference. A proficiency score was established using the contrasting groups standard setting method. The assessment was shown to be reliable with an intraclass correlation coefficient of 0.83 (p<.001) and high internal consistency with a Cronbach's α of .91 (p<.001). Mann-Whitney U test showed that experts performed significantly better than novices and intermediates (p<.002 and p<.005, respectively). Regarding anatomical measurements, Mann-Whitney U test could discriminate between experts and novices (p=.002), between experts and intermediates (p=.010), and between novices and intermediates (p=.036). In stent selection the experts performed significantly better than both the novices and the intermediates (p=.002 and p=.007, respectively), while there was no significant difference between the two non-expert groups (p=1). A credible passing standard with appropriate consequences was established using the contrasting groups methods. This study presents a standardised and objective assessment tool of competence in vessel analysis and stent graft selection for endovascular aortic repair. This was supported by strong validity evidence with good internal consistency and discriminatory ability. The tool may be used to facilitate training and certification of future endovascular specialists.