PTH-145 Validation of direct observation of procedural skills (DOPS) assessments for paediatric gastroscopy

Abstract

Introduction Direct observation of procedural skills (DOPS) are tools designed by the Joint Advisory Group (JAG) to assess competence in endoscopy. These were expanded in July 2016 (new DOPS) to include those specific to paediatric gastroscopy (OGD). However, paediatric OGD DOPS assessments have not been validated. Methods We performed a prospective UK-wide analysis of formative paediatric OGD DOPS submitted to the JETS e-Portfolio over one-year (August 2016–2017). Scores were averaged across procedural domains (pre-procedural, procedural, post-procedural and endoscopic non-technical skills – ENTS), and according to skillset (cognitive or technical), and compared with the overall performance score using Spearman’s correlation. Overall scores were also compared by trainee grade. Results 157 DOPS assessments were completed by 20 unique trainers for 17 trainees. Overall performance score comprised: 1: Maximal supervision (4.5%), 2: Significant supervision (14.0%), 3: Minimal supervision (24.8%) and 4: Competent (56.7%). By domain, overall competence correlated most with mean scores for the ‘Insertion and Withdrawal’ domain (rho: 0.884, p Conclusions Competencies in paediatric OGD, as assessed within DOPS, vary in their correlation with overall competence. Strong correlations were reported for the ‘Insertion and Withdrawal’ domain, ‘Management of Complications’ items, and ‘’Technical’ skillsets. As assessors are completing the new DOPS in a consistent manner, with scores improving by seniority, this provides validity evidence for the new paediatric OGD DOPS.