Abstract
Background: International guidelines suggest that trainees should perform at least 100 flexible bronchoscopies in a supervised setting, but this number is not evidence based. An objective assessment method could provide educational feedback to trainees and help supervisors decide when basic competency is established. No former assessment instrument has been able to distinguish between trainees and experts. Objectives: The aim of this study was to explore the validity and reliability of a new assessment procedure relating to testing operators across multiple tasks with increasing difficulty using a standardized scoring form. Methods: The test was administered on a virtual reality bronchoscopy simulator to a total of 42 test subjects (14 senior consultants, 14 trainees and 14 medical students). The inter-rater reliability of the test procedure was explored according to examination of test results from 10 subjects using 3 raters (2 blinded). Results: We found a high inter-rater reliability (Cronbach’s α = 0.90). The assessment procedure sufficiently differentiated the performance of the 3 groups (p < 0.001). Assessment of 6 procedures was necessary to secure a generalizability coefficient >0.80. Conclusions: The new assessment procedure proved both valid and reliable.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.