The Medical Examination - Between Desire and Reality - Analysis of Consensus Between the Second Part of the Medical Licensing Exam (IMPP) and the National Catalogue of Expertise-based Learning Goals in Surgery (NKLC)

Abstract

Background The working party of the German Society for Surgery (DGCH) on undergraduate surgical education has developed a national expertise-based catalogue of learning goals in surgery (NKLC). This study analyses the extent to which the questions of the German second medical licensing examination compiled by the IMPP are congruent with the NKLC and which thematic focus is emphasised. Materials and Methods Firstly, a guideline and evaluation sheet were developed in order to achieve documentation of the individual examination questions of the second licensing examination with respect to the learning goals of the NKLC. In a retrospective analysis from autumn 2009 to autumn 2014, eleven licensing examinations in human medicine were screened independently by three different reviewers. In accordance with the guideline, the surgical questions were identified and subsequently matched to the learning goals of the NKLC. The analysis included the number of surgical learning goals as well as the number of surgical questions for each examination, learning goal, and different levels of expertise (LE). Results Thirteen reviewers from six surgical disciplines participated in the analysis. On average, reviewers agreed on the differentiation between surgical and non-surgical questions in 79.1% of all 3480 questions from 11 licensing examinations. For each examination (n = 320 questions), 98.8 ± 22.6 questions (min.: 69, max.: 150) were rated as surgical. For each surgical learning goal addressed, 2.2 ± 0.3 questions (min.: 1, max.: 16) were asked. For each examination, 23.5 ± 6.3 questions (min.: 11; max.: 31) referred to learning goals of LE 3, 52.5 ± 16.7 questions (min.: 34; max.: 94) addressed learning goals of LE 2 and 22.8 ± 7.7 questions (min.: 9; max.: 34) were related to learning goals of LE 1. 64 learning goals (27.8% of all learning goals of the NKLC) were not reflected in the examinations. With a total of 70 questions, the most frequently examined surgical topic was "disorders of the rheumatic spectrum". Conclusion The number of surgical examination questions in the German second medical licensing examination seems to be sufficient. However, the questions seem to be unevenly distributed between different surgical areas of undergraduate education. In order to achieve a more homogenous representation of relevant surgical topics, improved alignment is needed between the state examination with existing catalogues of learning goals by the IMPP.