Evaluation of a national neurosurgical formative examination: the UK experience

Abstract

Introduction: Formative assessment is a key component in medical education and that it is a helpful process for all involved. Until recently there was no national formative examination for neurosurgical trainees. The Neurosurgery Annual in Training Examination (NAiTE) is an annual online, formative assessment that was introduced in 2014. In this paper, we seek to discuss how well NAiTE relates to established educational practice and principles and its fitness for purpose by discussing its rationale, structure and utility.Methods: A national online examination was introduced in 2014. The NAiTE consists of 100 single best answer multiple choice questions. The examination and questions with were reviewed and the global results presented. The existing literature and educational theory are used to guide subjective assessment of the process.Results: In 2016, 191 candidates participated in the NAiTE, of whom 154 were trainees working in UK neurosurgical units. The mean score for early stage UK trainees (years 1-3) was 52.4%, intermediate (years 4-5) 58.5% and senior (years 6-8) 65.4%. The NAiTE was found to be a reliable (Cronbach-Alpha of 0.89) and valid assessment of trainees with scores approximating those attained in the Intercollegiate Specialty Examination itself.Discussion: Potential areas for improvement are highlighted, including reference to some that have already been implemented.Conclusion: Overall, the examination is a cheap, viable and reliable means of testing trainees and encouraging their onward development and learning as they work towards the Intercollegiate Specialty Examination