Comparison the Efficiency and the Effectiveness of a New Comprehensive Test Management Software (NAJMA Software) with Traditional Method in Resident in-training and pre-board Examinations in Isfahan University of Medical Sciences

Abstract

Background and Object: Considering new e-teaching and e-learning systems, and electronic assessment tools, this study was performed assessing the efficiency and the effectiveness of a new generated comprehensive test management software (CTMS), named NAJMA, in medical resident evaluation. Materials and Methods: This cross sectional descriptive study was conducted in Isfahan University of Medical Sciences in 2015. Statistical analysis of the questions was done comparing the two models of examination management performed in 2014 and 2015 to evaluate all medical residents of 21 specialties in Faculty of Medicine. Totally 6300 questions from 42 question books based on the model of exams hold in 2014 and 2015 were analyzed. A survey questionnaire was administered to faculty members to obtain their insight into their perceptions of the two models. Results: The cost of formatting and performing the examinations was considerably lower in CTMS method. From the whole 377 members. 64.8% of faculties preferred the CTMS method in management of resident examinations. Number of residents participated in the examinations was 711 in 2014 and 668 in 2015. There were no differences among traditional and CTMS methods considering statistical analysis and Millman structural criteria. Conclusion: Improving and utilization of CTMS method in all university and state examinations will result in reducing human and material costs. Meanwhile satisfaction of faculty members and security of the examinations will be improved by eliminating intermediate processes from developing to analyzing the examination questions.