Predictive validity of pre-admission assessments on medical student performance.

Al-Awwab Dabaliz,Akef Obeidat,Mohammad Abrar Shareef,M Marwan Dabbagh,Ayman Mohamed,Mohamad Al-Tannir,Abdulaziz Barakat,Samy Kaadan

doi:10.5116/ijme.5a10.04e1

Abstract

ObjectivesTo examine the predictive validity of pre-admission variables on students’ performance in a medical school in Saudi Arabia. MethodsIn this retrospective study, we collected admission and college performance data for 737 students in preclinical and clinical years. Data included high school scores and other standardized test scores, such as those of the National Achievement Test and the General Aptitude Test. Additionally, we included the scores of the Test of English as a Foreign Language (TOEFL) and the International English Language Testing System (IELTS) exams. Those datasets were then compared with college performance indicators, namely the cumulative Grade Point Average (cGPA) and progress test, using multivariate linear regression analysis.ResultsIn preclinical years, both the National Achievement Test (p=0.04, B=0.08) and TOEFL (p=0.017, B=0.01) scores were positive predictors of cGPA, whereas the General Aptitude Test (p=0.048, B=-0.05) negatively predicted cGPA. Moreover, none of the pre-admission variables were predictive of progress test performance in the same group. On the other hand, none of the pre-admission variables were predictive of cGPA in clinical years. Overall, cGPA strongly predict-ed students’ progress test performance (p<0.001 and B=19.02).ConclusionsOnly the National Achievement Test and TOEFL significantly predicted performance in preclinical years. However, these variables do not predict progress test performance, meaning that they do not predict the functional knowledge reflected in the progress test. We report various strengths and deficiencies in the current medical college admission criteria, and call for employing more sensitive and valid ones that predict student performance and functional knowledge, especially in the clinical years.

Highlights

The medical school admission process is an ever-growing topic on which the literature is voluminous
The aim of this study is to examine the predictive validity of the Saudi national pre-admission variables and English language proficiency standardized tests on medical students’ performance using the progress test (PT) and cumulative Grade Point Average (cGPA) as indicators of student performance
Academic assessment Our findings indicate that the NAT is a significant positive predictor of student performance in preclinical years through the cGPA; it was not found to be predictive of performance in clinical years

Summary

Introduction

The medical school admission process is an ever-growing topic on which the literature is voluminous. Studies have questioned the predictive validity of the various pre-admission variables on college academic performance. The necessity of further validation and refinement of pre-admission variables that are invalid or weakly predictive has been established in several studies.[1,2,3]. In Saudi Arabia, medical schools depend on a composite of pre-admission variables in their student selection. The main pre-admission variables currently being used are the cumulative high school average, the National Achievement Test score (NAT, locally known as Tahsili), the General Aptitude Test score (GAT, locally known as Qudrat), in addition to the English language proficiency exam score

Objectives

Methods

Discussion

Conclusion