Evaluation of Multiple Variables Predicting the Likelihood of Passage and Failure of PANCE

Abstract

A significant positive correlation between the Physician Assistant National Certifying Examination (PANCE) and the PAEA Physician Assistant Clinical Knowledge Rating and Assessment Tool (PACKRAT) has been found in previous studies. This study's goal was to improve prediction of PANCE failure using other predictive measures, alone and in combination, with the PACKRAT. Correlation and discriminate and regression analyses were conducted on 3 years of data (2007-2009) collected from Chatham University PA Studies graduates, with convergent results. Significant positive correlations between the PANCE and each of the assessment measures were found (in order of significance): (1) the PACKRAT exam; (2) a summative multiple choice question exam given near the end of the clinical (second) year; (3) average multiple-choice-question-exam results from the didactic (first) year; (4) prerequisite preadmission GPA; and (5) overall preadmission GPA. Discriminant analyses revealed the combined solution of PACKRAT, SUMM, and MCQ to most accurately differentiate between the "pass" versus "fail" groups on the PANCE. Most importantly, regression analyses revealed the combined solution of SUMM and MCQ to most accurately predict PANCE performance at the low end of the scale. This research suggests that all assessment measures tested can provide helpful estimates of PANCE performance; however the combined SUMM and MCQ solution provided the most reliable and accurate prediction of PANCE performance for "high risk" students. Other physician assistant programs could develop analyses of their internal testing assessments to identify students at risk of PANCE failure and allocate institutional and program resources to improve rates of PANCE passage.