Evaluation of the Relationship between Student Performance on the PACKRAT And PANCE Examinations

Abstract

Purpose: The purpose of this study is to determine the relationship between student scores on the Physician Assistant Clinical Knowledge Rating and Assessment Tool (PACKRAT) and performance on the Physician Assistant National Certifying Examination (PANCE). Methods: PACKRAT scores from students enrolled in the Interservice Physician Assistant Program (IPAP) following their didactic year of training were compared to the PANCE scores by the same students. The PACKRAT examination was administered to students within the last few weeks of their first year of training, just prior to beginning their clinical rotations. The PANCE scores represent the first attempt by IPAP graduates to attain certification shortly following completion of their second phase of training (clinical rotations). The study included those students that began their training in May of 1999 through May 2001. The first didactic year is divided into three separate trimesters and a new class of students begins each four months. This represents students included in seven different classes (n = 375). The relationship between the scores was evaluated by determination of the correlation coefficient. Analysis of the predictive value of PACKRAT results with respect to passing the PANCE was accomplished using logistic regression. Results: Correlation between PACKRAT and PANCE scores showed a correlation coefficient of 0.668 (P<0.001). Logistic regression showed a significant relationship between PACKRAT scores and PANCE performance (P<0.001). A PACKRAT score of < 55% (raw score = 124) had a sensitivity of 77.2% and specificity of 83.3%. Conclusions: The scores obtained by the students on the PACKRAT examination correlated well with those obtained on the first administration of the PANCE. In addition, PACKRAT scores proved to have a strong predictive value of student pass/fail performance on the PANCE.