In this study two types of criterion-related validity of the Quarterly Profile Examination (QPE) were assessed. The QPE is a computer assisted test construction system designed for the longitudinal measure of the acquistion and retention of facts in the medical sciences. QPE scores from four graduating classes were utilized to determine the relationships among various measures of performance. Cumulative grade point average, examination scores from Part I and II of the National Board of Medical Examiners (NBME) series, and a clinical performance evaluation served as concurrent criterion measures. Clinical performance as measured by the Resident Evaluation Form and examination scores from Part III of the NBME series served as predictive criterion measures. The resulting significant correlations between the QPE total score and the concurrent and predictive criterion measures suggest that the QPE is a valid and accurate measure of overall performance during the course of medical school, as well as a useful predictor of performance beyond medical school.