GENERALIZATION OF GRE GENERAL TEST VALIDITY ACROSS DEPARTMENTS

Abstract

ABSTRACTThis study of the validity of the GRE General Test used data from predictive validity studies that were conducted by the GRE Validity Study Service (VSS) in 79 graduate departments. The performance criterion was first‐year grades in graduate school. Observed validities were computed, and for each graduate department validities were also estimated for groups at two other stages of selection–applicants for admission to the department, and all GRE takers.Two validity generalization hypotheses were tested. One was that the General Test's validities were equal across studies; the other was that the General Test's validities had equal ratios across studies, that is, that the level of the validities might vary from institution to institution but the ratios would be constant. These hypotheses were applied for VSS groups, applicant groups, and all GRE takers, and implied validities (validities that would be observed if the hypotheses were true) were calculated. When the implied validities were compared to the observed validities, it was found that the assumption of equal validity did not account well for differences in the level of observed validity of the GRE General Test. The equal ratio hypothesis accounted for the observed validities rather well, possibly due to overcapitalization on chance, but departmental discipline was not significantly related to the degree of fit of observed to implied validities.At all levels of selection, the study yielded applicant validities that were predominantly positive. This lends support to the presumption that the General Test's validity is transportable, i.e., institutions that do not use the General Test can, if they adopt it, expect it to prove valid. In view of the scarcity of very low or negative validities, studies revealing such validities should be questioned.