CONTENT CHARACTERISTICS OF GRE ANALYTICAL REASONING ITEMS

Abstract

ABSTRACTIn actual test development practice, the number of test items that must be developed and pretested is typically greater, and sometimes much greater, than the number that is eventually judged suitable for use in operational test forms. This has proven to be especially true for one item type–analytical reasoning–that currently forms the bulk of the analytical ability measure of the GRE General Test.This study involved coding the content characteristics of some 1,400 GRE analytical reasoning items. These characteristics were correlated with indices of item difficulty, discrimination, and independence from the verbal and quantitative measures.Several item characteristics were predictive of the difficulty of analytical reasoning items. Generally, these same variables also predicted item discrimination, but to a lesser degree. Independence from the GRE verbal and quantitative measures was largely unpredictable.The results suggest several content characteristics that could be considered in extending the current specifications for analytical reasoning items. The use of these item features may also contribute to greater efficiency in developing such items. Finally, the influence of these various characteristics also provides a better understanding of the construct validity of the analytical reasoning item type.