This paper illustrates cut-and-try techniques that point to appropriate transformations of variables and to the selection of sets of variables for an equation that may improve understanding of a social process. The substance of the research reported — the relation of mental test results to state population, cultural, and school resource indexes (Walberg and Rasher, 1974) — illustrates typical problems of behavioral data: multi-colinearity, outliers, abnormal distributions, and the lack of a consensually-validated, explicit theoretical model. Despite these problems, data originally collected for purposes other than the investigator’s may yield tentative confirmations or cautions about prior findings and provisional indications for theory or policy; such inferences may be at least partially checked by cross-validation on independent or semi-independent sets of data. After discussing the sequence of analyses and the results, we conclude by mentioning a number of uncertainties and reservations about drawing substantive or policy implications.
Read full abstract