A Comparison of Survey Data Collected by Regular Mail and Electronic Mail Questionnaires

Abstract

A survey was conducted by the National Council on Measurement in Education (NCME) to examine the telecommunications needs of the organization's membership. A component of this study permitted an examination of two response modalities (regular mail and e-mail) across a number of variables. Separate samples of 585 were drawn to take the survey. The first sample consisted of all those organization members who had registered their e-mail address with the organization while the second sample was randomly selected from those members who did not list an e-mail address. The first group was sent a nine question instrument via e-mail while the second group was asked to fill out a ten question instrument via regular mail. Overall response rates were low and significantly different [30% for the e-mail group and 36% for the regular mail group, χ2 (1) = 10.42, p < .01], though not uncommon for institutional surveys. Individual item response rates, however, were statistically significantly higher for the e-mail group across a number of dimensions. The results suggest that for some organizations, e-mail questionnaires may be a viable mechanism for conducting surveys. Suggestions are made on how to improve overall response rates.