Patterns of Response and Nonresponse from Teachers to Traditional and Web Surveys

Abstract

A study was conducted to compare the psychometric qualities of two identical forms of a survey administered in paper-and-pencil format and in Web format to 197 teachers randomly split into two paper and Web groups. While the rates of response were quite discrepant, the respective measures of reliability were extremely similar for the two versions of the survey. A followup study was conducted with the nonrespondents in the Web group to investigate reasons behind their decision not to complete the survey. Several methodological issues are raised as a result of the followup. (Contains 3 tables and 16 references.) (SLD) Reproductions supplied by EDRS are the best that can be made from the original document. WHAT...ANOTHER SURVEY??? PATTERNS OF RESPONSE AND NONRESPONSE FROM TEACHERS TO TRADITIONAL AND WEB SURVEYS PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) 1 Craig A. Mertler, Ph.D. (mertler@bgnet.bgsu.edu) Division of Educational Foundations & Inquiry School of Educational Leadership & Policy Studies College of Education & Human Development Bowling Green State University Bowling Green, OH 43403 U.S. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement ED&4CATIONAL RESOURCES INFORMATION CENTER (ERIC) This document has been reproduced as received from the person or organization originating it. 0 Minor changes have been made to improve reproduction quality. Points of view or opinions stated in this document do not necessarily represent official OERI position or policy. Paper presented at the annual meeting of the Mid-Western Educational Research Association, Columbus, OH (Oct. 15-18, 2003) Running head: PATTERNS OF RESPONSE AND NONRESPONSE... 2 BEST COPY AVAILABLE PATTERNS OF RESPONSE AND NONRESPONSE... 2 Abstract This paper discusses the results of a study comparing the psychometric qualities of two forms of an identical survey: one administered in paper-and-pencil format and the other administered in Web format. Two groups of teachers were surveyed. One group received a paper-and-pencil version of the survey; the other group was directed to a Webbased version of the survey. While the rates of response were quite discrepant, the respective measures of reliability were extremely similar for the two versions of the survey. A follow-up survey was conducted with the nonrespondents in the Web group in order to investigate reasons behind their decision not to complete the survey. Several methodological issues are raised as a result of the follow-up.This paper discusses the results of a study comparing the psychometric qualities of two forms of an identical survey: one administered in paper-and-pencil format and the other administered in Web format. Two groups of teachers were surveyed. One group received a paper-and-pencil version of the survey; the other group was directed to a Webbased version of the survey. While the rates of response were quite discrepant, the respective measures of reliability were extremely similar for the two versions of the survey. A follow-up survey was conducted with the nonrespondents in the Web group in order to investigate reasons behind their decision not to complete the survey. Several methodological issues are raised as a result of the follow-up.