Computer Literacy and the Accuracy of Substance Use Reporting in an ACASI Survey

Timothy P. Johnson,Michael Fendrich,Mary Ellen Mackesy-Amiti

doi:10.1177/0894439309350693

Abstract

In recent years, audio computer-assisted self-interviews (ACASI) have been demonstrated to increase and presumably improve the quality of drug reporting in epidemiologic research. Surprisingly little research is available, however, regarding the potential limitations of this technique. For example, it is unclear what effects computer literacy may have on the validity of substance use information collected via ACASI. Respondents with limited computer skills may become distracted by the automated technology, requiring the devotion of considerable cognitive effort to the navigation of unfamiliar computer equipment and software that would otherwise be available for use to more carefully process and answer survey questions. In this study, we report findings from a community ACASI survey conducted in Chicago, which are used to address this problem. Using multiple indicators of computer literacy, a covariance structure model was developed to test the hypothesis that persons with low computer literacy skills may report drug use with less accuracy. Biological assays were used to evaluate 30-day cocaine use reporting accuracy. Model findings confirmed a positive relationship between computer literacy and the accuracy of cocaine use reports. Future research should investigate strategies for improving the usability of self-administrated computer reporting systems for persons with little direct computer experience.

Highlights

Over the past several decades, considerable concern has been expressed regarding the quality of estimates of sensitive social behaviors such as drug use that have been traditionally obtained via self-reports during survey interviews (Babor, Brown, & DelBoca, 1990; Harrison & Hughes, 1997; Rouse, Kozel, & Richards, 1985)
Perhaps the most important innovation in this regard has been the development of audio computer-assisted selfinterviews (ACASI), a methodology designed in recognition of the importance of privacy and respondent comfort when reporting on sensitive topics such as drug use behaviors (O’Reilly, Hubbard, Lessler, Biemer, & Turner, 1994; Turner et al, 1998)
In addition to presenting gender, race, age, education, and income distributions, this table indicates that the concordance of past 30-day cocaine use reporting was 94.2% (91.6% were concordant for nondrug use; 2.6% were concordant for drug use)

Summary

Introduction

Over the past several decades, considerable concern has been expressed regarding the quality of estimates of sensitive social behaviors such as drug use that have been traditionally obtained via self-reports during survey interviews (Babor, Brown, & DelBoca, 1990; Harrison & Hughes, 1997; Rouse, Kozel, & Richards, 1985). Perhaps the most important innovation in this regard has been the development of audio computer-assisted selfinterviews (ACASI), a methodology designed in recognition of the importance of privacy and respondent comfort when reporting on sensitive topics such as drug use behaviors (O’Reilly, Hubbard, Lessler, Biemer, & Turner, 1994; Turner et al, 1998). For surveys of substance use and other sensitive topics, ACASI has arguably become the methodological standard. Little research is available, regarding the potential limitations of ACASI technology. It is unclear what effects computer literacy may have on the validity of substance use reports collected via ACASI. Persons with limited computer skills, for example, may become distracted by the automated technology, requiring the devotion of additional cognitive effort to the navigation of unfamiliar computer equipment and software that would otherwise be available for use to more carefully answer survey questions

Objectives

Methods

Results

Conclusion