Question Order Effects in Sustainable Behavior Norm Measurement: Gender Differences

Mykolas Simas Poškus,Raimonda Sadauskaitė

doi:10.15388/psichol.2015.51.8256

Mykolas Simas Poškus, Raimonda Sadauskaitė

Open Access

https://doi.org/10.15388/psichol.2015.51.8256

Copy DOI

Journal: Psichologija	Publication Date: Jul 1, 2015
Citations: 9	License type: cc-by

Affiliation: Mykolas Romeris University, Klaipėda University

Abstract

Sustainable behavior is an important and increasingly popular field of research, but the question order effects that may occur in descriptive and injunctive sustainable behavior norm measurements remain largely unexplored. Even less attention is drawn to gender differences that may be present in question order effects. In the present study, we have investigated the question order effects and their gender differences in measurements of descriptive and injunctive social norms directed at sustainable behavior. For the purposes of the study, three questionnaires were constructed, each questionnaire consisting of 16 items half of which were directed at injunctive and half at descriptive social norms. The questionnaires differed only in the order in which the items were presented. Engineering, art, and social science students from various Lithuanian universities participated in the study (N = 296). The participants were equally distributed by gender, their mean age was 20 years (SD = 1.5). Participants were asked to fill in the questionnaires during lectures, and each participant was randomly assigned to fill in one of three types of questionnaires. The results have shown that the evaluations of injunctive and descriptive social norms were sensitive to the question order. When priming participants with one type of social norm, the evaluation of the other type of social norm was affected. Presenting questionnaire items in random order did not cancel priming; rather, it made both types of social norms salient at the same time, and therefore norm measurements of this group did not differ from those that were obtained under priming. The further analysis indicated that the question order effects were present only in the female sample. We recommend presenting questionnaire items directed at descriptive and injunctive social norms in random order. When measuring just one type of social norm, we would recommend adding items directed at the other type of social norm as well, in order to obtain data that would be more comparable with other studies.

Highlights

There are many circumstances under which unwanted and hard to predict question effects can occur (Holbrook, Krosnick, Moore, & Tourangeau, 2007; Yang & Wyckoff, 2010; Lasorsa, 2003)
In order to determine whether the question order effects in the descriptive and injunctive social norm measurements were present in the experimental conditions, we conducted a Kruskal–Wallis test
In the case of injunctive norm measurements, when the items directed at descriptive norms were presented first, as well as when items were presented in random order, the norm measurements differed from the condition where the injunctive items were presented first

Summary

Introduction

There are many circumstances under which unwanted and hard to predict question effects can occur (Holbrook, Krosnick, Moore, & Tourangeau, 2007; Yang & Wyckoff, 2010; Lasorsa, 2003). The present study is concerned with the type of order effects that are induced by the relative position of an item in a questionnaire and the context of the previous questions (Ramirez & Straus, 2006; Siminski, 2006). These types of order effects can distort and invalidate the obtained data (Yang & Wyckoff, 2010). Answers to questions on a similar topic can largely depend on the answer to the first question or prior judgments in general

Objectives

Methods

Results

Conclusion