Online Survey Experiment Research Articles

Persistence of the Gender Frame: Gender Perceptions of Ambiguous Chinese and Gender-Neutral American Names in the United States

How do people conduct gender classification in ambiguous contexts? A gender framing perspective suggests the pervasiveness and consequences of using gender in novel contexts, but there is a paucity of knowledge about how people assign a gender to ambiguous targets in interpersonal relations. This study fills in this knowledge gap by investigating how U.S. individuals classify the gender of two types of gender-ambiguous names—Chinese names written in English letters and gender-neutral American names. It also examines how respondents’ gender ideologies and racial stereotypes are associated with their perceptions of gender-ambiguous names. An online survey experiment with 795 U.S. individuals finds that respondents predominantly assign a binary gender (versus neutral or unsure) to both Chinese names (40.8 percent men and 37.4 percent women) and gender-neutral American names (41.1 percent men and 19.4 percent women). Multivariate analyses reveal that respondents with traditional gender ideologies associate a gender-binary perception with gender-neutral American names rather than Chinese names. Meanwhile, respondents who endorse the racialized stereotypes that Chinese people are socially cold and/or generally competent are more likely to perceive Chinese names as men’s names. These findings demonstrate that a gender-binary frame persists in ambiguous contexts, and that the classification outcome is conditional on contextual signals and preexisting cultural beliefs. They also deepen understanding of gender neutrality during social interactions and a gendered nature of racialized stereotypes.

Classrooms or Crackdowns? How Violence Affects Security Policy Preferences in Mexico

AbstractPenal policies have been the primary strategy of Latin American governments to combat crime, but preventative social policies such as youth education programmes may be more effective solutions. Penal and social policies are often treated as a trade-off by governments, who expect citizens—especially victims of violence—to be more supportive of punitive solutions. Using an original online survey experiment conducted in 2021 in Mexico, we challenge the idea of a trade-off between penal and social policies by studying how different policy solutions along the penal-welfare policy continuum affect victims’ support for increased state security presence. We unpack differences between victims of criminal perpetrators and state violence and those who are fearful of crime. Our vignette experiment reveals—in contrast to previous results—that crime victims are more supportive of state security presence when coupled with pre-emptive measures. Surprisingly, the same holds for victims of state violence and for those fearful of crime, including those residing in neighbourhoods with watch groups. Victimisation, by either crime or the state, raises demand for policies to increase employment and improve education.

Too many numbers and worse word choice: Why readers find data-driven news articles produced with automation harder to understand

The production of data-driven journalism is becoming increasingly automated, impacting its composition and comprehensibility. Given the importance of data-driven reporting for democratic participation, this study investigates, firstly, how readers evaluate the composition of data-driven articles produced with and without the help of automation and, secondly, how these evaluations affect readers’ perceptions of the articles’ comprehensibility. In an online survey experiment, 3135 online news consumers evaluated 24 articles produced with or without automation using criteria developed in prior research. Our factor analysis reduced those criteria to five categories that matter in readers’ evaluations of the articles’ composition: numeric features, writing style, sentence and paragraph length, descriptive language, and word choice. Our results show, firstly, that although the perception of news stories produced with automation did not differ significantly from that of news stories produced without automation regarding sentence and paragraph length and writing style, the stories produced with automation were evaluated as significantly less comprehensible; and, secondly, that this can be explained partly by readers’ perceptions of some of the other article composition categories, which were rated significantly worse in automated articles. Our findings suggest that using automation to produce data-driven news articles changes their perceived composition in ways that negatively impact comprehensibility. However, this study also suggests how such articles could be made more comprehensible. Specifically, when ‘post-editing’ automated articles, journalists should aim to further reduce the quantity of numbers, better explain words that readers are unlikely to understand and change inappropriate wording.

Multitasking, subtitles, and product placement effectiveness: an analysis of multitasking influencing the effectiveness of product placement and being influenced by audiovisual translation formats

ABSTRACT Placing brands and products in movies and series has significantly increased in recent years, leading to more research on the subject being undertaken. Little of this research has so far focused on the relationship between multitasking by audiences and the effectiveness of product placement. This study tests time the correlation between levels of multitasking and brand recall of placements in programs. The second objective of the study is to investigate if there is any link between the version of a program watched (i.e. original, dubbed, or subtitled), and levels of multitasking. The experimental online survey showed no difference in brand recall among viewers engaging in secondary activities while watching a program for up to 5 minutes in a 20-minute episode. The addition of subtitles increased screen attention, and viewers did not multitask as much. An innovative out-of-lab method consisting of in-home video observation produced high-precision time data on viewers’ multi-tasking behavior and enabled cross-checking with the survey answers for false-positives. The main outcome of this study is that multitasking while watching shows or movies should not be a concern for advertisers investing in product placement.

The Influence of Risk Perceptions on Consumers’ Willingness to Pay for Nutrient-enhanced Microgreens

Microgreens are young plants used as ingredients and flavoring in various dishes. Their production time is short, and their production methods can be altered to enhance the nutritional content. To date, consumers’ preferences for microgreens that display different esthetic and nonesthetic traits have not been addressed. Additionally, consumers’ perceived risk of production methods used to enhance nutrition has not been investigated. An online survey and choice experiment involving a sample of 821 consumers in Tennessee were performed to investigate these topics. A mixed logit model was used to analyze the data. Both esthetic and nonesthetic traits influenced the consumers’ preferences. Green microgreens were preferred and valued more than light or dark purple microgreens. When fertilizer was used during production to enhance nutrients, consumers perceived the microgreens as riskier to the environment and for personal consumption relative to microgreens with light-induced nutrient enhancement. Using lighting during production to enhance nutrients generated a $0.47 to $0.79 premium relative to no nutrient enhancement. In general, if participants’ perceived risk aligned with the nutrient enhancement attribute (i.e., light, fertilizer), then their willingness to pay for the microgreens decreased. This was amplified for the fertilizer nutrient enhancement attribute more than it was for the light enhancement attribute. In-state production and microgreen height also impacted consumer preferences for microgreens.

Sorry Not Sorry: Presentational strategies and the electoral punishment of corruption

A growing literature has explored various factors that hamper the electoral punishment of corruption. Most studies have focused on how voters react to a corruption allegation, but this focus leaves out an important, common aspect of corruption allegations that voters also encounter: politicians' blame avoidance strategies. This study examines how politicians' presentational strategies in response to corruption allegations affect voter sanctioning. Employing an online survey experiment on a sample of 3531 U.S. citizens, we find that politicians' action-oriented strategies, such as denying allegations, acknowledging a problem but denying responsibility, or acknowledging a problem and taking responsibility, are more effective than passive non-response. These three active strategies do not differ in their effectiveness. This result is robust to heterogenous levels of state-level corruption, partisan bias, and political knowledge. Our findings suggest that politicians’ presentational strategies may undermine political accountability for corruption, although they do not fully counteract the effect of corruption on voting intentions.

Estimating public opinion from surveys: the impact of including a “don't know” response option in policy preference questions

Abstract What are the consequences of including a “don't know” (DK) response option to attitudinal survey questions? Existing research, based on traditional survey modes, argues that it reduces the effective sample size without improving the quality of responses. We contend that it can have important effects not only on estimates of aggregate public opinion, but also on estimates of opinion differences between subgroups of the population who have different levels of political information. Through a pre-registered online survey experiment conducted in the United States, we find that the DK response option has consequences for opinion estimates in the present day, where most organizations rely on online panels, but mainly for respondents with low levels of political information and on low salience issues. These findings imply that the exclusion of a DK option can matter, with implications for assessments of preference differences and our understanding of their impacts on politics and policy.

Acceptability of de-intensified screening for women at low risk of breast cancer: a randomised online experimental survey

BackgroundRisk-stratified approaches to breast screening show promise for increasing benefits and reducing harms. But the successful implementation of such an approach will rely on public acceptability. To date, research suggests that while increased screening for women at high risk will be acceptable, any de-intensification of screening for low-risk groups may be met with less enthusiasm. We report findings from a population-based survey of women in England, approaching the age of eligibility for breast screening, to compare the acceptability of current age-based screening with two hypothetical risk-adapted approaches for women at low risk of breast cancer.MethodsAn online survey of 1,579 women aged 40–49 with no personal experience of breast cancer or mammography. Participants were recruited via a market research panel, using target quotas for educational attainment and ethnic group, and were randomised to view information about (1) standard NHS age-based screening; (2) a later screening start age for low-risk women; or (3) a longer screening interval for low-risk women. Primary outcomes were cognitive, emotional, and global acceptability. ANOVAs and multiple regression were used to compare acceptability between groups and explore demographic and psychosocial factors associated with acceptability.ResultsAll three screening approaches were judged to be acceptable on the single-item measure of global acceptability (mean score > 3 on a 5-point scale). Scores for all three measures of acceptability were significantly lower for the risk-adapted scenarios than for age-based screening. There were no differences between the two risk-adapted scenarios. In multivariable analysis, higher breast cancer knowledge was positively associated with cognitive and emotional acceptability of screening approach. Willingness to undergo personal risk assessment was not associated with experimental group.ConclusionWe found no difference in the acceptability of later start age vs. longer screening intervals for women at low risk of breast cancer in a large sample of women who were screening naïve. Although acceptability of both risk-adapted scenarios was lower than for standard age-based screening, overall acceptability was reasonable. The positive associations between knowledge and both cognitive and emotional acceptability suggests clear and reassuring communication about the rationale for de-intensified screening may enhance acceptability.

Anchoring of political attitudes

This paper studies the malleability of individuals’ political attitudes to simple anchors. Using an online survey experiment, we provide participants with the policy preference of one anonymous previous survey respondent. We exogenously vary whether participants are shown a Republican-aligned or Democrat-aligned response. We demonstrate that anchoring has a significant effect on an individual’s stated political attitudes even with this minimal anchor. Our results support the susceptibility of individuals to be easily persuaded through strategic anchoring.

Blurred Ideas: How Perpetrator Behavior, Target Response, and Observer Gender Can Influence Perceptions of Workplace Sexual Harassment.

Despite increasing awareness, sexual harassment remains a significant concern in the workplace. The enduring problem of sexual harassment seems to persist due to a lack of clarity regarding what behaviors qualify as harassment. Furthermore, the interpretation of these behaviors is influenced by contextual and relational factors, contributing to the complexity of addressing and preventing such incidents. This study builds on existing research by investigating how the severity of sexually harassing behavior, the response from the target, and the gender of the participant contribute to labeling behavior as sexual harassment. Using an online experimental scenario-based survey, 1,700 (850 female, 850 male) currently employed participants were presented with a single workplace scenario that manipulated the severity of the sexual harassment behavior and the target's response. Participants were then asked to assess the appropriateness of the behavior, label it as sexual harassment or not, and rate their confidence in their labeling decision. The results revealed that less severe sexual harassment behaviors, targets who displayed interest, and male participants were more likely to perceive the behavior as less inappropriate and were less inclined to label it as sexual harassment. These findings have implications for shaping the definition of sexual harassment and designing training programs for heightened awareness.

The influence of environmental cleanliness on food perceptions.

Background: Getting consumers to adopt healthier eating habits continues to be a puzzle for marketers and policymakers all over the globe. Nevertheless, research continues to identify factors that can influence consumers' food consumption. Aim: The purpose of this research is to explore how one relatively unexplored factor, namely the cleanliness of the surrounding environment, can affect perceptions and consumption. Methods: An online survey experiment presenting participants with either a clean or dirty environment scenario and asking subsequent questions about their dining experience was utilized. Results: Participants in a clean (vs. dirty) environment perceived their food to be healthier, fresher, and of higher quality, relative to a dirty environment. This effect, in turn, mediated the relationship between condition and perceptions of meal quality. Conclusion: Clean environmental conditions, though not directly related to the food products provided at food venues, can nevertheless have a strong influence on consumers' dining experience.

Migration aspirations in relation to border closures, employment opportunities and risk-taking attitudes: lessons from an online survey experiment

ABSTRACT This article investigates the effect of structural and individual factors on migration aspirations in a secondary migration context. Through an online survey experiment conducted with Syrian migrants (N = 551) living in Turkey, we unpack factors explaining aspirations to stay and move onward from the current country of residence. The findings indicate that open borders alone do not compel migrants to move onward. Instead, employment opportunities in their current residence play a crucial role in shaping aspirations to stay put. Moreover, individuals inclined to take risks are more likely to migrate, even when strict border controls are in place. By highlighting the question of what motivates migrants to stay as well as to move onward, this research emphasizes individual differences in forming migration aspirations and contributes to migration aspirations literature in the secondary migration context.

Self-benefits, fiscal risk, and political support for the public healthcare system

The rapid aging of the population has become increasingly challenging for public healthcare systems. To ensure sustainability, governments must persuade their citizens to accept a larger burden, which is a difficult task. This study explored whether informing individuals of self-benefits from the healthcare system could be a solution. We first constructed a two-period overlapping generations model and hypothesized that doing so could facilitate political support for larger healthcare insurance contributions; however, this effect is reduced when people are concerned about fiscal sustainability due to a declining fertility rate. To test these hypotheses, we conducted an online survey experiment in Japan, in which the treatment group was informed of the benefits from the public healthcare system. We found that the treatment had no effect on average but augmented support for a larger burden among respondents who were unaware of fiscal unsustainability. Furthermore, this positive effect on optimistic respondents reduced once they were informed of the fiscal risks. Moreover, we analyzed the heterogeneity of the treatment effects depending on time and risk preferences.

Cutback management: Strategy, blame attribution, and evaluation of government

AbstractCutback management literature examines how governments engage strategies and maintain organizational performance in times of resource decline. While much of this literature has focused on financial outcomes, in this study we incorporate citizen evaluation of government as the outcome of interest. Additionally, we assess how blame attribution for the resource decline influences citizen evaluations. Using an online survey experiment, we bridge the literatures of cutback management, citizen evaluation of government, and blame attribution to explore how citizens evaluate governments by financial decisions and blame for a deficit. Results show that less blame improves citizen evaluations for each cutback strategy.

Youth Participatory Action Communication Research: A Model for Developing Youth-Driven Health Campaigns

ABSTRACT Youth offer valuable insight on health communication needs and solutions in their communities. We propose youth participatory action communication research (YPACR) as a model for health campaign development that engages youth perspectives in applying systematic theory-informed communication research to addressing youth-identified health priorities. YPACR informed a series of paid high school internship programs in West Philadelphia, in which youth interns identified mental health help-seeking communication as a need among peers. In Phase 1, guided by the reasoned action approach and Hornik & Woolf method, youth interns conducted a survey measuring behavioral beliefs, normative beliefs, and control beliefs associated with mental health help-seeking, as well as trusted sources of mental health information, among local high school students. Survey results suggested control (self-efficacy) was an important message target and peers were trusted mental health information sources. In Phase 2, youth interns developed TikTok-style messages focused on strengthening control beliefs and promoting a youth-selected mental health support resource. Youth interns distributed an online survey experiment to test whether youth-created messages shown alongside resource information increased help-seeking self-efficacy compared to an information-only control. The YPACR framework contributed to youth-relevant campaign goals, study measurements, recruitment approaches, data interpretation, and message design. We discuss the benefits and challenges of this youth-driven health campaign development model and recommendations for future research.

“Don’t touch your face”---Effectiveness of a health communication intervention on reducing face-touching behaviors

Given the risk of infection through face-touching behaviors, investigators have called for more research into the development of interventions to reduce the frequency of face-touching. The current study aims to test the effectiveness of messages on reducing face-touching behaviors. Nine different messages that highlighted the risk of face-touching were developed. Study 1, an online survey-experiment with a national sample of US adults (N=998), examined message-, risk perceptions, and face-touching-related behavioral intentions. The most promising messages identified in study 1 were then tested in study 2, a follow-up behavioral observation study with a class of undergraduate students. Students' face-touching behaviors were observed during a 4-week period when intervention versus control messages were displayed in the classroom. Four messages performed better in study 1, 2 of which were selected to test the actual message effectiveness in study 2. Study 2 results showed that on average, students touched their faces less frequently when a "Don't touch your face" message was present, although such decrease was not statistically significant. Having reminder messages of "Don't touch your face" in public spaces holdthe potential to be a low-cost, effective strategy to reduce face-touching behaviors.

Let us go with the flow − Impact of a dynamic social norm nudge on parents’ school menu selection

Designing more sustainable school meal offerings not only contributes to environmental protection and climate change mitigation but also promotes children’s health, provides food education, and raises awareness on sustainability issues. The present study, using a between-subject experimental online survey (N = 617), proved the effectiveness of a dynamic social norm nudge in encouraging parents to make more environmentally friendly choices when selecting school menus for their elementary school children. In addition, nudging was more successful in promoting sustainable food choices among parents with lower levels of education and those who are more actively involved and responsible for child-related practices. Disentangling the individual traits that leverage the effectiveness of nudges should allow public entities to fully exploit the potential of these interventions and design tailored approaches for targeted subpopulations.

Sacrifice for Love: The Effects of Compromise on Individual Emotional Benefits in Romantic Tourism

Romantic tourism has emerged as an important segment, where tourists have a strong drive to compromise with partners to maintain good relations. But it’s not clear how this influences their feelings. Based on expectancy theory, this study reveals how different types of unilateral compromise influence their emotional benefits, and explores the special role played by social cues and anonymity in the tourism context. A field experiment and an online experimental survey were conducted. The main findings include: (1) social cues attenuate the negative effects of psychological reactance-based compromise (i.e., tourists feel better when they treat compromise as a non-verbal message of love). (2) The negative feelings generated by stereotype-based compromise can be reduced in a highly anonymous tourism environment. These findings suggest that by managing tourists’ expectations of compromise and designing interactive, indulgent, and immersive activities, a more enjoyable experience and higher emotional benefits can be created for romantic tourists.

Fiscal illusion at the individual level

AbstractThis study uses a survey experiment to test for fiscal illusion—the idea that taxpayers systematically misperceive their tax liabilities and contributions to public services. To date, the voluminous literature on fiscal illusion has not analyzed how better information on personalized total tax liabilities and contributions to public services would influence fiscal preferences. This is the first study to inform participants of their individual fiscal balance sheets comprising all major taxes regularly paid by taxpayers and their allocation to public services, thus comprehensively covering both sides of the fiscal account. This aim is achieved by embedding a novel personalized fiscal calculator in an online survey experiment administered to a representative sample of UK employees. The experiment finds evidence of fiscal illusion: providing personalized fiscal information reduces support for higher taxes and spending and increases support for lower taxes and spending. These findings indicate that taxpayers underestimate both their tax liabilities and the costs of public services.

Prior Attitude, Individualism and Perceived Scientists’ Expertise

Abstract: On Chinese social media, the stigmatization of homosexuals is tightly connected to the belief that they have a higher risk of contraction than others. However, scientists’ estimation of such risks is selectively framed on media outlets, and could cause confusion about and even polarization around the topic. In the theoretical framework of motivated reasoning, the current study showcases a cognition-intention link in the processing of scientific information regarding homosexuals’ high HIV/AIDS prevalence in China. An online survey experiment ( N = 695) using different emphasis frames of the findings from a scientific report shows that ad hoc identification with homosexuals’ rights, and individualism, strongly moderates the direct effect of exposure to different messages on intention of message forwarding, and also the indirect effect mediated by the perception of scientists’ expertise.