Internet-based Experiment Research Articles

Chinese readers utilize emotion information for word segmentation.

We reported a large-scale Internet-based experiment to investigate the impact of emotion information on Chinese word segmentation, in which participants completed an overlapping ambiguous string (OAS) segmentation task and the Chinese version of Beck Depression Inventory-II in a counterbalanced order. OAS is a three-character string (ABC) in which the middle character can form a distinct word with both the character on its left side (word AB) and the character on its right side (word BC). Participants were presented with isolated OASs and were asked to report the word they identified first. Emotional OAS was constructed by a combination of a neutral word and an emotional word, with the neutral and emotional words sharing character B. We orthogonally manipulated the valence of the emotional words (positive vs. negative) and their position in the OAS (left-side vs. right-side). The results showed that compared with neutral words, both positive and negative words were more likely to be segmented, and this segmentation outcome was not affected by readers with different depression tendencies. These findings suggest that emotion information can influence word segmentation, and that both positive and negative words take precedence over neutral words in the word segmentation process. This study provides a new perspective and evidence to understand the impact of emotion information on word processing.

Transfer of Approach-Avoidance Training: Motoric or Goal-Related?

Approach-avoidance training (AAT) procedures were developed with the prospect that they can modify action impulses to approach or avoid specific stimuli. Research suggested that the outcome of AAT procedures is mediated by training-induced changes in implicit response tendencies. This study investigated whether AAT procedures affect implicit response tendencies because of a training of goal-related responses or due to a training of motoric actions effecting approach and avoidance. Participants in three internet-based experiments (total n = 514) were trained to approach and avoid two fictitious social groups by steering a symbolic representation of the self towards and away from group members. They alternated between the training task and a flanker-like test task that probed for training-induced changes in response tendencies consistent with the trained action or with the trained AA goal. Results demonstrated a transfer of relations between the stimuli and AA goals from training to test tasks. In contrast, relations to the motoric acts subserving these goals had no effect on implicit response tendencies. It is concluded that a relation to approach- and avoidance related goals, and not to the motoric action, were established with the AAT procedure. Implications for associative and inferential accounts of AAT effects are discussed.

Voice onset time and vowel formant measures in online testing and laboratory-based testing with(out) surgical face masks

Since the COVID-19 pandemic started, conducting experiments online is increasingly common, and face masks are often used in everyday life. It remains unclear whether phonetic detail in speech production is captured adequately when speech is recorded in internet-based experiments or in experiments conducted with face masks. We tested 55 Spanish–Basque–English trilinguals in picture naming tasks in three conditions: online, laboratory-based with surgical face masks, and laboratory-based without face masks (control). We measured plosive voice onset time (VOT) in each language, the formants and duration of English vowels /iː/ and /ɪ/, and the Spanish/Basque vowel space. Across conditions, there were differences between English and Spanish/Basque VOT and in formants and duration between English /iː/–/ɪ/; between conditions, small differences emerged. Relative to the control condition, the Spanish/Basque vowel space was larger in online testing and smaller in the face mask condition. We conclude that testing online or with face masks is suitable for investigating phonetic detail in within-participant designs although the precise measurements may differ from those in traditional laboratory-based research.

Dissociating the processing of empty categories in raising and control sentences: a self-paced reading study in Japanese

IntroductionTheoretical linguistics has proposed different types of empty categories (ECs), i.e., unpronounced words with syntactic characteristics. ECs are a key to elucidating the computational system of syntax, algorithms of language processing, and their neural implementation. Here we examined the distinction between raising and control sentences in Japanese and whether ECs are psychologically real.MethodsWe recruited 254 native speakers of Japanese in the present internet-based experiment. We used a self-paced reading and a probe recognition priming technique. To investigate whether raising and control sentences have different ECs (i.e., Copy and PRO) and whether these ECs cause a reactivation effect, behavioral data were analyzed using linear mixed-effects models.ResultsWe found two striking results. First, we demonstrate that the reading times of raising and control sentences in Japanese were better explained by the linear mixed-effects model considering the differences of ECs, i.e., Copy and PRO. Secondly, we found a significant reactivation effect for raising and control sentences, which have ECs, and reflexive sentences without ECs. These results indicate that ECs are processed similarly to reflexive pronouns (e.g., himself ).DiscussionBased on these results, we conclude that raising and control sentences in Japanese have different ECs, i.e., Copy and PRO, and that ECs have psychological reality. Our results demonstrate that behavioral experiment based on theoretical linguistics, which is the first step for developing linking hypotheses connecting theoretical linguistics and experimental neuroscience, is indeed necessary for testing hypotheses proposed in theoretical linguistics.

Name matters! The cost of having a foreign-sounding name in the Swedish private housing market.

Both immigration and a troubling housing deficit have increased rapidly in Sweden over the past 20 years. In this internet-based field experiment, we investigated whether there exists discrimination in the Swedish private rental housing market based on the names of apartment seekers. We used a correspondent test by randomly submitting equivalent applications from four fictitious, highly educated, and seemingly “well-behaved” male applicants in response to a number of randomly selected private housing ads. Each advertising landlord received applications from two applicants with names signaling Swedish, Arab/Muslim, Eastern European, or East Asian ethnicity. Our results show that the person with a name associated with the dominant ethnic group received most callbacks from the landlords, while the persons with Eastern European- and East Asian sounding names, and especially the Arab/Muslim-sounding name, yielded significantly lower callback rates. Moreover, each applicant’s callback rates are about the same regardless of whom he was paired with, reinforcing our result that a person’s name clearly matters when applying for an apartment. The comparisons with previous discrimination research focusing on the Swedish housing market show that the situation for a male person with an Arabic/Muslim-sounding name has at least not improved in Sweden in the past decade.

Hope, Emotional Charges, and Online Action: An Experimental Study of the DREAM Act

Abstract This study investigates the causal relationship between an under-studied emotion—hope—and online action. We ask whether some emotions are more effective than others in driving a semi-behavioral outcome—clicking a hyperlink. Using an experimental design, we find that a recorded speech that has been “emotionally charged” with hope increases respondents’ willingness to seek information about a contentious social issue, immigrant rights. We argue that the hope charge is uniquely powerful, in part because it energizes both beneficiary constituents (BCs) and conscience constituents (CCs) of social movements, as well as those of broader publics. We suggest that hope is a quintessential bridging charge, linking beneficiary constituents to these other groups. Our study builds on important methodological trends in the developing field of survey experimentation: it uses audio recordings to convey emotional charges and embeds a semi-behavioral measure at the conclusion of an internet-based survey experiment. We argue that hope has been empirically submerged in the discipline, and, when used to charge social movement frames, has under-acknowledged mobilizing power.

Artificial intelligence in breast cancer screening: primary care provider preferences.

Artificial intelligence (AI) is increasingly being proposed for use in medicine, including breast cancer screening (BCS). Little is known, however, about referring primary care providers' (PCPs') preferences for this technology. We identified the most important attributes of AI BCS for ordering PCPs using qualitative interviews: sensitivity, specificity, radiologist involvement, understandability of AI decision-making, supporting evidence, and diversity of training data. We invited US-based PCPs to participate in an internet-based experiment designed to force participants to trade off among the attributes of hypothetical AI BCS products. Responses were analyzed with random parameters logit and latent class models to assess how different attributes affect the choice to recommend AI-enhanced screening. Ninety-one PCPs participated. Sensitivity was most important, and most PCPs viewed radiologist participation in mammography interpretation as important. Other important attributes were specificity, understandability of AI decision-making, and diversity of data. We identified 3 classes of respondents: "Sensitivity First" (41%) found sensitivity to be more than twice as important as other attributes; "Against AI Autonomy" (24%) wanted radiologists to confirm every image; "Uncertain Trade-Offs" (35%) viewed most attributes as having similar importance. A majority (76%) accepted the use of AI in a "triage" role that would allow it to filter out likely negatives without radiologist confirmation. Sensitivity was the most important attribute overall, but other key attributes should be addressed to produce clinically acceptable products. We also found that most PCPs accept the use of AI to make determinations about likely negative mammograms without radiologist confirmation.

Sad mood and poor sleep are related to task-unrelated thoughts and experience of diminished cognitive control

Previous studies have indicated that a sad mood and sleep deprivation increase mind wandering, but it is unclear whether these associations reflect reduced effort in concentrating on the task at hand or diminished cognitive control. In an internet-based experiment, participants completed a sleep disturbance questionnaire followed by a complex span task and a 2-back task with thought-sampling probes. Subsequently, participants underwent a positive, neutral, or negative mood induction prior to repeating the 2-back. The results (N = 504) replicated the finding of increased task-unrelated thoughts following sad mood induction, B = 0.56 (SE = 0.14), p < 0.01, d = 0.31. Unguided thoughts were increased following sad mood induction, B = 0.31 (0.13), p = 0.02, but working memory did not significantly moderate this association (p = 0.31). People reported a lower degree of trying to concentrate on the 2-back after the sad mood induction, B = −0.07 (0.04), p = 0.04, but actual performance was not affected (p = 0.46). Sleep disturbances showed small associations with task-unrelated, B = 0.23 (0.08), p < 0.01, and unguided thoughts, B = 0.32 (0.08), p < 0.01. This study strengthens the evidence that a sad mood and poor sleep relate to mind wandering.

Where’s the Beef? How Masculinity Exacerbates Gender Disparities in Health Behaviors

Men in the United States have higher rates of life-threatening diseases than do women, in part due to behavioral differences in health practices. We argue that men’s enactment of masculinity in their daily lives contributes to health behavior differences. We focus on meat consumption, a masculine-stereotyped dietary practice that epidemiological studies have linked to negative health outcomes. In study 1, nationally representative survey data indicate men report less healthy lifestyle preferences than do women, including less willingness to reduce meat consumption. In study 2, an internet-based experiment shows that experiencing a masculinity threat leads men to express more attachment to meat consumption. In study 3, lab experiment data with a different experimental manipulation and study population again indicate that threats to masculinity influence men’s meat preferences. These results support the claim that men’s masculinity maintenance may be one factor contributing to gender differences in meat consumption and health disparities related to overconsumption of meat.

Best practices: Two Web-browser-based methods for stimulus presentation in behavioral experiments with high-resolution timing requirements.

The Web is a prominent platform for behavioral experiments, for many reasons (relative simplicity, ubiquity, and accessibility, among others). Over the last few years, many behavioral and social scientists have conducted Internet-based experiments using standard web technologies, both in native JavaScript and using research-oriented frameworks. At the same time, vendors of widely used webbrowsers have been working hard to improve the performance of their software. However, the goals of browser vendors do not always coincide with behavioral researchers' needs. Whereas vendors want high-performance browsers to respond almost instantly and to trade off accuracy for speed, researchers have the opposite trade-off goal, wanting their browser-based experiments to exactly match the experimental design and procedure. In this article, we review and test some of the best practices suggested by web-browser vendors, based on the features provided by new web standards, in order to optimize animations for browser-based behavioral experiments with high-resolution timing requirements. Using specialized hardware, we conducted four studies to determinethe accuracy and precision of two different methods. The results using CSS animations inweb browsers (Method 1) with GPU acceleration turned off showed biases that depend on the combination of browser and operating system. The results of tests on the latest versions of GPU-accelerated web browsers showed no frame loss in CSS animations. The same happened in many, but not all, of the tests conducted using requestAnimationFrame (Method 2)instead of CSS animations. Unbeknownst to many researchers, vendors of web browsers implement complextechnologies that resultin reducedquality oftiming.Therefore, behavioral researchers interested in timing-dependent procedures should be cautious when developing browser-based experiments and should test the accuracy and precision of the whole experimental setup (web application, web browser, operating system, and hardware).

SES: um sistema baseado na web para o design e a condução de experimentos educacionais

A web-based experiment, also referred to as an Internet-based experiment or online experiment, is an experimental research method in which the experiment is conducted over the Internet. Several advantages provided by the use of the web approach to conducting research can be identified in the literature. However, although the experimental web-based method has been widely used in the area of Psychology over the last decades, there is still little literature in the area of Education. The present work presents a web-based system for conducting educational experiments. The system, as well as the experimental web-based method, is evaluated by means of a pilot experiment replicated with 6 classes of students (n = 107). The results demonstrate that, in addition to the advantages already mentioned in the literature, web-based experiments can provide better control over several types of threats to internal and external validity in some types of scenarios.

Replacing the Orchestra? - The Discernibility of Sample Library and Live Orchestra Sounds.

Recently, musical sounds from pre-recorded orchestra sample libraries (OSL) have become indispensable in music production for the stage or popular charts. Surprisingly, it is unknown whether human listeners can identify sounds as stemming from real orchestras or OSLs. Thus, an internet-based experiment was conducted to investigate whether a classic orchestral work, produced with sounds from a state-of-the-art OSL, could be reliably discerned from a live orchestra recording of the piece. It could be shown that the entire sample of listeners (N = 602) on average identified the correct sound source at 72.5%. This rate slightly exceeded Alan Turing's well-known upper threshold of 70% for a convincing, simulated performance. However, while sound experts tended to correctly identify the sound source, participants with lower listening expertise, who resembled the majority of music consumers, only achieved 68.6%. As non-expert listeners in the experiment were virtually unable to tell the real-life and OSL sounds apart, it is assumed that OSLs will become more common in music production for economic reasons.

When Catholics turn right: the effects of the Islamic terrorism threat on the fragmented Catholic Italian voters

ABSTRACTItaly, as well as most European countries, has been hit by a wave of anxiety arising from groups such as ISIS and Al Qaeda, whose effects on political attitudes are still under-examined. This article investigates the effect of the perceived threat of Islamic terrorism as a potential driver for a ‘right turn’ in the Catholic Italian electorate with open-ended interviews and an Internet-based experiment in which voters were randomly assigned to a terrorism threat manipulation and to a control condition (N = 138). The results show that the Islamic terroristic threat significantly increased the support for centre-right leaders who promoted in-group identity and out-group hostility towards Muslims. Implications for the debate about the effects of perceived threat on political opinions and the relevance of the findings beyond the Italian case are discussed at the end of the article.

Non-invasive prenatal screening for trisomy 21: Consumers' perspectives.

Non-invasive prenatal screening (NIPS) has the potential to dramatically increase the prenatal detection rate of Down syndrome because of improvements in safety and accuracy over existing tests. There is concern that NIPS could lead to more negative attitudes towards Down syndrome and less support for individuals with Down syndrome. To assess the impact of NIPS on support for prenatal testing, decision-making about testing, and beliefs or attitudes about Down syndrome, we performed an Internet-based experiment using adults (N = 1,789) recruited through Amazon Mechanical Turk. Participants were randomly assigned to read a mock news article about NIPS, a mock news article about amniocentesis, or no article. The content in the two articles varied only in their descriptions of the test characteristics. Participants then answered questions about their support for testing, hypothetical testing decision, and beliefs and attitudes about Down syndrome. Reading the mock NIPS news article predicted increased hypothetical test uptake. In addition, the NIPS article group also agreed more strongly that pregnant women, in general, should utilize prenatal testing. We also found that the more strongly participants supported prenatal testing for pregnant women, the less favorable their attitudes towards individuals with Down syndrome; providing some evidence that NIPS may indirectly result in more negative perceptions of individuals with this diagnosis.

The impact of recent and long-term experience on access to word meanings: Evidence from large-scale internet-based experiments

Many word forms map onto multiple meanings (e.g., “ace”). The current experiments explore the extent to which adults reshape the lexical–semantic representations of such words on the basis of experience, to increase the availability of more recently accessed meanings. A naturalistic web-based experiment in which primes were presented within a radio programme (Experiment 1; N = 1800) and a lab-based experiment (Experiment 2) show that when listeners have encountered one or two disambiguated instances of an ambiguous word, they then retrieve this primed meaning more often (compared with an unprimed control condition). This word-meaning priming lasts up to 40 min after exposure, but decays very rapidly during this interval. Experiments 3 and 4 explore longer-term word-meaning priming by measuring the impact of more extended, naturalistic encounters with ambiguous words: recreational rowers (N = 213) retrieved rowing-related meanings for words (e.g., “feather”) more often if they had rowed that day, despite a median delay of 8 hours. The rate of rowing-related interpretations also increased with additional years’ rowing experience. Taken together these experiments show that individuals’ overall meaning preferences reflect experience across a wide range of timescales from minutes to years. In addition, priming was not reduced by a change in speaker identity (Experiment 1), suggesting that the phenomenon occurs at a relatively abstract lexical–semantic level. The impact of experience was reduced for older adults (Experiments 1, 3, 4) suggesting that the lexical–semantic representations of younger listeners may be more malleable to current linguistic experience.

Relatively speaking: contrast effects influence assessors' scores and narrative feedback.

In prior research, the scores assessors assign can be biased away from the standard of preceding performances (i.e. 'contrast effects' occur). This study examines the mechanism and robustness of these findings to advance understanding of assessor cognition. We test the influence of the immediately preceding performance relative to that of a series of prior performances. Further, we examine whether assessors' narrative comments are similarly influenced by contrast effects. Clinicians (n=61) were randomised to three groups in a blinded, Internet-based experiment. Participants viewed identical videos of good, borderline and poor performances by first-year doctors in varied orders. They provided scores and written feedback after each video. Narrative comments were blindly content-analysed to generate measures of valence and content. Variability of narrative comments and scores was compared between groups. Comparisons indicated contrast effects after a single performance. When a good performance was preceded by a poor performance, ratings were higher (mean 5.01, 95% confidence interval [CI] 4.79-5.24) than when observation of the good performance was unbiased (mean 4.36, 95% CI 4.14-4.60; p<0.05, d=1.3). Similarly, borderline performance was rated lower when preceded by good performance (mean 2.96, 95% CI 2.56-3.37) than when viewed without preceding bias (mean 3.55, 95% CI 3.17-3.92; p<0.05, d=0.7). The series of ratings participants assigned suggested that the magnitude of contrast effects is determined by an averaging of recent experiences. The valence (but not content) of narrative comments showed contrast effects similar to those found in numerical scores. These findings are consistent with research from behavioural economics and psychology that suggests judgement tends to be relative in nature. Observing that the valence of narrative comments is similarly influenced suggests these effects represent more than difficulty in translating impressions into a number. The extent to which such factors impact upon assessment in practice remains to be determined as the influence is likely to depend on context.

The Influence of News Framing on Support for Charter School Reform

This study examined the influence of media framing on attitudes toward charter school reform. Participants in an Internet-based experiment were presented, at random, with one of three manipulated news articles framing charter school reform as (a) supportive of values such as freedom, choice, and innovation; (b) conflicting with values such as public accountability; or (c) neutral. Participants were then asked about their preferences with respect to a variety of school reform proposals. Results indicated that the framing did influence the policy preferences of participants in areas such as the expansion of charter schools, but did not consistently predict policy preferences.

Conducting Psychological Research via the Internet: In the West and China

With the rapid growth of the Internet, using the Internet to conduct psychological research is receiving increasing attention and acceptance. Internet-based research, which appeared in early 1990 s, includes four basic paradigms: non-reactive data collection, Internet-based surveys, Internet-based tests and Internet-based experiments. Compared with the traditional lab research, Internet-based approach has advantages in collecting large and heterogeneous samples. However, there are also some drawbacks such as a lack of control, self-selection and drop-out that need special attention and solutions. Nevertheless, Internet-based approach is useful and promising, particularly in China.

Negativity, Information, and Candidate Position-Taking

The purpose of this paper is to advance our understanding of how negativity affects voters’ assessments of the positions candidates take on issues. We argue that the inferences people make about candidates’ positions on issues differ depending on whether the information they encounter comes from attack or self-promotional statements. Specifically, we posit that attacks offer two pieces of information to voters—insight into the positions of the target and the sponsor—whereas, positive information only affects perceptions of the sponsor. Further, we contend that attacks offer important correctives to candidates’ often misleading self-promotional claims. By drawing attention to the differences between the informational content of negative and positive appeals, we offer new insights into the inferences voters make about candidates’ positions on issues. We support these claims using data from an internet-based experiment employing a nationally representative sample of nearly 4,000 people. The paper concludes by teasing out a series of implications that arise from these insights.

Emotional and Social Factors influence Poker Decision Making Accuracy

Poker is a social game, where success depends on both game strategic knowledge and emotion regulation abilities. Thus, poker provides a productive environment for studying the effects of emotional and social factors on micro-economic decision making. Previous research indicates that experiencing negative emotions, such as moral anger, reduces mathematical accuracy in poker decision making. Furthermore, various social aspects of the game—such as losing against "bad players" due to "bad luck"—seem to fuel these emotional states. We designed an Internet-based experiment, where participants' (N = 459) mathematical accuracy in five different poker decision making tasks were assessed. In addition, we manipulated the emotional and social conditions under which the tasks were presented, in a 2 × 2 experimental setup: (1) Anger versus neutral emotional state—participants were primed either with an anger-inducing, or emotionally neutral story, and (2) Social cue versus non-social cue—during the tasks, either an image of a pair of human eyes was "following" the mouse cursor, or an image of a black moving box was presented. The results showed that anger reduced mathematical accuracy of decision making only when participants were "being watched" by a pair of moving eyes. Experienced poker players made mathematically more accurate decisions than inexperienced ones. The results contribute to current understanding on how emotional and social factors influence decision making accuracy in economic games.