Choice Of Experimental Design Research Articles

Assessing Student Preferences for Quantitative Methods Courses Using Discrete Choice Experiments

Understanding how students choose quantitative methods courses is important for both instructors and departments: Meeting student preferences increases motivation and engagement, enhances learning, can contribute to reducing statistics anxiety, and ensures enrollment. This article uses a discrete choice experiment to causally assess sociology students’ course preferences. In contrast to existing experimental interventions, choice experiments allow for an estimation of treatment effects prior to implementing an instructional design. Using data collected at a German university as a case study, this contribution provides insights and discusses practical implications of student preferences for quantitative methods courses. In the study, students prefer courses that use hands-on forms of assessment, follow a regular schedule, offer more credit points, and mix undergraduate and graduate students. The accompanying online material provides a step-by-step introduction to the design of discrete choice experiments, allowing a replication of the study and an implementation of the methodology in other contexts.

Preferable price to buy an electric two-wheeled vehicle for college students

This research delves into the determinants affecting Taiwanese college students’ purchasing behavior towards two-wheeled electric vehicles (ETWVs) and the financial allocation they are willing to commit. A choice experiment design was utilized, with a sample of approximately 900 college students, regular users of two-wheeled gasoline vehicles (TWGs). The students engaged in one of two choice scenarios, presented with general characteristics, operational efficiency, vehicle cost, and subsidy strategies. Subsequent to the scenarios, respondents indicated their willingness to pay (WTP) for a ETWV. ETWVs, apart from being an emerging transportation alternative, also present potential environmental and health benefits due to reduced air pollution. The dependent inverse hyperbolic sine (IHS) double-hurdle model was employed, facilitating the accommodation of heteroscedasticity and correlated normality. The outcomes suggest that purchasing behavior for ETWVs among college students is shaped by factors such as purchase subsidy, tax breaks, and ETWVs’ capability in supporting students’ external travel requirements. The average WTP for ETWVs among this demographic stands at US$ 1,410. Importantly, the dependent IHS double-hurdle model, considering heteroscedasticity, proved statistically superior to its counterparts. Insights from this research offer crucial information on the price range students are likely to accommodate for ETWVs and provide a foundation for framing incentive-driven policies to amplify ETWV adoption

Toxin-Induced Animal Models of Parkinson's Disease.

The debilitating motor symptoms of Parkinson's disease (PD) result primarily from the degenerative nigrostriatal dopaminergic pathway. To elucidate pathogenic mechanisms and evaluate therapeutic strategies for PD, numerous animal models have been developed. Understanding the strengths and limitations of these models can significantly impact the choice of model, experimental design, and data interpretation. Herein, we systematically review the literature over the past decade. Some models no longer serve the purpose of PD models. The primary objectives of this review are: First, to assist new investigators in navigating through available animal models and making appropriate selections based on the objective of the study. Emphasis will be placed on common toxin-induced murine models. And second, to provide an overview of basic technical requirements for assessing the nigrostriatal pathway's pathology, structure, and function.

Information about life expectancy related to obesity is most important to cat owners when deciding whether to act on a veterinarian's weight loss recommendation.

To determine the relative importance of information communicated to cat owners during veterinarian-client obesity-related conversations. Cat owner participants recruited via snowball sampling. A cross-sectional online questionnaire was distributed to cat owners who owned cats of any weight status. A discrete choice experiment design was used to determine the relative importance of obesity-related attributes to cat owners when receiving information from a veterinarian. A total of 1,095 questionnaires were analyzed. Participating cat owners resided primarily in Canada and the US. Impact on life expectancy was the most important attribute that would encourage participants to pursue weight management for a cat with obesity (relative importance, 32.66%), followed by change to cost of food (20.40%), future quality of life (20.38%), future mobility (14.40%), and risk of developing diabetes (12.15%). Findings suggest that cat owners consider the impact on life expectancy to be most important when considering whether to follow a veterinarian's recommendation for their cat to lose weight. When veterinary professionals are communicating about obesity in practice, there is the potential to increase owner engagement in weight management efforts for cats by emphasizing the obesity-related information owners prefer to receive.

Consumer preference for sustainability labels in the context of China

Sustainability Label (SL) have emerged as an important product attribute in recent decades, and have evolved into various types as products with social, environmental, and economic benefits have become more prevalent in the marketplace. With the information of SL in products, consumers are encouraged to embrace environmental sustainability principles and to make environmentally sustainable choices and actions. SL helps alignment between consumers and the industry by enhancing consumers’ nderstanding of company’s act, and serve as an effective marketing message. However, there is limited research on consumer preferences for different types of sustainable labels or benefits. This study addresses this knowledge gap by applying choice experiment method to assess consumers’ choice behavior for products associated with various SL. Choice experiment designs are separately developed for two most relevant sustainable products (i.e. soymilk and EV) in China. A stated preference method (SPM) consumer survey was conducted in 2022 across six major cities in China, namely Beijing, Shanghai, Guangzhou, Shenzhen, Chengdu, and Xi’an, and a total of 840 valid responses were collected for assessing multinomial logit (MNL) model. Findings show that Chinese consumers prefer SL with environmental benefits, foreign COO/Brand in consuming soymilk, and prefer SL with employee friendliness, domestic COO/Brand for Electric Vehicle (EV). These findings provide insights for marketers and researchers Chinese consumers’ preference for specific SL and brand for two selected product categories.

On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods

Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings have shortcomings in their design, generally leading to overestimation of methods' real-world utility. In this work, we seek to address this by conducting a study that evaluates post-hoc explainable ML methods in a setting consistent with the application context and provide a template for future evaluation studies. We modify and improve a prior study on e-commerce fraud detection by relaxing the original work's simplifying assumptions that departed from the deployment context. Our study finds no evidence for the utility of the tested explainable ML methods in the context, which is a drastically different conclusion from the earlier work. This highlights how seemingly trivial experimental design choices can yield misleading conclusions about method utility. In addition, our work carries lessons about the necessity of not only evaluating explainable ML methods using tasks, data, users, and metrics grounded in the intended application context but also developing methods tailored to specific applications, moving beyond general-purpose explainable ML methods.

Influence of a private-public risk pool and an opt-out framing on earthquake protection demand for Canadian homeowners in Quebec and British Columbia.

This article describes the design and analysis of web-based choice experiments that examine how the demand for earthquake protection in Quebec and British Columbia (BC), Canada, is influenced by the default option and the structure of the insurance plan. Homeowners in both provinces were given the opportunity to purchase protection against earthquake losses when presented with one of the following options: the current private insurance plan and proposed public-private Risk Pools with different levels of the public layer. The default frame was changed so the homeowner could either opt-in by purchasing this coverage or opt-out of being given this protection and receiving a premium discount. Assigning participants to the public-private Risk Pools rather than the current private insurance plan increases the likelihood of purchasing earthquake insurance protection by an odds ratio of 2.7 or greater in BC and Quebec. Furthermore, opt-out enrollment design substantially increases take-up of earthquake protection relative to opt-in enrollment. The policy implications of these findings are discussed.

You do you: susceptibility of temporal binding to self-relevance.

The self-prioritization effect suggests that self-relevant information has a processing advantage over information that is not directly associated with the self. In consequence, reaction times are faster and accuracy rates higher when reacting to self-associated stimuli rather than to other-related stimuli (Sui et al., Journal of Experimental Psychology: Human Perception and Performance 38:1105-1117, 2012). This spurs the assumption that self-associated action-effects should also be perceived earlier than other-related outcomes. One way to measure this is temporal binding. Previous research indeed showed that the perceived temporal interval between actions and self-associated outcomes was reduced compared to friend- and other-associated outcomes. However, the employed method (interval estimations) and several experimental design choices make it impossible to discern whether the perceived shortening of the interval between a keypress and a self-relevant outcome is due to a perceptual shift of the action or of the action-effect or both. Thus, we conducted four experiments to assess whether temporal binding can indeed be modulated by self-relevance and if so where this perceptual bias is located. The results did not support stronger temporal binding for self- vs other-related action-effects. We discuss these results against the backdrop of the attentional basis of self-prioritization and propose directions for future research.

Feasibility of engineered Bacillus subtilis for use as a microbiome-based topical drug delivery platform.

Non-adherence to medication is a major challenge in healthcare that results in worsened treatment outcomes for patients. Reducing the frequency of required administrations could improve adherence but is challenging for topical drug delivery due to the generally short residence time of topical formulations on the skin. In this study, we sought to determine the feasibility of developing a microbiome-based, long-acting, topical delivery platform using Bacillus subtilis for drug production and delivery on the skin, which was assessed using green fluorescent protein as a model heterologous protein for delivery. We developed a computational model of bacteria population dynamics on the skin and used its qualitative predictions to guide experimental design choices. Using an ex vivo pig skin model and a human skin tissue culture model, we saw persistence of delivered bacteria for multiple days and observed little evidence of cytotoxicity to human keratinocyte cells in vitro. Finally, using an in vivo mouse model, we found that the delivered bacteria persisted on the skin for at least 1 day during every-other-day application and did not appear to present safety concerns. Taken together, our results support the feasibility of using engineered B. subtilis for topical drug delivery.

Interactive and passive mixed reality distraction: effects on cold pressor pain in adults.

While interactive distractors are predicted to be more effective in reducing acute pain than passive distractors, the underlying mechanisms remain poorly understood. Previous work using Virtual-Reality (VR) has suggested that interactive distraction may be enhanced by increasing the person's sense of immersion. Despite the possible utility of immersive VR in reducing pain, some people report being disoriented and motion sick, and it doesn't allow for interactions with environment (e.g., following instructions from medical staff). Here, we explore the role of the immersion in the effectiveness of interactive distraction by employing an alternative technology, a Mixed-Reality (MR) headset that limits disorientation by projecting virtual objects into the real world. Healthy volunteers (18-35 years) participated in two experiments employing either a between (N = 84) or a within-subject (N = 42) design to compare Interactive and Passive distraction tasks presented via MR or a standard computer display. For both experiments, a cold-pressor task was used to elicit pain, with pain tolerance and pain perception being recorded. Analysis revealed that whilst interactive distraction was more effective in reducing pain perception and increasing pain tolerance than passive distraction, the interpretation of results was sensitive to experimental design. Comparison of devices did not reveal significant differences in pain tolerance or pain intensity, while pain unpleasantness was significantly reduced during the MR task using a within-subject design. Our findings add to existing VR studies reporting little additional analgesic benefit of new, immersive technologies compared to traditional computers, but underscores the important impact the choice of experimental design can have on the interpretation of results.

Tourist choice of sustainable hot springs tourism under post‐COVID‐19 pandemic period: A case in Colorado

AbstractHot springs tourism has increasingly attracted tourists who pursue wellness and harmony with the natural environment. This paper investigates how four sustainability‐related attributes influence tourist choice and estimates their marginal willingness to pay for Colorado hot springs tourism under the post‐COVID‐19 pandemic period. A fractional factorial choice experiment design and conditional logit model were used to analyze the choice data of 303 retained respondents collected from the online surveys. The results show the importance of sustainability‐related attributes on tourist choice and suggest the hot springs tourism sector improves destination sustainability to maintain market competitiveness under the post‐COVID‐19 pandemic period.

Whistleblowing Research: Experimental Method Choices from Accounting and Management

ABSTRACT This paper reviews whistleblowing experimental research in accounting and management and provides methodological guidance to new scholars. Based on a sample of 49 experimental papers, we summarized key issues, such as research design, task, dependent variable, and subject selection. Overall, we find that journals classified as accounting are more concentrated in experimental research and management journals are more diverse in terms of methodologies. Thus, whistleblowing experimental research from both areas is largely characterized by vignette-based studies. Accounting articles focused primarily on misappropriation of assets and fraudulent financial reporting, whereas management articles focused more broadly on unethical behavior. Also, some articles controlled for social desirability bias on the dependent variable. Finally, there is a predominance of the use of M.B.A. and postgraduate students in accounting studies and undergraduate studies in management. This paper is intended to further our understanding of experimental design choices and facilitate future research in this emerging field.

Unlocking transparency in water information: a discrete choice experiment design

ABSTRACT This study employed the discrete choice experiment (DCE) to examine consumers’ willingness to gain access to public information on water quality and the tradeoffs. We estimated that if water quality information is provided monthly, weekly, and daily, consumers are willing to pay an additional 28, 29, and 37 thousand VND per cubic metre, respectively. Consumers highly value the transparency of water quality information. High-income consumers are willing to pay more for water quality improvements and transparent water quality information. Further, having safe filter to drink water and potable tap water rather than unsafe drinking water equals an additional 5 and 7 thousand VND per cubic metre in customers’ willingness to pay. Consumers also prefer state-controlled water companies to private companies. In the case of private water companies, consumers also expect these companies to have a high level of awareness about their corporate social responsibility. The findings provide evidence that information transparency in water quality can be a powerful tool that fosters public awareness and holds water companies accountable. Consumers are willing to pay to get access to information on water quality regularly. Since technology has evolved, a digital smart monitoring solution is no longer an option but a potential or a must.

Portion size matters: Carrion ecology lessons for medicolegal death investigations-A study in Cape Town, South Africa.

Forensic taphonomic studies are regionally specific and improve time since death estimates for medico-legal casework. Within forensic taphonomy and carrion ecology, vertebrate scavengers are under-researched with many studies conducted using multiple, unclothed carcasses. This is a forensically unrealistic experimental design choice with unknown impact. The effect of variation in carrion biomass on the decomposition ecosystem, particularly where vertebrate scavengers are concerned, requires clarification. To assess the effect of carrion biomass load on vertebrate scavenging and decomposition rate, seasonal baseline data for single, clothed ~60 kg porcine carcasses were compared to clothed multiple-carcass deployments, in a forensically relevant habitat of Cape Town, South Africa. Decomposition was tracked via weight loss and bloat progression and scavenging activity via motion-activated cameras. The single carcasses decayed more quickly, particularly during the cooler, wetter winter, strongly correlated with concentrated Cape gray mongoose (Galerella pulverulenta) scavenging activity. On average and across seasons, the single carcasses lost 68% of their mass by day 32 (567 accumulated degree days [ADD]), compared to 80 days (1477 ADD) for multi-carcass deployments. The single carcasses experienced substantially more scavenging activity, with longer visits by single and multiple mongooses, totaling 53 h on average compared to 20 h for the multi-carcass deployments. These differences in scavenging activity and decay rate demonstrate the impact of carrion biomass load on decomposition for forensic taphonomy research. These findings need corroboration. However, forensic realism requires consideration in taphonomic study design. Longitudinally examining many single carcasses may produce more forensically accurate, locally appropriate, and usable results.

The CESM2 Single-Forcing Large Ensemble and Comparison to CESM1: Implications for Experimental Design

Abstract Single-forcing large ensembles are a relatively new tool for quantifying the contributions of different anthropogenic and natural forcings to the historical and future projected evolution of the climate system. This study introduces a new single-forcing large ensemble with the Community Earth System Model, version 2 (CESM2), which can be used to separate the influences of greenhouse gases, anthropogenic aerosols, biomass burning aerosols, and all remaining forcings on the evolution of the Earth system from 1850 to 2050. Here, the forced responses of global near-surface temperature and associated drivers are examined in CESM2 and compared with those in a single-forcing large ensemble with CESM2’s predecessor, CESM1. The experimental design, the imposed forcing, and the model physics all differ between the CESM1 and CESM2 ensembles. In CESM1, an “all-but-one” approach was used whereby everything except the forcing of interest is time evolving, while in CESM2 an “only” approach is used, whereby only the forcing of interest is time evolving. This experimental design choice is shown to matter considerably for anthropogenic aerosol-forced change in CESM2, due to state dependence of cryospheric albedo feedbacks and nonlinearity in the Atlantic meridional overturning circulation (AMOC) response to forcing. This impact of experimental design is, however, strongly dependent on the model physics and/or the imposed forcing, as the same sensitivity to experimental design is not found in CESM1, which appears to be an inherently less nonlinear model in both its AMOC behavior and cryospheric feedbacks.

Do mturkers collude in interactive online experiments?

One of the issues that can potentially affect the internal validity of interactive online experiments that recruit participants using crowdsourcing platforms is collusion: participants could act upon information shared through channels that are external to the experimental design. Using two experiments, I measure how prevalent collusion is among MTurk workers and whether collusion depends on experimental design choices. Despite having incentives to collude, I find no evidence that MTurk workers collude in the treatments that resembled the design of most other interactive online experiments. This suggests collusion is not a concern for data quality in typical interactive online experiments that recruit participants using crowdsourcing platforms. However, I find that approximately 3% of MTurk workers collude when the payoff of collusion is unusually high. Therefore, collusion should not be overlooked as a possible danger to data validity in interactive experiments that recruit participants using crowdsourcing platforms when participants have strong incentives to engage in such behavior.

Discrete Choice Experiment Consideration: A Framework for Mining Community Consultation with Case Studies

Local community acceptance, a key indicator of the socio-political risk of a project, is addressed through good stakeholder (community) engagement. Discrete choice modeling (DCM) enhances stakeholder analysis and has been widely applied to encourage community engagement in energy projects. However, very little detail is provided on how researchers design discrete choice experiments (DCEs). DCE design is the key step for effective and efficient data collection. Without this, the discrete choice model may not be meaningful and may be misleading in the local community engagement effort. This paper presents a framework for mining community engagement DCE design in an attempt to determine (1) how to identify the optimum number of factors and (2) how to design and validate the DCE design. Case studies for designing discrete choice experiments for community acceptance of mining projects are applied to accommodate these two objectives. The results indicate that the four-factor design, which seeks to reduce cognitive burden and costs, is the optimal choice. A survey was used to examine the difficulty of the survey questions and the clarity of the instructions for the designs. It has, therefore, been proven that the DCM design is of reasonable cognitive burden. The results of this study will contribute to a better design of choice experiments (surveys) for discrete choice modeling, leading to better policies for sustainable energy resource development.

Propensity of selecting mutant parasites for the antimalarial drug cabamiquine

We report an analysis of the propensity of the antimalarial agent cabamiquine, a Plasmodium-specific eukaryotic elongation factor 2 inhibitor, to select for resistant Plasmodium falciparum parasites. Through in vitro studies of laboratory strains and clinical isolates, a humanized mouse model, and volunteer infection studies, we identified resistance-associated mutations at 11 amino acid positions. Of these, six (55%) were present in more than one infection model, indicating translatability across models. Mathematical modelling suggested that resistant mutants were likely pre-existent at the time of drug exposure across studies. Here, we estimated a wide range of frequencies of resistant mutants across the different infection models, much of which can be attributed to stochastic differences resulting from experimental design choices. Structural modelling implicates binding of cabamiquine to a shallow mRNA binding site adjacent to two of the most frequently identified resistance mutations.

Spatial distribution of hand-grasp motor task activity in spinal cord functional magnetic resonance imaging.

Upper extremity motor paradigms during spinal cord functional magnetic resonance imaging (fMRI) can provide insight into the functional organization of the cord. Hand-grasping is an important daily function with clinical significance, but previous studies of similar squeezing movements have not reported consistent areas of activity and are limited by sample size and simplistic analysis methods. Here, we study spinal cord fMRI activation using a unimanual isometric hand-grasping task that is calibrated to participant maximum voluntary contraction (MVC). Two task modeling methods were considered: (1) a task regressor derived from an idealized block design (Ideal) and (2) a task regressor based on the recorded force trace normalized to individual MVC (%MVC). Across these two methods, group motor activity was highly lateralized to the hemicord ipsilateral to the side of the task. Activation spanned C5-C8 and was primarily localized to the C7 spinal cord segment. Specific differences in spatial distribution are also observed, such as an increase in C8 and dorsal cord activity when using the %MVC regressor. Furthermore, we explored the impact of data quantity and spatial smoothing on sensitivity to hand-grasp motor task activation. This analysis shows a large increase in number of active voxels associated with the number of fMRI runs, sample size, and spatial smoothing, demonstrating the impact of experimental design choices on motor activation.

Bayesian D- and I-optimal designs for choice experiments involving mixtures and process variables

Many food products involve mixtures of ingredients, where the mixtures can be expressed as combinations of ingredient proportions. In many cases, the quality and the consumer preference may also depend on the way in which the mixtures are processed. The processing is generally defined by the settings of one or more process variables. Experimental designs studying the joint impact of the mixture ingredient proportions and the settings of the process variables are called mixture-process variable experiments. In this article, we show how to combine mixture-process variable experiments and discrete choice experiments, to quantify and model consumer preferences for food products that can be viewed as processed mixtures. First, we describe the modeling of data from such combined experiments. Next, we describe how to generate D- and I-optimal designs for choice experiments involving mixtures and process variables, and we compare the two kinds of designs using two examples.