Survey Mode Research Articles

Incorporating Adaptive Survey Design in a Two-Stage National Web or Mail Mixed-Mode Survey: An Experiment in the American Family Health Study.

This article presents the results of an adaptive design experiment in the recruitment of households and individuals for a two-stage national probability web or mail mixed-mode survey, the American Family Health Study (AFHS). In the screening stage, we based the adaptive design's subgroup differentiation on Esri Tapestry segmentation. We used tailored invitation materials for a subsample where a high proportion of the population was Hispanic and added a paper questionnaire to the initial mailing for a subsample with rural and older families. In the main-survey stage, the adaptive design targeted the households where a member other than the screening respondent was selected for the survey. The adaptations included emailing and/or texting, an additional prepaid incentive, and seeking screening respondents' help to remind the selected individuals. The main research questions are (i) whether the adaptive design improved survey production outcomes and (ii) whether combining adaptive design and postsurvey weighting adjustments improved survey estimates compared to performing postsurvey adjustments alone. Unfortunately, the adaptive designs did not improve the survey production outcomes. We found that the weighted AFHS estimates closely resemble those of a benchmark national face-to-face survey, the National Survey of Family Growth, although the adaptive design did not additionally change survey estimates beyond the weighting adjustments. Nonetheless, our experiment yields useful insights about the implementation of adaptive design in a self-administered mail-recruit web or mail survey. We were able to identify subgroups with potentially lower response rates and distinctive characteristics, but it was challenging to develop effective protocol adaptations for these subgroups under the constraints of the two primary survey modes and the operational budget of the AFHS. In addition, for self-administered within-household selection, it was difficult to obtain contact information from, reach, and recruit selected household members that did not respond to the screening interview.

Survey response over 15 years of follow-up in the Millennium Cohort Study

BackgroundPatterns of survey response and the characteristics associated with response over time in longitudinal studies are important to discern for the development of tailored retention efforts aimed at minimizing response bias. The Millennium Cohort Study, the largest and longest running cohort study of military personnel and veterans, is designed to examine the long-term health effects of military service and experiences and thus relies on continued participant survey responses over time. Here, we describe the response rates for follow-up survey data collected over 15 years and identify characteristics associated with follow-up survey response and mode of response (paper vs. web).MethodPatterns of follow-up survey response and response mode (web, paper, none) were examined among eligible participants (n=198,833), who were initially recruited in four panels from 2001 to 2013 in the Millennium Cohort Study, for a follow-up period of 3–15 years (2004–2016). Military and sociodemographic factors (i.e., enrollment panel, sex, birth year, race and ethnicity, educational attainment, marital status, service component, service branch, pay grade, military occupation, length of service, and time deployed), life experiences and health-related factors (i.e., military deployment/combat experience, life stressors, mental health, physical health, and unhealthy behaviors) were used to examine follow-up response and survey mode over time in multivariable generalized estimating equation models.ResultsOverall, an average response rate of 60% was observed across all follow-up waves. Factors associated with follow-up survey response over time included increased educational attainment, married status, female sex, older age, military deployment (regardless of combat experience), and higher number of life stressors, mental health issues, and physical health diagnoses.ConclusionDespite the challenges associated with collecting multiple waves of follow-up survey data from members of the U.S. military during and after service, the Millennium Cohort Study has maintained a relatively robust response rate over time. The incorporation of tailored messages and outreach to those groups least likely to respond over time may improve retention and thereby increase the representativeness and generalizability of collected survey data.

Demographic and Measurement Differences between Text-to-Web and Phone Survey Respondents

This paper builds on existing literature on survey mode effects. We explore the relationship between administration mode and demographics as well as measurement issues. Participants in a low-income home weatherization program were assigned to either a phone call or text-to-web survey administration group. Our findings appear to be consistent with previous research regarding both non-observation and observation effects to varying extents. In terms of non-observation mode effects, we found that text-to-web and phone group survey respondents had similar demographic and home characteristics. The two survey methods yielded similar response rates and minimal statistically significant differences between respondents’ reported background characteristics. We found a larger portion of phone respondents chose “Prefer not to say” for some demographic questions and generally indicated higher satisfaction than text-to-web respondents.

A Perspective of Investment Relationship on Effects of Social Media Investment Outcomes

The rise of social media has had an impact on conventional media since it has given individuals a platform to engage in marketing and investment activities. This article examines about the majority of firms use social media as a marketing tool genuinely aids in establishing and keeping relationships with investors. Currently, social media facilitates investors as well as companies an opportunity to establish relationships. Social media truly considered an investment in relationships, and by means of the execution of relationship quality, it is measured for how it influences behaviours such as fulfilment, word-of-mouth and trust. Both institutions and financial investors emphasize the effective use of social media marketing. Online survey mode was used to reach target group of respondents. Confirmatory factor analysis (CFA) was used to assess the reliability of each component using the Cronbach alpha test, correlation, KMO for the precision of the factor analysis and pivot of the Varimax, all of which were related to seven distinct parameters and 27 dimensions. Research results show that investors who follow a company on social media are more likely to be satisfied, to trust it and to want to recommend it to non-followers. Additionally, they perceive higher levels of commitment and excellence in relationships. Together, these results show that social media is likely to have an effect on crucial relationship marketing variables that lead to more relational clients.

Stakeholder Management to Improve Business Performance of "Pekarangan Pangan Lestari (P2L)" Programs

This study aims to examine the influence of the community on the business performance of P2L program actors and to examine the role of universities and government support as moderators in this relationship. This research is an explanatory research with a quantitative approach. The sample in this study were P2L program actors in Malang Regency. The data collection method used a survey mode by sending questionnaires online through the P2L group member community and collected as many as 62 respondents from 30 members of the P2L group. Data analysis used the SEM-PLS method using the SmarPLS4 program. The research findings show that the community has a significant effect on the business performance of P2L program actors. Universities and government support do not moderate the relationship, instead government support has a direct impact on improving the business performance of P2L program actors. These findings also show that the stakeholders of the P2L program have a very important role, so they must be managed in such a way as to have a bigger and wider impact on the sustainability of the P2L program.

Survey mode and satisfaction with democracy

Abstract A growing body of evidence indicates the public is less committed to democracy than conventional wisdom long held. One possibility is that many in the public have internalized the norm that democracy is “good” but that such support is not firmly held. An implication of this reasoning is that because there is an expectation to express support for democracy, responses will be influenced by the presence of an interviewer due to social desirability effects. In this note, we examine the 2012 and 2016 American National Election Studies—in each year, a portion of respondents were interviewed via the internet while others were interviewed face-to-face. We identify a politically relevant difference between the two survey modes: those interviewed face-to-face express greater satisfaction with democracy. Indeed, the difference we identify is similar in magnitude to the difference typically observed between electoral winners and electoral losers. Our result is robust to different measurement and estimation strategies. While levels of satisfaction are influenced by the presence of an interviewer, a followup analysis indicates that the relationship between satisfaction and winner–loser status is similar across modes.

Developing digital tools for health surveys in low- and middle-income countries: Comparing findings of two mobile phone surveys with a nationally representative in-person survey in Bangladesh.

Non-communicable disease (NCD) risk factor data from low- and middle-income countries (LMICs) are inadequate, mostly due to the cost and burden of collecting in-person population-level estimates. High-income countries regularly use phone-based surveys, and with increasing mobile phone subscription in developing countries, mobile phone surveys (MPS) could complement in-person surveys in LMICs. We compared the representativeness and prevalence estimates of two MPS (i.e., interactive voice response (IVR) and computer-assisted telephone interview (CATI)) with a nationally representative household survey in Bangladesh-the STEPwise approach to NCD risk factor surveillance (STEPs) 2018. This cross-sectional study included 18-69-year-old respondents. CATI and IVR recruitments were done by random digit dialing, while STEPs used multistage cluster sampling design. The prevalence of NCD risk factors related to tobacco, alcohol, diet, and hypertension was reported and compared by prevalence differences (PD) and prevalence ratios (PR). We included 2355 (57% males), 1942 (62% males), and 8185 (47% males) respondents in the CATI, IVR, and STEPs, respectively. CATI (28%) and IVR (52%) had a higher proportion of secondary/above-educated people than STEPs (13%). Most prevalence estimates differed by survey mode; however, CATI estimates were closer to STEPs than IVR. For instance, in CATI, IVR, and STEPs, respectively, the prevalence was 21.4%, 17.9%, and 23.5% for current smoking; and 1.6%, 2.2%, and 1.5% for alcohol drinking in past month. Compared to STEPs, the PD ranged from '-56.6% to 0.4%' in CATI and '-41.0% to 8.4%' in IVR; the PR ranged from '0.3 to 1.1' in CATI and '0.3 to 1.6' in IVR. There were some differences and some similarities in NCD indicators produced by MPS and STEPs with differences likely due to differences in socioeconomic characteristics between survey participants.

How Do Humans Create and Sustain Viable Communities? A Review Essay

Abstract In a very lucid account, Efrén Pérez and Margit Tavits’s Voicing Politics: How Language Shapes Public Opinion reports empirical studies demonstrating that language is an important foundation in nation-building. Their research makes excellent use the considerable percentage of Estonians who are proficient in Estonian and Russian, prominent languages spoken in Estonia; the two languages differ in how they characterize gender, how they characterize the future, and how they characterize ethnicity. Pérez and Tavits make use of experiments and survey modes of investigation. And across both modes and across many opinions, they find repeated, hence reliable, and modest “nudges” due to the language bilingual speakers are randomly assigned to use. I expand the focus to consider how language is but one of the important means by which the human species is able to generate very different social forms. Some societies—or better, polities—are more rigid, reliant on past practices to survive; some are more fluid and open to new possibilities. Each has proven vulnerable. I argue that the diversity of sociability enhances the likelihood of the survival of the species by having some better able to address the challenges of the moment—a better strategy than a fixed single solution.

THE MEDIATING EFFECT OF CULTURAL PARTICIPATION ON THE QUALITY OF HOME CARE AND WELL-BEING OF THE ELDERS

The purpose of this study was to determine the mediating effect of cultural participation on the relationship between the quality of home care and the well-being of the elderly. Utilizing quantitative, non-experimental design via correlational technique and mediation analysis, data were obtained from 300 elderly, in one of the cities in Davao Province. The researcher utilized a stratified sampling technique in selecting study participations and survey mode of data collection through standardized questionnaires. The researcher also utilized the statistical tools mean, Pearson r and Med-graph using Sobel z-test. From the results of the study, it was found out that there is a very high level of mean scores for quality home care, and well-being of the elderly while a high level of cultural participation. Also, results revealed that there are significant relationships between quality home care and cultural participation, between cultural participation and the well-being of the elderly and between quality home care and the well-being of the elderly. Further, it was revealed that cultural participation partially mediates the relationship between quality home care and the well-being of the elderly.<p> </p><p><strong> Article visualizations:</strong></p><p><img src="/-counters-/soc/0091/a.php" alt="Hit counter" /></p>

Gaining Consent to Survey Respondents’ Partners: The Importance of Anchors’ Survey Experience in Self-administered Modes

Dyadic surveys aim to interview pairs of respondents, such as partners in a relationship. In dyadic surveys, it is often necessary to obtain the anchors’ consent to contact their partners and invite them to a survey. If the survey is operated in self-administered modes, no interviewer is present to improve the consent rate, for example, by providing convincing arguments and additional information. To overcome the challenges posed by self-administered modes for dyadic surveys and to improve consent rates, it is important to identify aspects that positively influence the likelihood of anchors giving consent to contact their partners. Ideally, these aspects are in the hands of the researchers, such as the survey design and aspects of the questionnaire. Thus, in this study, we analyzed the relationship between anchors’ survey experience and their willingness to consent to surveying their partners in self-administered modes. Based on data from the German Family Demography Panel Study (FReDA), we found that the anchors’ perceptions of the questionnaire as “interesting” or “too personal” were related to consent rates. These relationships were consistent across different survey modes and devices. Effects of other aspects of the questionnaire, such as “important for science” and “diverse” varied between modes and devices. We concluded with practical recommendations for survey research and an outlook for future research. * This article belongs to a special issue on “Family Research and Demographic Analysis – New Insights from the German Family Demography Panel Study (FReDA)”.

PCCI-DI Combustion Simulation for Significant Reduction of NOX and PM for GENSET Engine

Improvements in engine combustion are required due to the stringent pollution norms. This can be achieved either by making improvements in the combustion or by equipping after-treatment devices to control engine emission levels. PCCI is one of the popular techniques used to enhance the combustion. In this work, Diesel-RK software is used for the simulation. The main and pre-injection timings are altered to give the benefits in power and emissions. Based on a literature survey, the fourth and fifth modes are finalized for PCCI combustion simulation. The amount of total fuel injected was kept the same to compare the performances in DI and PCCI modes. The simulation results show the reduction in soot (PM) and NOx simultaneously with the help of PCCI concept at lower BMEP levels. The results show a decrease in PM by up to 26%, a reduction in NOx by up to 30% and an increase in power by 2%.

Interviewer-Observed Paradata in Mixed-Mode and Innovative Data Collection

In this research note, we address the potentials of using interviewer-observed paradata, typically collected during face-to-face-only interviews, in mixed-mode and innovative data collection methods that involve an interviewer at some stage (e.g., during the initial contact or during the interview). To this end, we first provide a systematic overview of the types and purposes of the interviewer-observed paradata most commonly collected in face-to-face interviews—contact form data, interviewer observations, and interviewer evaluations—using the methodology of evidence mapping. Based on selected studies, we illustrate the main purposes of interviewer-observed paradata we identified—including fieldwork management, propensity modeling, nonresponse bias analysis, substantive analysis, and survey data quality assessment. Based on this, we discuss the possible use of interviewer-observed paradata in mixed-mode and innovative data collection methods. We conclude with thoughts on new types of interviewer-observed paradata and the potential of combining paradata from different survey modes.

Examination of the demographic representativeness of a cross-sectional mobile phone survey in collecting health data in Colombia using random digit dialling

ObjectivesAs mobile phone ownership becomes more widespread in low-income and middle-income countries, mobile phone surveys (MPSs) present an opportunity to collect data on health more cost-effectively. However, selectivity and coverage...

THE MEDIATING EFFECT OF ORGANIZATIONAL COMMITMENT ON THE RELATIONSHIP BETWEEN WORKPLACE RESILIENCE AND TEACHER PROFESSIONAL IDENTITY

The purpose of this study was to determine the mediating effect of organizational commitment on the relationship between workplace resilience and teacher professional identity. Utilizing quantitative, non-experimental design via correlational technique, data were obtained from 300 respondents who are public elementary school teachers of the three national high schools in the province of Davao Del Sur. The researcher utilized a stratified random sampling technique and an online survey mode of data collection. The researcher also utilized the statistical tools mean, Pearson r, and Medgraph using Sobel z-test. From the results of the study, it was found out that there is a very high level of mean score for workplace resilience, a very high level of mean score for teacher professional identity and a high level of organizational commitment. Also, results revealed that there is a significant relationship between workplace resilience and teacher professional identity, a significant relationship between workplace resilience and organizational commitment and a significant relationship between organizational commitment and teacher professional identity. Further, it was revealed that there was full mediation on the effect of organizational commitment on the relationship between workplace resilience and teacher professional identity.<p> </p><p><strong> Article visualizations:</strong></p><p><img src="/-counters-/soc/0005/a.php" alt="Hit counter" /></p>

Adolescent simultaneous use of alcohol and marijuana by trends in cigarette and nicotine vaping from 2000 to 2020

BackgroundSimultaneous alcohol and marijuana (SAM) use is associated with adverse consequences for youth. While SAM use is overall declining among youth, prior studies indicate increasing marijuana use among US adolescents who ever used cigarettes, suggesting possible moderation of the alcohol-marijuana relationship by cigarette use. MethodsWe included 43,845 12-th grade students participating in Monitoring the Future data (2000–2020). A 5-level alcohol/marijuana measure was used, including past-year SAM, alcohol-only, marijuana-only, non-simultaneous alcohol and marijuana, or no use. Multinomial logistic regressions estimated associations between time periods (categorized based on sample size: 2000–2005, 2006–2009, 2010–2014, 2015–2020) and the 5-level alcohol/marijuana measure. Models adjusted for sex, race, parental education and survey mode and included interactions of time periods and lifetime cigarette or vaped nicotine use. ResultsWhile overall SAM among 12th graders decreased from 23.65% to 18.31% between 2000 and 2020, SAM increased among students who never used cigarettes or vaped nicotine (from 5.42% to 7.03%). Among students who ever used cigarettes or vaped nicotine, SAM increased from 39.2% in 2000–2005–44.1% in 2010–2014 then declined to 37.8% in 2015–2020. Adjusted models controlling for demographics indicated that among students with no lifetime cigarette or vaped nicotine use, students in 2015–2020 had 1.40 (95% C.I. 1.15–1.71) times the odds of SAM, and 5.43 (95% C.I. 3.63–8.12) times the odds of marijuana-only (i.e., no alcohol use) compared to students who used neither in 2000–2005. Alcohol-only declined over time in both students who ever and never used cigarettes or nicotine vape products. ConclusionParadoxically, while SAM declined in the overall adolescent US population, the prevalence of SAM increased among students who have never smoked cigarettes or vaped nicotine. This effect arises because of a substantial decline in the prevalence of cigarette smoking; smoking is a risk factor for SAM, and fewer students smoke. Increases in vaping are offsetting these changes, however. Preventing adolescent use of cigarettes and nicotine vaped products could have extended benefits for other substance use, including SAM.

Southern Hemisphere minke whales: standardised abundance estimates from the 1978/79 to 1997/98 IDCR-SOWER surveys

Minke whale abundance estimates, standardised by the use of consistent methodology throughout, are presented from the IWC/IDCR and SOWER Antarctic circumpolar sightings surveys for three circumpolar sets of cruises: 1978/79–1983/84, 1985/86–1990/91 and 1991/92–1997/98 (*still incomplete). The database estimation package DESS is used to obtain these standardised estimates. Two survey modes (closing and IO) are used in the surveys; IO mode is considered to provide less biased estimates. An updated estimate for the conversion factor from closing to ‘pseudo-passing’ mode of R = 0.826 (CV = 0.089) is obtained. IO and ‘pseudo-passing’ estimates are then combined using inverse-variance weighting to give estimates of 608,000 (CV = 0.130), 766,000 (CV = 0.091) and 268,000* (CV = 0.093) for the three circumpolar sets of cruises. These cruises have covered approximately 65%, 81% and 68% of the ice-free area south of 60°S. As estimates of abundance for Southern Hemisphere minke whales, these are negatively biased because some areas inside the pack ice cannot be surveyed, not all whales migrate into the area south of 60°S, the assumption is made that all whales on the trackline are sighted, and minke whale sightings for which species identification is uncertain (‘like minkes’) are omitted. The three circumpolar estimates are extrapolated simply to account for the different areas covered in the sets of surveys, and also for the increasing proportion of ‘like-minke’ sightings over time. The results suggest that for comparable areas the abundance estimates for the third circumpolar set of cruises are 55% (closing mode only) and 45% (IO mode only) of those for the second set, but that the first and second set estimates are within 15% of each other. The decrease in abundance between the second and third sets is statistically significant at the 5% level. Possible reasons for this estimated decline are discussed, related both to factors that might render the estimates non-comparable, and to population dynamics effects that could have led to a real decline. Further attention should be given, in particular, to the most appropriate method for estimation of mean school size for these surveys.

ICT INDICATORS AND MUSIC PERFORMANCE OF MAPEH STUDENTS: THE MEDIATING ROLE OF TEACHING COMPETENCY

This study aimed to determine the mediating effect of teaching competency on the relationship between ICT Indicators and the music performance of MAPEH students. The researcher utilizes a quantitative, non-experimental design via a correlational technique. The researcher obtained data from 300 Grade 11 and 12 students of the three national high schools under the division of Davao del Sur in Region XI. The researcher utilized a stratified random sampling technique and an online survey mode of data collection. The researcher also utilized the statistical tools: mean, Pearson r, regression and med graph using the Sobel z- test. The study results found that there is a very high mean score of teaching competency, high levels of ICT indicators and music performance of MAPEH students. Furthermore, there are significant relationships between ICT indicators and music performance, ICT indicators and teaching competency and teaching competency and music performance of MAPEH students. Further, the result revealed that there was complete mediation on the effect of teaching competency on the relationship between ICT Indicators and the music performance of MAPEH students.<p> </p><p><strong> Article visualizations:</strong></p><p><img src="/-counters-/soc/0005/a.php" alt="Hit counter" /></p>

Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality

Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality

Engaging Public Health Alumni in the Tracking of Career Trends: Results From a Large-Scale Experiment on Survey Fielding Mode.

We sought to understand the relative impact of fielding mode on response rate among public health alumni. As part of the 2021 Career Trends Survey of alumni from the University of Minnesota School of Public Health, we designed a fielding mode experiment to ascertain whether a paper survey, a postcard with a custom survey link ("postcard push-to-web"), a mobile telephone call or text (mobile), or an email invitation would garner the highest response rates. Invitations were randomly assigned from available contact information. Of 8531 alumni invited, 1671 alumni (19.6%) completed the survey. Among the initial fielding modes, the paper survey had the highest response rate (28%), followed by mobile (19%), email (10%), and postcard push-to-web (10%). More robust recent engagement with alumni relations, paper survey invitation or mode switch, and recent graduation were all significantly associated with a higher likelihood of response. Paper and mobile invitations had the highest response rates to our survey among public health alumni. Findings from this fielding mode experiment are relevant to schools and programs of public health seeking to capture similar information among their alumni, especially given current trends in investment in the public health workforce.

The Mode Effect of Web-Based Surveying on the 2018 U.S. Health and Retirement Study Measure of Cognitive Functioning.

Measuring cognition in an aging populabtion is a public health priority. A move towards survey measurement via the web (as opposed to phone or in-person) is cost-effective but challenging as it may induce bias in cognitive measures. We examine this possibility using an experiment embedded in the 2018 wave of data collection for the U.S. Health and Retirement Study (HRS). We utilize techniques from multiple group item response theory to assess the effect of survey mode on performance on the HRS cognitive measure. We also study the problem of attrition by attempting to predict dropout and via approaches meant to minimize bias in subsequent inferences due to attrition. We find evidence of an increase in scores for HRS respondents who are randomly assigned to the web-based mode of data collection in 2018. Web-based respondents score higher in 2018 than experimentally matched phone-based respondents, and they show much larger gains relative to 2016 performance and subsequently larger declines in 2020. The differential in favor of web-based responding is observed across all items, but is most pronounced for the Serial 7 task and numeracy items. Due to the relative ease of the web-based mode, we suggest a cutscore of 12 being used to indicate CIND (cognitively impaired but not demented) status when using the web-based version rather than 11. The difference in mode may be nonignorable for many uses of the HRS cognitive measure. In particular, it may require reconsideration of some cutscore-based approaches to identify impairment.