Interactive Voice Response Survey Research Articles

A nationwide mobile phone survey for tobacco use in Tanzania: Sample quality and representativeness compared to a household survey

We investigated the feasibility of an interactive voice response (IVR) survey in Tanzania and compared its prevalence estimates for tobacco use to the estimates of the 'Global Adult Tobacco Survey (GATS) 2018′. IVR participants were enrolled by random digit dialing. Quota sampling was employed to achieve the required sample sizes of age-sex strata: sex (male/female) and age (18–29-, 30–44-, 45–59-, and ≥60-year-olds). GATS was a nationally representative survey and used a multistage stratified cluster sampling design. The IVR sample’s weights were generated using the inverse proportional weighting (IPW) method with a logit model and the standard age-sex distribution of Tanzania. The IVR and GATS had 2362 and 4555 participants, respectively. Compared to GATS, the unweighted IVR sample had a higher proportion of males (58.7 % vs. 43.2 %), educated people (secondary/above education: 43.3 % vs. 21.1 %), and urban residents (56.5 % vs. 40 %). The weighted prevalence (95 % confidence interval (CI)) of current smoking was 4.99 % (4.11–6.04), 5.22 % (4.36–6.24), and 7.36 % (6.51–8.31) among IVR (IPW), IVR (age-sex standard), and GATS samples, respectively; the weighted prevalence (95 % CI) of smokeless tobacco use was similar: 3.54 % (2.73–4.57), 3.58 % (2.80–4.56), and 2.43 % (1.98–2.98), respectively. Most differences in point estimates for tobacco indicators were small (<2%). Overall, the odds of tobacco smoking indicators were lower in IVR than in GATS; however, the odds of smokeless tobacco use were reversed. Although we found under-/over-estimation of the prevalence of tobacco use in IVR than GATS, the estimates were close. Further research is required to increase the representativeness of IVR.

Accuracy and practical considerations in an RDD text-to-web survey

This study investigates the accuracy of a survey that combines smartphone completion, random digit dialing (RDD), and text message invitation to a web survey. A benchmarking study was conducted using 26 questionnaire items from a survey on wellbeing, health, and life in general. Additionally, methodological, technical, ethical, and cost considerations of this relatively new approach to web survey data collection were investigated, compared to previous research findings, and discussed with an aim to propose practical solutions. Ultimately, average errors in this survey were compared to average errors in three other probability samples and one nonprobability online panel sample (i.e., reference samples) using nationally representative benchmarks from high-quality government data sources. The results showed that the sample used in this study was similarly accurate to the reference samples from a different benchmarking study. Based on these findings, a very low response rate in the RDD text-to-web survey did not appear to introduce significant nonresponse bias for a majority of survey items, and all large errors can be explained. Hence, in countries where prior consent to text messages is not required, RDD text-to-web should be considered as a cost- and time-effective alternative to probability- and nonprobability-based online panel surveys, telephone, or interactive voice response surveys, and used in market, public opinion, and social research.

Improving success of non-communicable diseases mobile phone surveys: Results of two randomized trials testing interviewer gender and message valence in Bangladesh and Uganda.

Although interactive voice response (IVR) is a promising mobile phone survey (MPS) method for public health data collection in low- and middle-income countries (LMICs), participation rates for this method remain lower than traditional methods. This study tested whether using different introductory messages increases the participation rates of IVR surveys in two LMICs, Bangladesh and Uganda. We conducted two randomized, controlled micro-trials using fully-automated random digit dialing to test the impact of (1) the gender of the speaker recording the survey (i.e., survey voice); and (2) the valence of the invitation to participate in the survey (i.e., survey introduction) on response and cooperation rates. Participants indicated their consent by using the keypad of cellphones. Four study arms were compared: (1) male and informational (MI); (2) female and information (FI); (3) male and motivational (MM); and (4) female and motivational (FM). Bangladesh and Uganda had 1705 and 1732 complete surveys, respectively. In both countries, a majority of the respondents were males, young adults (i.e., 18-29-year-olds), urban residents, and had O-level/above education level. In Bangladesh, the contact rate was higher in FI (48.9%), MM (50.0%), and FM (55.2%) groups than in MI (43.0%); the response rate was higher in FI (32.3%) and FM (33.1%) but not in MM (27.2%) and MI (27.1%). Some differences in cooperation and refusal rates were also observed. In Uganda, MM (65.4%) and FM (67.9%) had higher contact rates than MI (60.8%). The response rate was only higher in MI (52.5%) compared to MI (45.9%). Refusal and cooperation rates were similar. In Bangladesh, after pooling by introductions, female arms had higher contact (52.1% vs 46.5%), response (32.7% vs 27.1%), and cooperation (47.8% vs 40.4%) rates than male arms. Pooling by gender showed higher contact (52.3% vs 45.6%) and refusal (22.5% vs 16.3%) rates but lower cooperation rate (40.0% vs 48.2%) in motivational arms than informational arms. In Uganda, pooling intros did not show any difference in survey rates by gender; however, pooling by intros showed higher contact (66.5% vs 61.5%) and response (50.0% vs 45.2%) rates in motivational arms than informational arms. Overall, we found higher survey rates among female voice and motivational introduction arms compared to male voice and informational introduction arm in Bangladesh. However, Uganda had higher rates for motivational intro arms only compared to informational arms. Gender and valence must be considered for successful IVR surveys. Name of the registry: ClinicalTrials.gov. Trial registration number: NCT03772431. Date of registration: 12/11/2018, Retrospectively Registered. URL of trial registry record: https://clinicaltrials.gov/ct2/show/NCT03772431?term=03772431&cond=Non-Communicable+Disease&draw=2&rank=1. Protocol Availability: https://www.researchprotocols.org/2017/5/e81.

Effect of the Data Collection Method on Mobile Phone Survey Participation in Bangladesh and Tanzania: Secondary Analyses of a Randomized Crossover Trial.

Mobile phone surveys provide a novel opportunity to collect population-based estimates of public health risk factors; however, nonresponse and low participation challenge the goal of collecting unbiased survey estimates. This study compares the performance of computer-assisted telephone interview (CATI) and interactive voice response (IVR) survey modalities for noncommunicable disease risk factors in Bangladesh and Tanzania. This study used secondary data from a randomized crossover trial. Between June 2017 and August 2017, study participants were identified using the random digit dialing method. Mobile phone numbers were randomly allocated to either a CATI or IVR survey. The analysis examined survey completion, contact, response, refusal, and cooperation rates of those who received the CATI and IVR surveys. Differences in survey outcomes between modes were assessed using multilevel, multivariable logistic regression models to adjust for confounding covariates. These analyses were adjusted for clustering effects by mobile network providers. For the CATI surveys, 7044 and 4399 phone numbers were contacted in Bangladesh and Tanzania, respectively, and 60,863 and 51,685 phone numbers, respectively, were contacted for the IVR survey. The total numbers of completed interviews in Bangladesh were 949 for CATI and 1026 for IVR and in Tanzania were 447 for CATI and 801 for IVR. Response rates for CATI were 5.4% (377/7044) in Bangladesh and 8.6% (376/4391) in Tanzania; response rates for IVR were 0.8% (498/60,377) in Bangladesh and 1.1% (586/51,483) in Tanzania. The distribution of the survey population was significantly different from the census distribution. In both countries, IVR respondents were younger, were predominantly male, and had higher education levels than CATI respondents. IVR respondents had a lower response rate than CATI respondents in Bangladesh (adjusted odds ratio [AOR]=0.73, 95% CI 0.54-0.99) and Tanzania (AOR=0.32, 95% CI 0.16-0.60). The cooperation rate was also lower with IVR than with CATI in Bangladesh (AOR=0.12, 95% CI 0.07-0.20) and Tanzania (AOR=0.28, 95% CI 0.14-0.56). Both in Bangladesh (AOR=0.33, 95% CI 0.25-0.43) and Tanzania (AOR=0.09, 95% CI 0.06-0.14), there were fewer completed interviews with IVR than with CATI; however, there were more partial interviews with IVR than with CATI in both countries. There were lower completion, response, and cooperation rates with IVR than with CATI in both countries. This finding suggests that, to increase representativeness in certain settings, a selective approach may be needed to design and deploy mobile phone surveys to increase population representativeness. Overall, CATI surveys may offer a promising approach for surveying potentially under-represented groups like women, rural residents, and participants with lower levels of education in some countries.

The effect of airtime incentives to improve participation in noncommunicable disease interactive voice response surveys: randomized controlled trials in Colombia and Tanzania

Abstract Objective: We assessed whether airtime incentives can improve cooperation and response rates for a noncommunicable disease interactive voice response survey in Colombia and Tanzania. Methods: Participants were randomized to four arms: (a) no incentive; (b) 1X incentive, where X equals to 5000 Colombian Pesos (US$1.35) or 3000 Tanzanian shillings (TSh; US$1.29); (3) 2X incentive; or (4) lottery incentive of 50 000 COP (US$18.90) or 50 000 TSh (US$21.50), where the odds of winning the lottery were 1:20. Adults aged 18 years and older who possessed a functioning mobile phone were sampled using random digit dialling. We analyzed the primary outcomes, cooperation and response rates using a log binomial regression model as computed by the American Association of Public Opinion Research. Results: In Colombia, between October 15 to November 13, 2018, 125 745 phone calls were made. In Tanzania, 67 800 random digit dial phone calls were made from August 9 to 28, 2018. In Colombia, we observed significantly higher cooperation rates in the 1X, 2X and lottery incentive groups compared to control. Additionally, response rates were significantly higher in the 1X and 2X incentive groups but were significantly lower in lottery group compared to control. In Tanzania, both cooperation and response rates were significantly higher in the 1X, 2X and lottery incentive groups compared to control. Conclusion: Except for the lottery incentive arm in Colombia, which yielded a response rate lower than the control, the introduction of airtime incentives significantly improved cooperation and response rates in Colombia and Tanzania, with no notable variations between the incentive arms.

Understanding community perception and acceptability of interactive voice response survey method: findings from formative research in Bangladesh.

Abstract Mobile phone technology’s expansion in Bangladesh has ushered in its use for rapid population-based data collection. This study was conducted to assess community perceptions on the acceptability, usability and challenges of participating in mobile phone surveys (MPS) on non-communicable disease risk factors through interactive voice response (IVR) in Bangladesh. Three user groups and seven focus group discussions with different communities, along with seven key informant interviews with relevant experts, were conducted in Bangla. Interviews were audio-recorded and analysed manually using thematic analysis. Participants indicated their unwillingness to receive calls during their busy hours. They suggested shorter duration calls and two sessions to complete longer duration surveys. They recommended that incentives can increase call completion, and previous notification through voice or text message might improve this further. Previous experience with scam calls and mobile balance depletion resulted in their hesitancy to receive calls from unknown numbers. Respondents showed concerns about sharing sensitive issues like alcohol consumption. Providing responses by key presses, less familiarity with smartphone use, availability and strength of mobile networks were identified as challenges for IVR surveys. The study emphasized careful consideration of survey duration and burden, trustworthiness, general and technical literacy and socio-cultural factors to increase MPS participation.

Parameters of EMA Compliance and Self-Reported Reactivity in a Longitudinal Study of Young Adult Cannabis and Tobacco Co-Users.

Co-use of cannabis and tobacco has become increasingly popular among young adults. Interactive voice response (IVR) based ecological momentary assessment (EMA) allows for measurement of behavior in or near real-time, but has limitations including non-compliance, missing data, and potential for reactivity (e.g., behavior change) from frequent assessments. This study examined tobacco and cannabis use characteristics and factors associated with IVR compliance and self-reported reactivity in 97 young adults who reported cannabis and tobacco co-use at baseline and completed daily IVR surveys of co-use behavior at three random times per day for 28 days. Overall IVR compliance was 55%, with a modal compliance of 60%. Compliance rates did not differ across morning, midday, and evening surveys, but significantly declined over time. The sample was divided into high frequency responders (>70% calls completed, n=35) and low frequency responders (<70%, calls completed n=62). There were no differences between high and low frequency responders on any baseline demographic, tobacco use (nicotine dependence severity), alcohol, or cannabis use characteristics (past 30-day frequency of use). Participants were receptive to IVR-based EMA monitoring and, 16.5% reported purposely decreasing nicotine/tobacco use due to monitoring, while 19.6% reported purposely decreasing cannabis use, which predicted lower cannabis use post-EMA monitoring. Real-time assessment of co-use behavior among young adults does not appear to be impacted by specific demographics or substance use severity (nicotine dependence, heavy drinking). Data suggest some predictive utility of IVR-based EMA monitoring on short-term behavior change. More intensive approaches are needed to improve compliance among young adult cannabis and tobacco co-users.

Estimation of bed net coverage indicators in Tanzania using mobile phone surveys: a comparison of sampling approaches

Threats to maintaining high population access with effective bed nets persist due to errors in quantification, bed net wear and tear, and inefficiencies in distribution activities. Monitoring bed net coverage is therefore critical, but usually occurs every 2-3years through expensive, large-scale household surveys. Mobile phone-based survey methodologies are emerging as an alternative to household surveys and can provide rapid estimates of coverage, however, little research on varied sampling approaches has been conducted in sub-Saharan Africa. A nationally and regionally representative cross-sectional mobile phone survey was conducted in early 2021 in Tanzania with focus on bed net ownership and access. Half the target sample was contacted through a random digit dial methodology (n = 3500) and the remaining half was reached through a voluntary opt-in respondent pool (n = 3500). Both sampling approaches used an interactive voice response survey. Standard RBM-MERG bed net indicators and AAPOR call metrics were calculated. In addition, the results of the two sampling approaches were compared. Population access (i.e., the percent of the population that could sleep under a bed net, assuming one bed net per two people) varied from a regionally adjusted low of 48.1% (Katavi) to a high of 65.5% (Dodoma). The adjusted percent of households that had a least one bed net ranged from 54.8% (Pemba) to 75.5% (Dodoma); the adjusted percent of households with at least one bed net per 2 de facto household population ranged from 35.9% (Manyara) to 55.7% (Dodoma). The estimates produced by both sampling approaches were generally similar, differing by only a few percentage points. An analysis of differences between estimates generated from the two sampling approaches showed minimal bias when considering variation across the indicator for households with at least one bed net per two de facto household population. The results generated by this survey show that overall bed net access in the country appears to be lower than target thresholds. The results suggest that bed net distribution is needed in large sections of the country to ensure that coverage levels remain high enough to sustain protection against malaria for the population.

Women's Experiences With Family Planning Under COVID-19: A Cross-Sectional, Interactive Voice Response Survey in Malawi, Nepal, Niger, and Uganda.

We conducted an assessment in Malawi, Nepal, Niger, and Uganda to document access-related reasons for not using contraceptive methods during the COVID-19 pandemic that led to unintended pregnancies, describe use of modern contraception among women in potential need of contraception compared to before the pandemic, examine method choice, and describe barriers to contraceptive access and use. Between December 2020 and May 2021, we conducted an opt-in phone survey with 21,692 women, followed by an outbound survey with 5,124 women who used modern nonpermanent contraceptive methods or who did not want to get pregnant within 2 years but were not using a modern contraceptive method. The surveys examined current behaviors and documented behaviors before the pandemic retrospectively. We used multivariable logistic regression models to examine factors associated with contraceptive use dynamics during COVID-19. Pregnant women surveyed reported that the pandemic had affected their ability to delay or avoid getting pregnant, ranging from 27% in Nepal to 44% in Uganda. The percentage of respondents to the outbound survey using modern contraception decreased during the pandemic in all countries except Niger. Fear of COVID-19 infection was associated with discontinuing modern contraception in Malawi and with not adopting a modern method among nonusers in Niger. Over 79% of surveyed users were using their preferred method. Among nonusers who tried obtaining a method, reasons for nonuse included unavailability of the preferred method or of providers and lack of money; nonusers who wanted a method but did not try to obtain one cited fear of COVID-19 infection. We found evidence of surveyed women attributing unintended pregnancies to the pandemic and examples of constraints to contraceptive access and use on the supply and demand side. The effects of the pandemic must be interpreted within the local contraceptive, health system, and epidemiological context.

Effectiveness of WhatsApp for Measuring Migration in Follow-Up Phone Surveys. Lessons from a Mode Experiment in Two Low-Income Countries during COVID Contact Restrictions

Phone surveys have increasingly become important data collection tools in developing countries, particularly in the context of sudden contact restrictions due to the COVID-19 pandemic. So far, there is limited evidence regarding the potential of the messenger service WhatsApp for remote data collection despite its large global coverage and expanding membership. WhatsApp may offer advantages in terms of reducing panel attrition and cutting survey costs. WhatsApp may offer additional benefits to migration scholars interested in cross-border migration behavior which is notoriously difficult to measure using conventional face-to-face surveys. In this field experiment, we compared the response rates between WhatsApp and interactive voice response (IVR) modes using a sample of 8446 contacts in Senegal and Guinea. At 12%, WhatsApp survey response rates were nearly eight percentage points lower than IVR survey response rates. However, WhatsApp offers higher survey completion rates, substantially lower costs and does not introduce more sample selection bias compared to IVR. We discuss the potential of WhatsApp surveys in low-income contexts and provide practical recommendations for field implementation.

Promised and Lottery Airtime Incentives to Improve Interactive Voice Response Survey Participation Among Adults in Bangladesh and Uganda: Randomized Controlled Trial.

BackgroundIncreased mobile phone penetration allows the interviewing of respondents using interactive voice response surveys in low- and middle-income countries. However, there has been little investigation of the best type of incentive to obtain data from a representative sample in these countries.ObjectiveWe assessed the effect of different airtime incentives options on cooperation and response rates of an interactive voice response survey in Bangladesh and Uganda.MethodsThe open-label randomized controlled trial had three arms: (1) no incentive (control), (2) promised airtime incentive of 50 Bangladeshi Taka (US $0.60; 1 BDT is approximately equivalent to US $0.012) or 5000 Ugandan Shilling (US $1.35; 1 UGX is approximately equivalent to US $0.00028), and (3) lottery incentive (500 BDT and 100,000 UGX), in which the odds of winning were 1:20. Fully automated random-digit dialing was used to sample eligible participants aged ≥18 years. The risk ratios (RRs) with 95% confidence intervals for primary outcomes of response and cooperation rates were obtained using log-binomial regression.ResultsBetween June 14 and July 14, 2017, a total of 546,746 phone calls were made in Bangladesh, with 1165 complete interviews being conducted. Between March 26 and April 22, 2017, a total of 178,572 phone calls were made in Uganda, with 1248 complete interviews being conducted. Cooperation rates were significantly higher for the promised incentive (Bangladesh: 39.3%; RR 1.38, 95% CI 1.24-1.55, P<.001; Uganda: 59.9%; RR 1.47, 95% CI 1.33-1.62, P<.001) and the lottery incentive arms (Bangladesh: 36.6%; RR 1.28, 95% CI 1.15-1.45, P<.001; Uganda: 54.6%; RR 1.34, 95% CI 1.21-1.48, P<.001) than those for the control arm (Bangladesh: 28.4%; Uganda: 40.9%). Similarly, response rates were significantly higher for the promised incentive (Bangladesh: 26.5%%; RR 1.26, 95% CI 1.14-1.39, P<.001; Uganda: 41.2%; RR 1.27, 95% CI 1.16-1.39, P<.001) and lottery incentive arms (Bangladesh: 24.5%%; RR 1.17, 95% CI 1.06-1.29, P=.002; Uganda: 37.9%%; RR 1.17, 95% CI 1.06-1.29, P=.001) than those for the control arm (Bangladesh: 21.0%; Uganda: 32.4%).ConclusionsPromised or lottery airtime incentives improved survey participation and facilitated a large sample within a short period in 2 countries.Trial RegistrationClinicalTrials.gov NCT03773146; http://clinicaltrials.gov/ct2/show/NCT03773146

Violence and sexual and reproductive health service disruption among girls and young women during COVID-19 pandemic in Nepal: A cross-sectional study using interactive voice response survey.

IntroductionThere is a paucity of data on the impact of COVID-19 pandemic on girls and young women. The study examines the prevalence and correlates of violence and sexual and reproductive health (SRH) service disruption among girls and young women during COVID-19 restrictions and lockdown.MethodsAn interactive voice response survey was conducted among girls and women aged 18–24 years between 10th March to 24th April 2021. The survey enrolled 1314 participants. Descriptive analysis was used to assess prevalence of violence and SRH service disruption. Two sampled test of proportion was used to asses difference in prevalence of violence before and after the pandemic. Logistic regression was used to examine relationship between the outcome variables and socio demographic predictors.ResultsThe study did not find significant difference in prevalence of violence before and after the pandemic. Education was found to be protective against experience of both physical and sexual violence after the pandemic. Dalit participants were four times more likely to report physical violence after the pandemic than Brahmin/Chhetri participants (OR:3.80; CI:1.41–10.24). Participants from 22-24-year age group were twice as likely to experience sexual violence compared to girls and participants from 18-21year age group (OR:2.25; CI:1.04–4.84). Participants from urban municipalities were 29% less likely to report SRH services disruption than participants from rural municipalities (OR-0.71, 95% CI: 0.55–0.91). Participants with disability were twice as likely to report disruption than participants without disability (OR-2.35, 95% CI: 1.45–3.82).ConclusionsTo reduce violence against girls and women due to the pandemic, interventions should focus on Dalit women and on preventing education discontinuation among girls and women. SRH service during the pandemic needs to be improved for girls and women with focus on girls and women from rural municipalities and girls and women with disability.

Data Collection Smart and Simple: Evaluation and Metanalysis of Call Data From Studies Applying the 5Q Approach

Agricultural development projects often struggle to show impact because they lack agile and cost-effective data collection tools and approaches. Due to the lack of real-time feedback data, they are not responsive to emerging opportunities during project implementation and often miss the needs of beneficiaries. This study evaluates the application of the 5Q approach (5Q). It shows findings from analyzing more than 37,000 call log records from studies among five countries. Results show that response rate and completion status for interactive voice response (IVR) surveys vary between countries, survey types, and survey topics. The complexity of question trees, the number of question blocks in a tree, and the total call duration are relevant parameters to improve response and survey completion rate. One of the main advantages of IVR surveys is low cost and time efficiency. The total cost for operating 1,000 calls of 5 min each in five countries was 1,600 USD. To take full advantage of 5Q, questions and question-logic trees must follow the principle of keeping surveys smart and simple and aligned to the project's theory of change and research questions. Lessons learned from operating the IVR surveys in five countries show that the response rate improves through quality control of the phone contact database, using a larger pool of phone numbers to reach the desired target response rate, and using project communication channels to announce the IVR surveys. Among other things, the respondent's first impression is decisive. Thus, the introduction and the consent request largely determine the response and completion rate.

User Perceptions and Experiences of an Interactive Voice Response Mobile Phone Survey Pilot in Uganda: Qualitative Study

BackgroundWith the growing burden of noncommunicable diseases in low- and middle- income countries, the World Health Organization recommended a stepwise approach of surveillance for noncommunicable diseases. This is expensive to conduct on a frequent basis and using interactive voice response mobile phone surveys has been put forth as an alternative. However, there is limited evidence on how to design and deliver interactive voice response calls that are robust and acceptable to respondents.ObjectiveThis study aimed to explore user perceptions and experiences of receiving and responding to an interactive voice response call in Uganda in order to adapt and refine the instrument prior to national deployment.MethodsA qualitative study design was used and comprised a locally translated audiorecorded interactive voice response survey delivered in 4 languages to 59 purposively selected participants' mobile phones in 5 survey rounds guided by data saturation. The interactive voice response survey had modules on sociodemographic characteristics, physical activity, fruit and vegetable consumption, diabetes, and hypertension. After the interactive voice response survey, study staff called participants back and used a semistructured interview to collect information on the participant’s perceptions of interactive voice response call audibility, instruction clarity, interview pace, language courtesy and appropriateness, the validity of questions, and the lottery incentive. Descriptive statistics were used for the interactive voice response survey, while a framework analysis was used to analyze qualitative data.ResultsKey findings that favored interactive voice response survey participation or completion included preference for brief surveys of 10 minutes or shorter, preference for evening calls between 6 PM and 10 PM, preference for courteous language, and favorable perceptions of the lottery-type incentive. While key findings curtailing participation were suspicion about the caller’s identity, unclear voice, confusing skip patterns, difficulty with the phone interface such as for selecting inappropriate digits for both ordinary and smartphones, and poor network connectivity for remote and rural participants.ConclusionsInteractive voice response surveys should be as brief as possible and considerate of local preferences to increase completion rates. Caller credibility needs to be enhanced through either masking the caller or prior community mobilization. There is need to evaluate the preferred timing of interactive voice response calls, as the finding of evening call preference is inconclusive and might be contextual.

The Effects of Nonresponse and Sampling Omissions on Estimates on Various Topics in Federal Surveys: Telephone and IVR Surveys of Address-Based Samples

With declining response rates and challenges of using RDD sampling for telephone surveys, collecting data from address-based samples has become more attractive. Two approaches are doing telephone interviews at telephone numbers matched to addresses and asking those at sampled addresses to call into an Interactive Voice Response (IVR) system to answer questions. This study used in-person interviewing to evaluate the effects of nonresponse and problems matching telephone numbers when telephone and IVR were used as the initial modes of data collection. The survey questions were selected from major US federal surveys covering a variety of topics. Both nonresponse and, for telephone, inability to find matches result in important nonresponse error for nearly half the measures across all topics, even after adjustments to fit the known demographic characteristics of the residents. Producing credible estimates requires using supplemental data collection strategies to reduce error from nonresponse.

Automated and Interviewer-Administered Mobile Phone Surveys in Burkina Faso: Sociodemographic Differences Among Female Mobile Phone Survey Respondents and Nonrespondents.

BackgroundThe remarkable growth of cell phone ownership in low- and middle-income countries has generated significant interest in using cell phones for conducting surveys through computer-assisted telephone interviews, live interviewer-administered surveys, or automated surveys (ie, interactive voice response).ObjectiveThis study aimed to compare, by mode, the sociodemographic characteristics of cell phone owners who completed a follow-up phone survey with those who did not complete the survey.MethodsThe study was based on a nationally representative sample of women aged 15 to 49 years who reported cell phone ownership during a household survey in Burkina Faso in 2016. Female cell phone owners were randomized to participate in a computer-assisted telephone interview or hybrid interactive voice response follow-up phone survey 11 months after baseline interviews. Completion of the phone survey was defined as participants responding to more than 50% of questions in the phone survey. We investigated sociodemographic characteristics associated with cell phone survey completion using multivariable logistic regression models, stratifying the analysis by survey mode and by directly comparing computer-assisted telephone interview and hybrid interactive voice response respondents.ResultsA total of 1766 women were called for the phone survey between November 5 and 17, 2017. In both the computer-assisted telephone interview and hybrid interactive voice response samples, women in urban communities and women with secondary education or higher were more likely to complete the survey than their rural and less-educated counterparts. Compared directly, women who completed the hybrid interactive voice response survey had higher odds of having a secondary education than those who completed computer-assisted telephone interviews (odds ratio 1.7, 95% CI 1.1-2.6).ConclusionsIn Burkina Faso, computer-assisted telephone interviews are the preferred method of conducting cell phone surveys owing to less sample distortion and a higher response rate compared with a hybrid interactive voice response survey.

In search of the optimal mode for mobile phone surveys in developing countries: A comparison of IVR, SMS, and CATI in Nigeria

Mobile phone surveys are increasingly prevalent in low- and middle-income countries. The main modes include computer-assisted telephone interviewing (CATI), interactive voice response (IVR), and short message service (SMS, or text messaging). But there is surprisingly little research to guide researchers in selecting the optimal mode for a particular survey. To address this gap, this study compares cross-sectional CATI, IVR, SMS, and face-to-face (FTF) surveys of the general population in Nigeria. We ask four research questions: (1) What are production and response rates to CATI, IVR, SMS, and FTF surveys? (2) How representative (age, gender, education, marital status, literacy, household assets, urbanicity) are CATI, IVR, and SMS respondents relative to FTF respondents? (3) Can IVR and SMS provide an unbiased estimate of voting behavior? If there is bias, to what extent can weights reduce bias? (4) How does the cost and time differ across mobile phone survey modes? We find that FTF had the highest response rate (99%), followed by CATI (15%), IVR (3%) and SMS (0.2%). All mobile phone modes had substantial deficiencies with representativeness: mobile phones underrepresented women, older people, the less educated, and people in rural areas. There were differences in representativeness among mobile phone modes, but differences were relatively small and inconsistent. Both SMS and IVR produced biased estimates of voting relative to official statistics – but SMS was less biased than IVR. Weighting SMS and IVR data for demographic characteristics did not reduce bias. With regard to cost, we find that CATI is the most expensive mobile phone survey mode. For a survey of 3,000 completes, IVR is 43% the cost of CATI, and SMS is 24% the cost of CATI. SMS is significantly less expensive than IVR. We discuss the implications of these results for research and practice.

Acceptability and Use of Interactive Voice Response Mobile Phone Surveys for Noncommunicable Disease Behavioral Risk Factor Surveillance in Rural Uganda: Qualitative Study.

BackgroundThere is need for more timely data to inform interventions that address the growing noncommunicable disease (NCD) epidemic. With a global increase in mobile phone ownership, mobile phone surveys can bridge this gap.ObjectiveThis study aimed to explore the acceptability and use of interactive voice response (IVR) surveys for surveillance of NCD behavioral risk factors in rural Uganda.MethodsThis qualitative study employed user group testing (UGT) with community members. The study was conducted at the Iganga-Mayuge Health and Demographic Surveillance Site (IM-HDSS) in Eastern Uganda. We conducted four UGTs which consisted of different categories of HDSS members: females living in urban areas, males living in urban areas, females living in rural areas, and males living in rural areas. Participants were individually sent an IVR survey, then were brought in for a group discussion using a semistructured guide. Data were analyzed thematically using directed content analysis.ResultsParticipants perceived that IVR surveys may be useful in promoting confidentiality, saving costs, and raising awareness on NCD behavioral risk factors. Due to the clarity and delivery of questions in the local language, the IVR survey was perceived as easy to use. Community members suggested scheduling surveys on specific days and sending reminders as ways to improve their use for surveillance. Social issues such as domestic violence and perceptions toward unknown calls, technological factors including poor network connections and inability to use phones, and personal issues such as lack of access to phones and use of multiple networks were identified as barriers to the acceptability and use of mobile phone surveys. However, incentives were reported to motivate people to complete the survey.ConclusionsCommunity members reflected on contextual and sociological implications of using mobile phones for surveillance of NCD behavioral risk factors. The opportunities and challenges that affect acceptability and use of IVR surveys should be considered in designing and implementing surveillance programs for NCD risk factors.

Perceptions on using interactive voice response surveys for non-communicable disease risk factors in Uganda: a qualitative exploration.

Decision-makers need up to date information on risk factors for effective prevention and control of non-communicable diseases (NCDs). Currently available surveys are infrequent and costly to implement. The objective of the study was to explore perceptions on using an interactive voice response (IVR) survey for data collection on NCD risk factors. Five focus group discussions (FGDs), including rural and urban, elderly and young adults, male and female groups; and eleven key informant interviews (KIIs) of researchers and NCD policy makers were conducted. Respondents were audio recorded and data were transcribed into text. Data were entered into QDA miner software for analysis. Meaningful units were generated and then merged into codes and categories. Quotes are presented highlighting findings. At the individual level, age, gender, disability, past experience and being technology literate were perceived as key determinants on whether respondents would accept an IVR survey. Receiving the IVR at a time at which people are usually available to take calls increases participation. However, technological accessibility like presence of a mobile network signal and possession of mobile phones were critical for use of IVR. Participants recommended that community sensitization activities be provided, IVR be conducted at appropriate times and frequency, and that incentives may improve survey participation. IVR has the potential to quickly collect data from a wide geographic scope. However, caution needs to be taken to ensure that certain categories of people are not excluded because of their location, ability, age or gender. Sensitization prior to the survey, proper timing and structured incentives could increase participation.

Effect of airtime incentives on response and cooperation rates in non-communicable disease interactive voice response surveys: randomised controlled trials in Bangladesh and Uganda

BackgroundThe global proliferation of mobile phones offers opportunity for improved non-communicable disease (NCD) data collection by interviewing participants using interactive voice response (IVR) surveys. We assessed whether airtime incentives can...