Prepaid Incentives Research Articles

Effect of a pre-paid incentive on response rates to an Address-Based Sampling (ABS) Web-Mail survey

The effects of incentives on response rates, web completion rates and demographic and socioeconomic characteristics were investigated in a randomized experiment for a general population economic attitude survey. The experiment was conducted in two groups: 1) fresh cases from Address based sampling (ABS) postal addresses, and 2) recontact cases that were interviewed six months ago. The prepaid cash incentive condition was crossed with a set of Web-Mail survey contact strategies. While the fresh cases were contacted by Web-Mail concurrent or web-intensive contact strategies, the recontact cases were contacted by mail, concurrent or web-intensive contact strategies. Overall findings showed that incentives increased average response propensity without changing the covariance component of the nonresponse bias given the comparisons on a set of demographic and socioeconomic characteristics by the incentive condition. While the prepaid cash incentives significantly increased the web completion rates in the web intensive contact strategy for the fresh sample, they had a reversed effect in the concurrent strategy for the recontact sample.

Prepaid and promised incentives in web surveys: an experiment

Prepaid monetary incentives consistently exert the largest positive effect on response rates in mail surveys. For web-based surveys, it has not been possible to administer monetary incentives via the Internet in advance. Recently, several new web-based services have been introduced that can transfer money to people online. Does this really have the same positive effect on response rates as shown in traditional mail surveys? The authors investigated this question experimentally in the context of a web-based survey among members of a professional association in Virginia. The results indicate that prepaid incentives in web surveys seem to have no advantages concerning the willingness to participate, actual completion rates, and the share of incomplete response patterns when compared with postpaid incentives. Furthermore, postpaid incentives show no advantages over no incentives. Finally, compared to no incentives, prize draws increase completion rates and also reduce various incomplete participation patterns.

Population Survey Features and Response Rates: A Randomized Experiment.

To study the effects of several survey features on response rates in a general population health survey. In 2012 and 2013, 8000 households in British Columbia, Canada, were randomly allocated to 1 of 7 survey variants, each containing a different combination of survey features. Features compared included administration modes (paper vs online), prepaid incentive ($2 coin vs none), lottery incentive (instant vs end-of-study), questionnaire length (10 minutes vs 30 minutes), and sampling frame (InfoCanada vs Canada Post). The overall response rate across the 7 groups was 27.9% (range = 17.1-43.4). All survey features except the sampling frame were associated with statistically significant differences in response rates. The survey mode elicited the largest effect on the odds of response (odds ratio [OR] = 2.04; 95% confidence interval [CI] = 1.61, 2.59), whereas the sampling frame showed the least effect (OR = 1.14; 95% CI = 0.98, 1.34). The highest response was achieved by mailing a short paper survey with a prepaid incentive. In a mailed general population health survey in Canada, a 40% to 50% response rate can be expected. Questionnaire administration mode, survey length, and type of incentive affect response rates.

Sample Representation and Substantive Outcomes Using Web With and Without Incentives Compared to Telephone in an Election Survey

Abstract The objective of this article is to understand how the change of mode from telephone to web affects data quality in terms of sample representation and substantive variable bias. To this end, an experiment, consisting of a web survey with and without a prepaid incentive, was conducted alongside the telephone Swiss election survey. All three designs used identical questionnaires and probability samples drawn from a national register of individuals. First, our findings show that differences in completion rates mostly reflect different levels of coverage in the two modes. Second, incentives in the web survey strongly increase completion rates of all person groups, with the exception of people without Internet access or limited computer literacy. Third, we find voting behavior to be much closer to official figures in the web with the incentive version compared to the two other designs. However, this is partly due to the different sociodemographic compositions of the samples. Other substantive results suggest that the incentive version includes harder-to-reach respondents. Unit costs are much lower in the two web designs compared to the telephone, including when a relatively high incentive is used. We conclude that in countries with high Internet penetration rates such as Switzerland, web surveys are already likely to be highly competitive.

Effects of Incentive Amount and Type of Web Survey Response Rates

Providing meaningful incentives demonstrates to respondents that researchers understand the competing demands on their time and value their input. The effects of incentives, particularly when prepaid, are strongly established in survey research literature as effective tools for increasing response. However, effectiveness of incentives on web-administered surveys is less clear, and can be impacted by a number of factors, including incentive type and amount, timing, and mode of survey administration. This paper seeks to contribute to research on incentives for web-based surveys by examining the effects of the following: An additional post-incentive for early completion A pre-paid incentive in combination with a post-paid incentive Pre-incentives as a nonresponse follow-up strategy This paper uses data collected during the first wave of a nationally-representative survey of public school principals designed to take place across three waves of data collection. To determine a maximally-effective incentive strategy for subsequent years, we embedded an experiment into the study using electronic gift cards. All sample members were eligible for a standard $50 post-response incentive, but were also randomly assigned to one of four experimental conditions: (1) an additional $50 incentive for completing early in the field period, (2) a $25 incentive pre-paid with the initial survey mailing, (3) a $25 pre-paid incentive used during nonresponse follow-up, and (4) the standard $50 post response incentive, which serves as the control group for this experiment.

PRM135 - Response Rates In Direct-To-Patient Surveys

Survey response rates continue to decline across all modes of administration for public, private, and government organizations conducting survey research. This review examines response rates (RR) for direct-to-patient survey studies in health economics and outcomes research (HEOR). RR was examined for 21 HEOR patient surveys over 10 years. Patients were identified for each survey from a large, national administrative claims data base using study-specific inclusion criteria. Patients were then recruited directly by mail for participation. Surveys were administered in multiple disease areas including cardiovascular, dermatology, digestive, mental health, metabolic/endocrine, musculoskeletal, neurology, and respiratory. Survey length, incentive strategy (pre-paid vs. post-paid), incentive amount, season of administration, and condition type (chronic/acute) were assessed for impact on RR. Average response rate was 23% (SD=6). Pre-paid incentives were used in 86% of surveys. Mean RR for pre-paid incentives was 24% (SD=6) and 17% (SD=8) for post-paid incentives, supporting existing research on reciprocity garnered through use of pre-paid incentives. A $10 incentive was used in 2/3 of surveys, $20 in 4 surveys, ≥$25 in 2 surveys; surveys with larger incentive amounts were also longer surveys. RRs were somewhat higher with $10 versus ≥$20 incentives (23% [SD=6], 20% [SD=11] respectively). Season of administration was correlated with RR. Participants returned surveys administered in summer at the highest rate (RR=24%); RRs for spring administration were lowest (21%). Survey length was correlated with RR. RRs were consistently higher for shorter (8-9 page) surveys (33%) and were below average for the longest surveys (21%, ≥18 pages). Participants with chronic conditions were more likely to respond (RR=23% [SD=7] compared to 21% [SD=4] for acute conditions). Variation in RR was seen by season of survey administration, length, and incentive strategy. Incentive strategies, both type and amount, remain important considerations, as does respondent burden, with lower RRs for acute conditions and longer surveys.

Effects of Sequential Prepaid Incentives and Envelope Messaging in Mail Surveys

As researchers increasingly use mail survey methods to collect health and other data, research focused on optimizing features of survey design and administration in cost-effective ways is needed. We conducted two studies to examine the effects of sequential prepaid incentives and envelope messaging on response rates, item nonresponse, and costs in two mail surveys using address-based samples. Sample members in study 1 were randomly assigned to groups that received a preincentive of $2 versus $5, a second incentive of $0 versus $2 (sent only to nonresponders), and an envelope bearing no message or a monetary-focused message. Results indicated that the $5 preincentive significantly increased response rates, but neither the second incentive nor the message had an effect. Informed by the results of study 1, study 2 delivered a $2 preincentive to all sample members, but increased the amount of the second incentive to $5. Study 2 also tested a health-focused envelope message. While envelope messaging again failed to motivate participation, the administration of a second incentive, valued at a larger amount than the preincentive, significantly increased response rates. With regard to their effects on item nonresponse, while none of the variables was associated with item-missing levels in study 2, a significant three-way interaction was found in study 1 such that missing data was higher in the presence of a monetary message when a $2 preincentive was paired with a $2 second incentive. Cost analyses indicated that while larger incentives increased response rates, they also increased costs

Completion rates and non-response error in online surveys: Comparing sweepstakes and pre-paid cash incentives in studies of online behavior

This study aims to compare the effects of incentives and contact modes on survey completion rates, and examine how non-response rates might affect the quality of responses in online surveys. Two online surveys with different incentives and contact modes were conducted. In study 1, both pre-paid cash incentives and a sweepstakes offering of equal monetary value were more effective than no incentive but the pre-paid incentive were more effective than the sweepstakes. In study 2, respondents who received a pre-paid cash incentive via postal mail after initially failing to respond to an emailed sweepstakes offer differed from the initial respondents with respect to demographic and psychological characteristics previously found to be important in a widely cited study of social networking. Therefore, non-response error may indeed be a problem in online surveys, at least among those directed to college students and using a common method of recruitment in which offers of sweepstakes drawings are delivered via email. Not only do the levels of variables important to an understanding of online communication vary by survey method, but also the lawful relationships among variables differ between groups recruited by different methods.

Using population screening for recruitment of young adults engaged in illicit drug use: Methodological issues and sampling outcomes

Social stigma, legal sanctions and the associated lack of sampling frames create barriers to the probabilistic sampling of those engaged in a variety of behaviour, including illicit drug use. We used a novel sampling approach to recruit respondents into a longitudinal study examining amphetamine-type stimulant use. A young adult population was screened for lifetime drug use to create a sampling frame of amphetamine-type stimulant users and non-users. We posted 12,118 screening questionnaires to a random selection of young adults listed on the electoral roll for Brisbane and the Gold Coast, Australia (N=107,275). Using a small pre-paid incentive and intensive telephone and postal reminders we attained a screening response rate of 49.9%. Eligible amphetamine-type stimulant users (used ecstasy or methamphetamine⩾3 times in past 12months) and non-users (never used ecstasy or methamphetamine) were identified by screening responses. About two-thirds of each selected group took part in the longitudinal study. Comparisons with large-scale population survey data suggest the sample was broadly representative of young adult amphetamine-type stimulant users in Australia.

Examining the Gender Effects of Different Incentive Amounts in a Web Survey

Researchers are struggling to determine effective methods to improve response rates to web surveys. This study presents the results of an experiment that varied the disbursement of an incentive in a web survey. Participants were randomly assigned to receive either a $5 or a $10 prepaid incentive. In line with the social exchange theory of survey participation, no significant differences were found in response rate between the two conditions. However, the incentive amount interacted with gender. Specifically, women were more likely to respond to the survey when provided with a $5 incentive compared to a $10 incentive.

Surveying the General Public over the Internet Using Address-Based Sampling and Mail Contact Procedures

We report results from two statewide experiments in Washington designed to test potential methods for using postal mail to obtain survey responses over the Internet from address-based samples of general public households. The five methods we test are: 1) sending Web and mail modes of response sequentially; 2) providing a prepaid $5 incentive; 3) offering an instruction card for responding over the Web; 4) sending the follow-up request by Priority Mail; and 5) providing an additional $5 incentive with this follow-up request. Results are evaluated from the standpoint of response rates, demographic representativeness of respondents, and survey costs and data collection times for Web and mail modes. We find that a “Web-plus-mail” design—mailing an initial Web request followed by a mail request—with the prepaid incentive offers much potential for obtaining Internet responses. In addition, the mail follow-up to the initial Web request significantly increases overall response rates and improves respondent representativeness. However, the results also show that a mail-only design consistently obtains higher response rates and a demographically similar sample compared to Web-plus-mail. We also find significant challenges in obtaining a representative sample of respondents with either Web or mail modes and in realizing the potential cost and speed benefits of the Internet in using postal mail contacts.

Whose money is it anyway? Using prepaid incentives in experimental economics to create a natural environment

Simulating a real world environment is of utmost importance for achieving accurate and meaningful results in experimental economics. Offering monetary incentives is a common method of creating this environment. In general, experimenters provide the rewards at the time of experiment. In this paper, we argue that receiving the reward at the time of the experiment may lead participants to make decisions as if the money they are using were not their own. To solve this problem, we devised a “prepaid mechanism” that encourages participants to use the money as if it were their own.

Lessons Learned From Using An Ill-Conceived Nonmonetary, Prepaid Incentive In A Self-Administered Survey Of College Students

An experiment was conducted to determine how effective a prepaid, nonmonetary incentive would be at inducing college students to participate in a self-administered survey. The experiment was conducted on two college campuses in Los Angeles County. As students exited their campus library, an interviewer approached them for an interview. Half of those approached were offered a prepaid, nonmonetary incentive; the other half were not. Contrary to expectations, the prepaid, nonmonetary incentive dampened the response rate to the survey. Explanations are offered as to why the incentive was counterproductive.

Effects of different Incentives on Attrition and Fieldwork Effort in Telephone Household Panel Surveys

Little is known about sample behavior and fieldwork e ects of di erent incentives introduced in a household panel survey. This is especially true for telephone surveys. In a randomized experiment, the Swiss Household Panel implemented one prepaid and two promised nonmonetary incentives in the range of 10 to 15 Swiss Francs (7-10 e), plus a no incentive control group. The aim of the paper is to compare e ects of these incentives especially on cooperation, but also on sample selection and fieldwork e ort, separated by the household and the subsequent individual level. We find small positive cooperation e ects of the prepaid incentive on both the household and the individual level especially in larger households. Sample composition is a ected to a very minor extent. Finally, incentives tend to save fieldwork time and partially the number of contacts needed on the individual level.

Testing Prepaid Incentives and a Mail Questionnaire to Increase Response in a Multi-Wave Telephone Survey

Testing Prepaid Incentives and a Mail Questionnaire to Increase Response in a Multi-Wave Telephone Survey

Using Debit Cards for Incentive Payments: Experiences of a Weekly Survey Study

The effectiveness of incentives is well-documented in the literature (e.g., Church 1993; Singer 2002). Cash incentives are both cost-effective and easy to deliver in face-to-face surveys, or as prepaid incentives enclosed with advance letters. For larger amounts—typically used with conditional incentives—checks are often used. The cost of processing and mailing a check can be relatively expensive, especially for small incentive amounts delivered frequently. In online panels, the use of lotteries or rewards points is common, in part because of the cost of delivering repeated incentives of small value (Goritz 2006). Unfortunately these incentives are often less effective than cash. We describe an alternative approach to incentive delivery, using automated prepaid debit cards or cash gift cards, in the context of a weekly survey with small incentive payments. While ATM or debit cards have previously been used for one-time payment of incentives (e.g., Beckler and Ott 2006; McGrath 2006) and convenience store debit cards have been used for repeated incentive payments among volunteers (Wiebe et al. 2008), we are aware of no other studies that have used this approach for repeated delivery of small incentive amounts in a survey setting. This approach has several important advantages, including reducing the cost of incentive delivery, reducing the administrative costs associated with the need to reconcile cash payments, the automation of the delivery process, and the ability to track card use.

An Experimental Test of a Strategy to Maintain Contact with Families Between Waves of a Panel Study

Keeping track of sample persons between waves of data collection helps minimize attrition in longitudinal studies. All things being equal, the longer the time between data collection waves, the greater the likelihood that sample persons have moved, and the greater the difficulty in locating movers (Couper and Ofstedal 2007; Duncan and Kalton 1987). In 1997, the Panel Study of Income Dynamics (PSID) changed from annual to biennial interviewing. To capture residential changes between waves, PSID began sending families a “contact information update” mailing in the year between data collection waves. Families who update or verify the address and telephone information and return it receive a $10 post-paid check. About half the families responded to this mailing in recent waves. During 2007, families providing this information needed far less tracking or refusal conversion efforts, and half as many contacts to be interviewed, underscoring the cost effectiveness of the mailing. Given these advantages, we designed a study before 2009 production interviewing to improve the response rate of the contact update mailing. Families were randomly assigned to the following conditions: $10 as a pre-versus post-paid incentive, mailing design (traditional versus updated), being sent a study newsletter, and timing and frequency of the mailing (July versus October versus both times). This paper reports on initial findings with regard to response rates to the mailing by these different conditions. Overall, there is no effect of incentive type implying that post-paid incentives are more cost effective. Traditional design performs better than updated design. Families receiving a second mailing have higher response rates than those receiving one mailing. There are some interaction effects with timing-of-mailing, with October-only families having higher response rates when also receiving a prepaid incentive and newsletter. Hypotheses for these findings and next steps for analysis are described.

The Costs of Using Pre-Paid Incentives in a Physician Survey

The use of pre-paid monetary incentives in surveys of respondents with specialized knowledge, such as business executives and physicians, has been shown to help reduce overall survey administration costs. Current research suggests that by offering a cash incentive to respondents at the outset of data collection, survey managers may reduce the need for follow-up efforts. This paper uses the results of a survey of office-based physicians in the United States to put a finer point to another, perhaps overlooked component of this “cost saving.” Respondents and non-respondents alike often choose not to cash the checks. Almost all sample members who decline to complete a survey forego cashing the incentive check. About 1/3 of the physicians who responded, also did not cash their checks. This paper addresses two questions. The first question is: to what extent are pre-paid cash incentives misdirected to sample members who cash the check, but do not respond to the survey? A secondary question is: which physician specialties accept pre-paid monetary incentive? The answers to these questions have practical value. Survey managers need to anticipate the extent to which their funds (pre-paid incentives) will be misdirected to non-cooperating or ineligible sample members. Similarly, having a foundation on which to anticipate this risk can inform the proposed price of service to clients. Since this project sampled a variety of medical specialties, the results allow one to anticipate need for funds with some granularity, in that the results allow us to identify which medical specialties were most inclined to cash checks.

Incentives and Ethnic Minorities: Results of a Controlled Randomized Experiment in the Netherlands

In this article we examine the e ect of prepaid incentives on ethnic minority cooperation rates in the Netherlands. We find that the incentives do have a substantial positive e ect on the cooperation rates of native Dutch sampled units and Western foreigners. This e ect is only modest among non-Western foreigners. We also match ethnic minorities with native Dutch sampled units using propensity score matching to compare the e ect of incentives on the cooperation rates of ethnic minorities and comparable native Dutch sampled units. We find that the increase in cooperation rates is larger on the part of the native Dutch than ethnic minorities.

Impact of Prepaid Incentives in Face-to-Face Surveys: A Large-Scale Experiment with Postage Stamps

Nonresponse is a general problem in survey research. Although response rates and the nonresponse trends differ between countries, the general trend is that response rates have been declining over the years (De Leeuw & De Heer, 2002). A high nonresponse rate is a problem as it reduces the number of respondents and consequently the precision of estimates. In addition, nonresponse can be selective. This occurs when nonrespondents differ systematically from respondents as to the survey objectives. As a result, the survey estimates of the key indicators may be biased. Nonresponse is not only a statistical problem, but it is also a financial problem as declining response rates cause increasing survey costs. In the nineties, a response rate of 55 percent in face-to-face surveys conducted by Statistics Netherlands was not unusual (De Heer, 1999). Due to a substantial reorganization of the fieldwork department and the raise of the minimum number of contact efforts from three to six, the response in Statistics Netherlands’ face-to-face surveys gradually increased to 65 percent in 2005 (De Bie & Luiten, 2005). In order to realize a further increase in the response rate, we decided to focus on the refusals. As Statistics Netherlands does not use a refusal conversion policy—which is a common practice in many other fieldwork organizations, including National Statistical Institutes—we had to consider other measures. One option was the use of incentives. Prepaid cash incentives are known to be most effective, but sending cash by mail is not allowed in the Netherlands. Therefore, postage stamps are chosen as a prepaid incentive, which are expected to be an opportunity to bridge the gap between cash and material incentives. In this article, the effect of stamps as a prepaid incentive in face-to-face surveys on response is tested in a large-scale field experiment embedded in the Dutch Labor Force Survey.