IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2024-23.html
   My bibliography  Save this paper

Does it Pay to Send Multiple Pre-Paid Incentives? Evidence from a Randomized Experiment

Author

Abstract

To encourage survey participation and improve sample representativeness, the Survey of Consumer Finances (SCF) offers an unconditional pre-paid monetary incentive and separate post-paid incentive upon survey completion. We conducted a pre-registered between-subject randomized control experiment within the 2022 SCF, with at least 1,200 households per experimental group, to examine whether changing the pre-paid incentive structure affects survey outcomes. We assess the effects of: (1) altering the total dollar value of the pre-paid incentive (“incentive effect”), (2) giving two identical pre-paid incentives holding the total dollar value fixed (“reminder effect”), and (3) offering multiple pre-paid incentives of different amounts holding the total dollar value fixed (“slope effect”) on survey response rates, interviewer burden, and data quality. Our evidence indicates that a single $15 pre-paid incentive increases response rates and maintains similar levels of interviewer burden and data quality, relative to a single $5 pre-paid incentive. Splitting the $15 into two pre-paid incentives of different amounts increases interviewer burden though lengthening time in the field without improving response rates, reducing the number of contact attempts needed for a response, or improving data quality, regardless of whether the first pre-paid is larger or smaller than the second.

Suggested Citation

  • Kate Bachtell & Andrew C. Chang & Joanne W. Hsu & Eva Ma & Micah Sjoblom, 2024. "Does it Pay to Send Multiple Pre-Paid Incentives? Evidence from a Randomized Experiment," Finance and Economics Discussion Series 2024-023, Board of Governors of the Federal Reserve System (U.S.).
  • Handle: RePEc:fip:fedgfe:2024-23
    DOI: 10.17016/FEDS.2024.023
    Note: CORRECT ORDER OF AUTHORS: Andrew C. Chang, Joanne W. Hsu, Eva Ma, Kate Bachtell, and Micah Sjoblom.
    as

    Download full text from publisher

    File URL: https://www.federalreserve.gov/econres/feds/files/2024023pap.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.17016/FEDS.2024.023?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alvaredo, Facundo & Bourguignon, François & Ferreira, Francisco H. G. & Lustig, Nora, 2023. "Seventy-five years of measuring income inequality in Latin America," LSE Research Online Documents on Economics 120557, London School of Economics and Political Science, LSE Library.
    2. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    3. Bradley Hardy & Timothy Smeeding & James P. Ziliak, 2018. "The Changing Safety Net for Low-Income Parents and Their Children: Structural or Cyclical Changes in Income Support Policy?," Demography, Springer;Population Association of America (PAA), vol. 55(1), pages 189-221, February.
    4. Deniz Dutz & Ingrid Huitfeldt & Santiago Lacouture & Magne Mogstad & Alexander Torgovitsky & Winnie van Dijk, 2021. "Selection in Surveys," NBER Working Papers 29549, National Bureau of Economic Research, Inc.
      • Deniz Dutz & Ingrid Huitfeldt & Santiago Lacouture & Magne Mogstad & Alexander Torgovitsky & Winnie van Dijk, 2021. "Selection in Surveys," Discussion Papers 971, Statistics Norway, Research Department.
    5. Bruce D. Meyer & Derek Wu & Victoria R. Mooers & Carla Medalia, 2019. "The use and misuse of income data and extreme poverty in the United States," AEI Economics Working Papers 1018925, American Enterprise Institute.
    6. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    7. Robert Moffitt & John Karl Scholz, 2010. "Trends in the Level and Distribution of Income Support," NBER Chapters, in: Tax Policy and the Economy, Volume 24, pages 111-152, National Bureau of Economic Research, Inc.
    8. Adrian Chadi, 2019. "Dissatisfied with life or with being interviewed? Happiness and the motivation to participate in a survey," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(3), pages 519-553, October.
    9. Tuttle, Charlotte, 2016. "The Stimulus Act of 2009 and Its Effect on Food-At-Home Spending by SNAP Participants," Economic Research Report 262193, United States Department of Agriculture, Economic Research Service.
    10. Francisco Parro & Loreto Reyes, 2017. "The rise and fall of income inequality in Chile," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 26(1), pages 1-31, December.
    11. Robert Collinson & John Eric Humphries & Nicholas Mader & Davin Reed & Daniel Tannenbaum & Winnie van Dijk, 2024. "Eviction and Poverty in American Cities," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 57-120.
    12. Ha Trong Nguyen & Huong Thu Le & Luke B Connelly, 2021. "Who's declining the “free lunch”? New evidence from the uptake of public child dental benefits," Health Economics, John Wiley & Sons, Ltd., vol. 30(2), pages 270-288, February.
    13. Mark Colas & Dominik Sachs, 2024. "The Indirect Fiscal Benefits of Low-Skilled Immigration," American Economic Journal: Economic Policy, American Economic Association, vol. 16(2), pages 515-550, May.
    14. Marianne Bitler & Jason Cook & Danea Horn & Nathan Seegert, 2022. "Incomplete program take-up during a crisis: evidence from the COVID-19 shock in one U.S. state," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 29(6), pages 1373-1394, December.
    15. Borgschulte, Mark & Cho, Heepyung & Lubotsky, Darren, 2022. "Partisanship and survey refusal," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 332-357.
    16. Jones, Jordan & Courtemanche, Charles & Denteh, Augustine & Marton, James & Tchernis, Rusty, 2021. "Do State Snap Policies Influence Program Participation among Seniors?," IZA Discussion Papers 14564, Institute of Labor Economics (IZA).
    17. Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2016. "Heterogeneity in Returns to Wealth and the Measurement of Wealth Inequality," American Economic Review, American Economic Association, vol. 106(5), pages 651-655, May.
    18. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    19. Colas, Mark & Sachs, Dominik, 2022. "The Indirect Fiscal Benefits of Low-Skilled Immigration," Rationality and Competition Discussion Paper Series 352, CRC TRR 190 Rationality and Competition.
    20. Liu, Xueyue & Zuo, Sharon Xuejing, 2023. "From equality to polarization: Changes in urban China’s gender earnings gap from 1988 to 2016," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 303-337.

    More about this item

    Keywords

    Pre-paid incentives; Unconditional incentives; Sequential incentives; Response rates; Surveys; Data quality; Household finance;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • G50 - Financial Economics - - Household Finance - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2024-23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.