IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p981-1003.html
   My bibliography  Save this article

Do previous survey experience and participating due to an incentive affect response quality? Evidence from the CRONOS panel

Author

Listed:
  • Hannah Schwarz
  • Melanie Revilla
  • Bella Struminskaya

Abstract

As ever more surveys are conducted, recruited respondents are more likely to already have previous survey experience. Furthermore, it has become more difficult to convince individuals to participate in surveys, and thus, incentives are increasingly used. Both previous survey experience and participation in surveys due to incentives have been discussed in terms of their links with response quality. This study aims to assess whether previous web survey experience and survey participation due to incentives are linked with three indicators of response quality: item non‐response, primacy effect and non‐differentiation. Analysing data of the probability‐based CROss‐National Online Survey panel covering Estonia, Slovenia and Great Britain, we found that previous web survey experience is not associated with item non‐response and the occurrence of a primacy effect but is associated with non‐differentiation. Participating due to the incentive is not associated with any of the three response quality indicators assessed. Hence, overall, we find little evidence that response quality is linked with either previous web survey experience or participating due to the incentive.

Suggested Citation

  • Hannah Schwarz & Melanie Revilla & Bella Struminskaya, 2022. "Do previous survey experience and participating due to an incentive affect response quality? Evidence from the CRONOS panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 981-1003, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:981-1003
    DOI: 10.1111/rssa.12857
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12857
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12857?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew Halpern-Manners & John Warren, 2012. "Panel Conditioning in Longitudinal Studies: Evidence From Labor Force Items in the Current Population Survey," Demography, Springer;Population Association of America (PAA), vol. 49(4), pages 1499-1519, November.
    2. Eleanor Singer & Cong Ye, 2013. "The Use and Effects of Incentives in Surveys," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 112-141, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beatty, Timothy K.M. & Ritter, Joseph A., 2018. "Measuring the Health Cost of Prolonged Unemployment: Evidence from the Great Recession," Miscellaneous Publications 280435, University of Minnesota, Department of Applied Economics.
    2. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    3. Beatty, Timothy K.M. & Ritter, Joseph A., 2018. "Measuring the Health Cost of Prolonged Unemployment: Evidence from the Great Recession," Staff Papers 280435, University of Minnesota, Department of Applied Economics.
    4. Friedman,Jed & Beegle,Kathleen G. & De Weerdt,Joachim & Gibson,John, 2016. "Decomposing response errors in food consumption measurement : implications for survey design from a survey experiment in Tanzania," Policy Research Working Paper Series 7646, The World Bank.
    5. Bürgel, Tobias R. & Hiebl, Martin R.W. & Pielsticker, David I., 2023. "Digitalization and entrepreneurial firms' resilience to pandemic crises: Evidence from COVID-19 and the German Mittelstand," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).
    6. Tobias Gummer & Pablo Christmann & Sascha Verhoeven & Christof Wolf, 2022. "Using a responsive survey design to innovate self‐administered mixed‐mode surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 916-932, July.
    7. Friedman, Jed & Beegle, Kathleen & De Weerdt, Joachim & Gibson, John, 2017. "Decomposing response error in food consumption measurement: Implications for survey design from a randomized survey experiment in Tanzania," Food Policy, Elsevier, vol. 72(C), pages 94-111.
    8. Bach, Ruben L. & Eckman, Stephanie, 2017. "Does participating in a panel survey change respondents' labor market behavior?," IAB-Discussion Paper 201715, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    9. Chadi, Adrian, 2021. "Identification of attrition bias using different types of panel refreshments," Economics Letters, Elsevier, vol. 201(C).
    10. Bernhardt, Robert & Munro, David & Wolcott, Erin, 2021. "How Does the Dramatic Rise of CPS Non-Response Impact Labor Market Indicators?," GLO Discussion Paper Series 781, Global Labor Organization (GLO).
    11. Georgarakos, Dimitris & Kenny, Geoff, 2022. "Household spending and fiscal support during the COVID-19 pandemic: Insights from a new consumer survey," Journal of Monetary Economics, Elsevier, vol. 129(S), pages 1-14.
    12. Kim, Hyung Jin & Kim, Inchan & Lee, Hogeun, 2016. "Third-party mobile app developers’ continued participation in platform-centric ecosystems: An empirical investigation of two different mechanisms," International Journal of Information Management, Elsevier, vol. 36(1), pages 44-59.
    13. Bach, Ruben L. & Eckman, Stephanie, 2020. "Rotation group bias in reporting of household purchases in the U.S. Consumer Expenditure Survey," Economics Letters, Elsevier, vol. 187(C).
    14. Rolf Becker, 2022. "The effects of a special sequential mixed-mode design, and reminders, on panellists’ participation in a probability-based panel study," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(1), pages 259-284, February.
    15. Ryan D. Edwards, 2013. "If My Blood Pressure Is High, Do I Take It To Heart? Behavioral Impacts of Biomarker Collection in the Health and Retirement Study," NBER Working Papers 19311, National Bureau of Economic Research, Inc.
    16. Ward, Jason M. & Anne Edwards, Kathryn, 2021. "CPS Nonresponse During the COVID-19 Pandemic: Explanations, Extent, and Effects," Labour Economics, Elsevier, vol. 72(C).
    17. Zhou, Xizhen & Lv, Mengqi & Ji, Yanjie & Zhang, Shuichao & Liu, Yong, 2023. "Pricing curb parking: Differentiated parking fees or cash rewards?," Transport Policy, Elsevier, vol. 142(C), pages 46-58.
    18. Ryan D. Edwards, 2018. "If My Blood Pressure Is High, Do I Take It to Heart? Behavioral Effects of Biomarker Collection in the Health and Retirement Study," Demography, Springer;Population Association of America (PAA), vol. 55(2), pages 403-434, April.
    19. Daniel Vujcich & Graham Brown & Jo Durham & Zhihong Gu & Lisa Hartley & Roanna Lobo & Limin Mao & Piergiorgio Moro & Vivienne Pillay & Amy B. Mullens & Enaam Oudih & Meagan Roberts & Caitlin Wilshin &, 2022. "Strategies for Recruiting Migrants to Participate in a Sexual Health Survey: Methods, Results, and Lessons," IJERPH, MDPI, vol. 19(19), pages 1-25, September.
    20. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:981-1003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.