IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p981-1003.html
   My bibliography  Save this article

Do previous survey experience and participating due to an incentive affect response quality? Evidence from the CRONOS panel

Author

Listed:
  • Hannah Schwarz
  • Melanie Revilla
  • Bella Struminskaya

Abstract

As ever more surveys are conducted, recruited respondents are more likely to already have previous survey experience. Furthermore, it has become more difficult to convince individuals to participate in surveys, and thus, incentives are increasingly used. Both previous survey experience and participation in surveys due to incentives have been discussed in terms of their links with response quality. This study aims to assess whether previous web survey experience and survey participation due to incentives are linked with three indicators of response quality: item non‐response, primacy effect and non‐differentiation. Analysing data of the probability‐based CROss‐National Online Survey panel covering Estonia, Slovenia and Great Britain, we found that previous web survey experience is not associated with item non‐response and the occurrence of a primacy effect but is associated with non‐differentiation. Participating due to the incentive is not associated with any of the three response quality indicators assessed. Hence, overall, we find little evidence that response quality is linked with either previous web survey experience or participating due to the incentive.

Suggested Citation

  • Hannah Schwarz & Melanie Revilla & Bella Struminskaya, 2022. "Do previous survey experience and participating due to an incentive affect response quality? Evidence from the CRONOS panel," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 981-1003, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:981-1003
    DOI: 10.1111/rssa.12857
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12857
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12857?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Eleanor Singer & Cong Ye, 2013. "The Use and Effects of Incentives in Surveys," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 112-141, January.
    2. Andrew Halpern-Manners & John Warren, 2012. "Panel Conditioning in Longitudinal Studies: Evidence From Labor Force Items in the Current Population Survey," Demography, Springer;Population Association of America (PAA), vol. 49(4), pages 1499-1519, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haifeng Zhao & Nosherwan Khaliq & Chunling Li & Judit Oláh, 2024. "In quest of perceived transaction cost’s impact on fintech users’ intention: the moderating role of situational factors," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    2. Hie Joo Ahn & James Hamilton, 2022. "Measuring Labor-Force Participation and the Incidence and Duration of Unemployment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 1-32, April.
    3. repec:lic:licosd:37516 is not listed on IDEAS
    4. Jing Peng & Christophe Van den Bulte, 2024. "Participation vs. Effectiveness in Sponsored Tweet Campaigns: A Quality-Quantity Conundrum," Management Science, INFORMS, vol. 70(11), pages 7961-7983, November.
    5. Tuyen Thanh Nguyen & John R. Baker & Thao Quang Le, 2024. "A Partial Least Squares Structural Equation Modeling Exploration of EFL Learners’ Perceptions of What Contributes to the Readability of Model Paragraphs," SAGE Open, , vol. 14(2), pages 21582440231, April.
    6. Bürgel, Tobias R. & Hiebl, Martin R.W. & Pielsticker, David I., 2023. "Digitalization and entrepreneurial firms' resilience to pandemic crises: Evidence from COVID-19 and the German Mittelstand," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).
    7. Bach, Ruben L. & Eckman, Stephanie, 2017. "Does participating in a panel survey change respondents' labor market behavior?," IAB-Discussion Paper 201715, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    8. Bach, Ruben L. & Eckman, Stephanie, 2020. "Rotation group bias in reporting of household purchases in the U.S. Consumer Expenditure Survey," Economics Letters, Elsevier, vol. 187(C).
    9. Goerg, Sebastian & Pondorfer, Andreas & Stöhr, Valentina, 2025. "Public support for more ambitious climate policies: Empirical evidence from Germany," Ecological Economics, Elsevier, vol. 231(C).
    10. Valentina Castillo Cifuentes & Ana Ferrer & Mike Ronchka & Ilona Dougherty & Amelia Clarke & Sana Khaliq & Eki Okungbowa & Ian Korovinsky & Mishika Khurana, 2025. "Strategies for Increasing Youth Participation in Longitudinal Survey Research: Lessons from a Pilot Study," World, MDPI, vol. 6(2), pages 1-15, June.
    11. Chadi, Adrian, 2021. "Identification of attrition bias using different types of panel refreshments," Economics Letters, Elsevier, vol. 201(C).
    12. Ryan D. Edwards, 2018. "If My Blood Pressure Is High, Do I Take It to Heart? Behavioral Effects of Biomarker Collection in the Health and Retirement Study," Demography, Springer;Population Association of America (PAA), vol. 55(2), pages 403-434, April.
    13. Daniel Vujcich & Graham Brown & Jo Durham & Zhihong Gu & Lisa Hartley & Roanna Lobo & Limin Mao & Piergiorgio Moro & Vivienne Pillay & Amy B. Mullens & Enaam Oudih & Meagan Roberts & Caitlin Wilshin &, 2022. "Strategies for Recruiting Migrants to Participate in a Sexual Health Survey: Methods, Results, and Lessons," IJERPH, MDPI, vol. 19(19), pages 1-25, September.
    14. Georgarakos, Dimitris & Kenny, Geoff, 2022. "Household spending and fiscal support during the COVID-19 pandemic: Insights from a new consumer survey," Journal of Monetary Economics, Elsevier, vol. 129(S), pages 1-14.
    15. Svaboe, Gunnhild Beate Antonsen & Tørset, Trude & Lohne, Jardar, 2025. "Recruitment strategies in app-based travel surveys: Methodological explorations," Transportation Research Part A: Policy and Practice, Elsevier, vol. 196(C).
    16. Beatty, Timothy K.M. & Ritter, Joseph A., 2018. "Measuring the Health Cost of Prolonged Unemployment: Evidence from the Great Recession," Miscellaneous Publications 280435, University of Minnesota, Department of Applied Economics.
    17. Nadeem, Kashif & Wong, Sut I. & Za, Stefano & Venditti, Michelina, 2024. "Digital transformation and industry 4.0 employees: Empirical evidence from top digital nations," Technology in Society, Elsevier, vol. 76(C).
    18. Beatty, Timothy K.M. & Ritter, Joseph A., 2018. "Measuring the Health Cost of Prolonged Unemployment: Evidence from the Great Recession," Staff Papers 280435, University of Minnesota, Department of Applied Economics.
    19. Rolf Becker, 2025. "The effect of prepaid incentives on panelists’ response across survey modes in a sequential mixed-mode design," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(1), pages 29-49, February.
    20. Tobias Gummer & Pablo Christmann & Sascha Verhoeven & Christof Wolf, 2022. "Using a responsive survey design to innovate self‐administered mixed‐mode surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 916-932, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:981-1003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.