IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v59y2025i1d10.1007_s11135-024-01993-9.html
   My bibliography  Save this article

Survey response rates in European comparative surveys: a 20-year decline irrespective of sampling frames or survey modes

Author

Listed:
  • Piotr Jabkowski

    (Adam Mickiewicz University)

  • Piotr Cichocki

    (Adam Mickiewicz University)

Abstract

This paper assesses trends in three survey outcome rates within four prominent crossnationalcomparative surveys conducted in European countries in the 21st century: theEuropean Quality of Life Survey, the European Social Survey, the European ValuesStudy, and the International Social Survey Programme. These projects are recognisedfor their high-quality sampling and fieldwork procedures, extensive track records, andcommitment to rigorous methodological standards. The analysis is based on 753national surveys conducted on probability samples of the general population in 36European countries from 1999 to 2018. We investigated whether two essential surveycharacteristics, namely sampling frames and data collection modes, moderated thedecrease of survey outcome rates over time. To analyse these relationships, thesurvey year was included as the explanatory variable, and we applied multi-level linearregressions with surveys nested within countries. Additionally, the project name wasincorporated as a fixed factor, and the sampling frame and mode of data collectionwere control variables for the effect of time. Our study provides valuable insights intothe challenges of conducting high-quality Pan-European cross-national comparativesurveys over nearly two decades. We observed a consistent decline in survey outcomerates, irrespective of country or project. Neither the sampling frame nor the datacollection mode moderated this decline. Hence, even though personal register samplesand Face-to-Face interviews are often regarded as enhancements to overall surveyquality, their application does not effectively counter the factors causing a decline insurvey outcome rates.

Suggested Citation

  • Piotr Jabkowski & Piotr Cichocki, 2025. "Survey response rates in European comparative surveys: a 20-year decline irrespective of sampling frames or survey modes," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(1), pages 635-655, February.
    • Handle: RePEc:spr:qualqt:v:59:y:2025:i:1:d:10.1007_s11135-024-01993-9
    DOI: 10.1007/s11135-024-01993-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-024-01993-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-024-01993-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pforr, Klaus & Blohm, Michael & Blom, Annelies G. & Erdel, Barbara & Felderer, Barbara & Fräßdorf, Mathis & Hajek, Kristin & Helmschrott, Susanne & Kleinert, Corinna & Koch, Achim & Krieger, Ulrich & , 2015. "Are Incentive Effects on Response Rates and Nonresponse Bias in Large-scale, Face-to-face Surveys Generalizable to Germany? Evidence from Ten Experiments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 79(3), pages 740-768.
    2. Patrick Bonnel & Michel Le Nir, 1998. "The quality of survey data: Telephone versus face-to-face interviews," Post-Print halshs-00140887, HAL.
    3. Atkeson, Lonna Rae & Adams, Alex N. & Alvarez, R. Michael, 2014. "Nonresponse and Mode Effects in Self- and Interviewer-Administered Surveys," Political Analysis, Cambridge University Press, vol. 22(3), pages 304-320, July.
    4. Brendan Burchell & Catherine Marsh, 1992. "The effect of questionnaire length on survey response," Quality & Quantity: International Journal of Methodology, Springer, vol. 26(3), pages 233-244, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philip S. Brenner, 2021. "Effects of Nonresponse, Measurement, and Coverage Bias in Survey Estimates of Voting," Social Science Quarterly, Southwestern Social Science Association, vol. 102(2), pages 939-954, March.
    2. Guang Yang & Yan Han & Hao Gong & Tiantian Zhang, 2020. "Spatial-Temporal Response Patterns of Tourist Flow under Real-Time Tourist Flow Diversion Scheme," Sustainability, MDPI, vol. 12(8), pages 1-28, April.
    3. Henk Roose & John Lievens & Hans Waege, 2007. "The Joint Effect of Topic Interest and Follow-Up Procedures on the Response in a Mail Questionnaire," Sociological Methods & Research, , vol. 35(3), pages 410-428, February.
    4. Caroline Bayart & Patrick Bonnel, 2012. "Combining web and face-to-face in travel surveys: comparability challenges?," Transportation, Springer, vol. 39(6), pages 1147-1171, November.
    5. Hans Fricke & Markus Frölich & Martin Huber & Michael Lechner, 2020. "Endogeneity and non‐response bias in treatment evaluation – nonparametric identification of causal effects by instruments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 481-504, August.
    6. Altmann Kristina & Bernard René & Le Blanc Julia & Gabor-Toth Enikö & Hebbat Malik & Kothmayr Lisa & Schmidt Tobias & Tzamourani Panagiota & Werner Daniel & Zhu Junyi, 2020. "The Panel on Household Finances (PHF) – Microdata on household wealth in Germany," German Economic Review, De Gruyter, vol. 21(3), pages 373-400, September.
    7. Almut Schumann & Detlev Lück, 2023. "Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 48(22), pages 609-640.
    8. Tobias Gummer, 2019. "Assessing Trends and Decomposing Change in Nonresponse Bias: The Case of Bias in Cohort Distributions," Sociological Methods & Research, , vol. 48(1), pages 92-115, February.
    9. Martin Huber & Anna Solovyeva, 2020. "Direct and Indirect Effects under Sample Selection and Outcome Attrition," Econometrics, MDPI, vol. 8(4), pages 1-25, December.
    10. Guy Stecklov & Alexander Weinreb & Calogero Carletto, 2018. "Can incentives improve survey data quality in developing countries?: results from a field experiment in India," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 1033-1056, October.
    11. Ane Kirstine Aare & Hanne Cooreman & Cristina Virto Garayoa & Esther Sótil Arrieta & Natalia Bellostas & Fleur Marchand & Henrik Hauggaard-Nielsen, 2020. "Methodological Reflections on Monitoring Interactive Knowledge Creation during Farming Demonstrations by Means of Surveys and Observations," Sustainability, MDPI, vol. 12(14), pages 1-26, July.
    12. Caroline Bayart & Patrick Bonnel, 2010. "L'impact du mode d'enquête sur la mesure des comportements de mobilité," Économie et Statistique, Programme National Persée, vol. 437(1), pages 47-70.
    13. Pirmin Fessler & Maximilian Kasy & Peter Lindner, 2018. "Survey mode effects on measured income inequality," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 16(4), pages 487-505, December.
    14. Jan Eckhard, 2018. "Indicators of Social Isolation: A Comparison Based on Survey Data from Germany," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 963-988, October.
    15. Pushkin Kachroo & Sheen Kachen, 2018. "Item placement for questionnaire design for optimal reliability," Journal of Marketing Analytics, Palgrave Macmillan, vol. 6(4), pages 120-126, December.
    16. Miroshnychenko, Ivan & Strobl, Andreas & Matzler, Kurt & De Massis, Alfredo, 2021. "Absorptive capacity, strategic flexibility, and business model innovation: Empirical evidence from Italian SMEs," Journal of Business Research, Elsevier, vol. 130(C), pages 670-682.
    17. Steven J. Tepper, 1998. "Making Sense of the Numbers: Estimating Arts Participation in America," Working Papers 57, Princeton University, School of Public and International Affairs, Center for Arts and Cultural Policy Studies..
    18. Gvantsa Sekhniashvili & Zoltán Bujdosó, 2023. "Developing a Wine Tourism Destination Image Measurement Scale," Sustainability, MDPI, vol. 15(11), pages 1-13, May.
    19. Naomi Moy & Ho Fai Chan & Benno Torgler, 2018. "How much is too much? The effects of information quantity on crowdfunding performance," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    20. Lonna Rae Atkeson & R. Michael Alvarez & Thad E. Hall & J. Andrew Sinclair, 2014. "Balancing Fraud Prevention and Electoral Participation: Attitudes Toward Voter Identification," Social Science Quarterly, Southwestern Social Science Association, vol. 95(5), pages 1381-1398, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:59:y:2025:i:1:d:10.1007_s11135-024-01993-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.