IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i6d10.1007_s11135-022-01594-4.html
   My bibliography  Save this article

Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021

Author

Listed:
  • Achim Goerres

    (University of Duisburg-Essen)

  • Jan Karem Höhne

    (University of Duisburg-Essen)

Abstract

This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents’ response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.

Suggested Citation

  • Achim Goerres & Jan Karem Höhne, 2023. "Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(6), pages 5431-5447, December.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:6:d:10.1007_s11135-022-01594-4
    DOI: 10.1007/s11135-022-01594-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01594-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01594-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:oup:ecpoli:v:16:y:2001:i:32:p:7-50 is not listed on IDEAS
    2. repec:bla:ecpoli:v:16:y:2001:i:32:p:7-50 is not listed on IDEAS
    3. Tito Boeri & Axel Börsch-Supan & Guido Tabellini, 2001. "Would you like to shrink the welfare state? A survey of European citizens," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 16(32), pages 08-50.
    4. Mick P. Couper & Frauke Kreuter, 2013. "Using paradata to explore item level response times in surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 271-286, January.
    5. Anna DeCastellarnau, 2018. "A classification of response scale characteristics that affect data quality: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1523-1559, July.
    6. Achim Goerres & Katrin Prinzen, 2012. "Can We Improve the Measurement of Attitudes Towards the Welfare State? A Constructive Critique of Survey Instruments with Evidence from Focus Groups," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 515-534, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simon G�chter & Arno Riedl, "undated". "Moral Property Rights in Bargaining," IEW - Working Papers 113, Institute for Empirical Research in Economics - University of Zurich.
    2. Robert MacCulloch & Silvia Pezzini, 2010. "The Roles of Freedom, Growth, and Religion in the Taste for Revolution," Journal of Law and Economics, University of Chicago Press, vol. 53(2), pages 329-358, May.
    3. Niculaescu, Corina E. & Sangiorgi, Ivan & Bell, Adrian R., 2023. "Does personal experience with COVID-19 impact investment decisions? Evidence from a survey of US retail investors," International Review of Financial Analysis, Elsevier, vol. 88(C).
    4. repec:zbw:rwirep:0557 is not listed on IDEAS
    5. Axel Börsch‐Supan & Alexander Ludwig & Joachim Winter, 2006. "Ageing, Pension Reform and Capital Flows: A Multi‐Country Simulation Model," Economica, London School of Economics and Political Science, vol. 73(292), pages 625-658, November.
    6. Luciano Fanti & Luca Gori, 2012. "Fertility and PAYG pensions in the overlapping generations model," Journal of Population Economics, Springer;European Society for Population Economics, vol. 25(3), pages 955-961, July.
    7. Kemmerling, Achim & Bruttel, Oliver, 2005. "New politics in German labour market policy? The implications of the recent Hartz reforms for the German welfare state," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2005-101, WZB Berlin Social Science Center.
    8. S. Brent Jackson & Kathryn T. Stevenson & Lincoln R. Larson & M. Nils Peterson & Erin Seekamp, 2021. "Outdoor Activity Participation Improves Adolescents’ Mental Health and Well-Being during the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(5), pages 1-18, March.
    9. Jon Roozenbeek & Stefan M. Herzog & Michael Geers & Ralf Kurvers & Mubashir Sultan & Sander van der Linden, 2022. "Susceptibility to misinformation is consistent across question framings and response modes and better explained by myside bias and partisanship than analytical thinking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 17(3), pages 547-573, May.
    10. Felderer, Barbara & Repke, Lydia & Weber, Wiebke & Schweisthal, jonas & Bothmann, Ludwig, 2024. "Predicting the Validity and Reliability of Survey Questions," OSF Preprints hkngd, Center for Open Science.
    11. Tito Boeri & J. Ignacio Conde-Ruiz & Vincenzo Galasso, "undated". "Cross-skill Redistribution and the Tradeoff between Unemployment Benefits and Employment Protection," Working Papers 2004-26, FEDEA.
    12. Monika Bütler, 2002. "The Political Feasibility of Increasing the Retirement Age: Lessons from a Ballot on the Female Retirement Age," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 9(4), pages 349-365, August.
    13. Rafael Di Tella & Robert J. MacCulloch & Andrew J. Oswald, 2003. "The Macroeconomics of Happiness," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 809-827, November.
    14. Andrew Clark & Fabien Postel-Vinay, 2009. "Job security and job protection," Oxford Economic Papers, Oxford University Press, vol. 61(2), pages 207-239, April.
    15. Hayo, Bernd & Ono, Hiroyuki, 2010. "Comparing public attitudes toward providing for the livelihood of the elderly in two aging societies: Germany and Japan," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 72-80, January.
    16. Maite D. Laméris & Richard Jong-A-Pin & Rasmus Wiese, 2018. "An Experimental Test of the Validity of Survey-Measured Political Ideology," CESifo Working Paper Series 7139, CESifo.
    17. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.
    18. Busemeyer, Marius R. & Cattaneo, Maria Alejandra & Wolter, Stefan C., 2010. "Individual policy preferences for vocational versus academic education micro level evidence for the case of Switzerland," MPIfG Discussion Paper 10/11, Max Planck Institute for the Study of Societies.
    19. Börsch-Supan, Axel & Reil-Held, Anette & Wilke, Christina Benita, 2007. "How an Unfunded Pension System looks like Defined Benefits but works like Defined Contributions: The German Pension Reform," MEA discussion paper series 07126, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    20. Helmuth Cremer & Jean‐Marie Lozachmeur & Pierre Pestieau, 2008. "Social Security And Retirement Decision: A Positive And Normative Approach," Journal of Economic Surveys, Wiley Blackwell, vol. 22(2), pages 213-233, April.
    21. Bottazzi, Renata & Jappelli, Tullio & Padula, Mario, 2006. "Retirement expectations, pension reforms, and their impact on private wealth accumulation," Journal of Public Economics, Elsevier, vol. 90(12), pages 2187-2212, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:6:d:10.1007_s11135-022-01594-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.