IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i6d10.1007_s11135-022-01594-4.html
   My bibliography  Save this article

Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021

Author

Listed:
  • Achim Goerres

    (University of Duisburg-Essen)

  • Jan Karem Höhne

    (University of Duisburg-Essen)

Abstract

This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for the development of improved rating scales, which we defined as five-point, end verbalized rating scales without non-substantive answer options. The overall results from an experimental online survey in Germany indicate differences in response effort in terms of response times but almost no differences in data quality in terms of criterion validity. Thus, the 16 survey measures show solid instrument validity as well as minor improvements in respondents’ response times. Indeed, the measures are (at least) in the online survey world of Germany of high-quality and warrant inclusion in future surveys with small efficiency gains still attainable.

Suggested Citation

  • Achim Goerres & Jan Karem Höhne, 2023. "Evaluating the response effort and data quality of established political solidarity measures: a pre-registered experimental test in an online survey of the German adult resident population in 2021," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(6), pages 5431-5447, December.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:6:d:10.1007_s11135-022-01594-4
    DOI: 10.1007/s11135-022-01594-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01594-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01594-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:bla:ecpoli:v:16:y:2001:i:32:p:7-50 is not listed on IDEAS
    2. Mick P. Couper & Frauke Kreuter, 2013. "Using paradata to explore item level response times in surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 271-286, January.
    3. repec:oup:ecpoli:v:16:y:2001:i:32:p:7-50 is not listed on IDEAS
    4. Anna DeCastellarnau, 2018. "A classification of response scale characteristics that affect data quality: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1523-1559, July.
    5. Achim Goerres & Katrin Prinzen, 2012. "Can We Improve the Measurement of Attitudes Towards the Welfare State? A Constructive Critique of Survey Instruments with Evidence from Focus Groups," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 515-534, December.
    6. Tito Boeri & Axel Börsch-Supan & Guido Tabellini, 2001. "Would you like to shrink the welfare state? A survey of European citizens," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 16(32), pages 08-50.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert MacCulloch & Silvia Pezzini, 2010. "The Roles of Freedom, Growth, and Religion in the Taste for Revolution," Journal of Law and Economics, University of Chicago Press, vol. 53(2), pages 329-358, May.
    2. Axel Börsch‐Supan & Alexander Ludwig & Joachim Winter, 2006. "Ageing, Pension Reform and Capital Flows: A Multi‐Country Simulation Model," Economica, London School of Economics and Political Science, vol. 73(292), pages 625-658, November.
    3. Luciano Fanti & Luca Gori, 2012. "Fertility and PAYG pensions in the overlapping generations model," Journal of Population Economics, Springer;European Society for Population Economics, vol. 25(3), pages 955-961, July.
    4. Felderer, Barbara & Repke, Lydia & Weber, Wiebke & Schweisthal, jonas & Bothmann, Ludwig, 2024. "Predicting the Validity and Reliability of Survey Questions," OSF Preprints hkngd, Center for Open Science.
    5. Monika Bütler, 2002. "The Political Feasibility of Increasing the Retirement Age: Lessons from a Ballot on the Female Retirement Age," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 9(4), pages 349-365, August.
    6. Rafael Di Tella & Robert J. MacCulloch & Andrew J. Oswald, 2003. "The Macroeconomics of Happiness," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 809-827, November.
    7. Hayo, Bernd & Ono, Hiroyuki, 2010. "Comparing public attitudes toward providing for the livelihood of the elderly in two aging societies: Germany and Japan," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 72-80, January.
    8. Maite D. Laméris & Richard Jong-A-Pin & Rasmus Wiese, 2018. "An Experimental Test of the Validity of Survey-Measured Political Ideology," CESifo Working Paper Series 7139, CESifo.
    9. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.
    10. Börsch-Supan, Axel & Reil-Held, Anette & Wilke, Christina Benita, 2007. "How an Unfunded Pension System looks like Defined Benefits but works like Defined Contributions: The German Pension Reform," MEA discussion paper series 07126, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    11. Helmuth Cremer & Jean‐Marie Lozachmeur & Pierre Pestieau, 2008. "Social Security And Retirement Decision: A Positive And Normative Approach," Journal of Economic Surveys, Wiley Blackwell, vol. 22(2), pages 213-233, April.
    12. Börsch-Supan, Axel, 2002. "What We Know and What We Do NOT Know," MEA discussion paper series 02017, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    13. Yosr Abid Fourati & Cathal O'Donoghue, 2009. "Eliciting Individual Preferences for Pension Reform," Working Papers 0150, National University of Ireland Galway, Department of Economics, revised 2009.
    14. Joachim Winter, 2002. "The impact of pension reforms and demography on stock markets," MEA discussion paper series 02021, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    15. Peter Backus & Alejandro Esteller-Moré, 2013. "What drives demand for redistribution? An empirical analysis of other-regarding and self-insurance motives," Economics Discussion Paper Series 1325, Economics, The University of Manchester.
    16. Pinotti Paolo, 2009. "Financial Development and Pay-As-You-Go Social Security," The B.E. Journal of Macroeconomics, De Gruyter, vol. 9(1), pages 1-21, March.
    17. Francesco Paolo Mongelli, 2008. "European Economic and Monetary Integration, and the Optimum Currency Area Theory," European Economy - Economic Papers 2008 - 2015 302, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    18. Tito Boeri & Pietro Garibaldi, "undated". "Shadow Activity and Unemployment in a Depressed Labor Market," Working Papers 177, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    19. Jochen Mayerl & Thorsten Faas, 2018. "Campaign dynamics of cognitive accessibility of political judgments: measuring the impact of campaigns and campaign events using response latencies in two German rolling cross section studies," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1575-1592, July.
    20. Thomas Fester & Marcel Thum, 2003. "Die Pensionslasten : eine Bedrohung der zukünftigen Handlungsfähigkeit der Länder," ifo Dresden berichtet, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(05), pages 36-45, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:6:d:10.1007_s11135-022-01594-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.