IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v55y2021i4d10.1007_s11135-020-01052-z.html
   My bibliography  Save this article

Conducting quantitative studies with the participation of political elites: best practices for designing the study and soliciting the participation of political elites

Author

Listed:
  • Barbara Vis

    (Utrecht University)

  • Sjoerd Stolwijk

    (NPO)

Abstract

Conducting quantitative research (e.g., surveys, a large number of interviews, experiments) with the participation of political elites is typically challenging. Given that a population of political elites is typically small by definition, a particular challenge is obtaining a sufficiently high number of observations and, thus, a certain response rate. This paper focuses on two questions related to this challenge: (1) What are best practices for designing the study? And (2) what are best practices for soliciting the participation of political elites? To arrive at these best practices, we (a) examine which factors explain the variation in response rates across surveys within and between large-scale, multi-wave survey projects by statistically analyzing a newly compiled dataset of 342 political elite surveys from eight projects, spanning 30 years and 58 countries, (b) integrate the typically scattered findings from the existing literature and (c) discuss results from an original expert survey among researchers with experience with such research (n = 23). By compiling a comprehensive list of best practices, systematically testing some widely held believes about response rates and by providing benchmarks for response rates depending on country, survey mode and elite type, we aim to facilitate future studies where participation of political elites is required. This will contribute to our knowledge and understanding of political elites’ opinions, information processing and decision making and thereby of the functioning of representative democracies.

Suggested Citation

  • Barbara Vis & Sjoerd Stolwijk, 2021. "Conducting quantitative studies with the participation of political elites: best practices for designing the study and soliciting the participation of political elites," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1281-1317, August.
  • Handle: RePEc:spr:qualqt:v:55:y:2021:i:4:d:10.1007_s11135-020-01052-z
    DOI: 10.1007/s11135-020-01052-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-020-01052-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-020-01052-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    2. Daniel M. Butler & Adam M. Dynes, 2016. "How Politicians Discount the Opinions of Constituents with Whom They Disagree," American Journal of Political Science, John Wiley & Sons, vol. 60(4), pages 975-989, October.
    3. Norris, Pippa & Lovenduski, Joni, 1989. "Women Candidates for Parliament: Transforming the Agenda?," British Journal of Political Science, Cambridge University Press, vol. 19(1), pages 106-115, January.
    4. David E. Broockman & Daniel M. Butler, 2017. "The Causal Effects of Elite Position‐Taking on Voter Attitudes: Field Experiments with Elite Communication," American Journal of Political Science, John Wiley & Sons, vol. 61(1), pages 208-221, January.
    5. Daniel M. Butler & Craig Volden & Adam M. Dynes & Boris Shor, 2017. "Ideology, Learning, and Policy Diffusion: Experimental Evidence," American Journal of Political Science, John Wiley & Sons, vol. 61(1), pages 37-49, January.
    6. Stefaan Walgrave & Jeroen K. Joly, 2018. "Surveying individual political elites: a comparative three-country study," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2221-2237, September.
    7. Sheffer, Lior & Loewen, Peter John & Soroka, Stuart & Walgrave, Stefaan & Sheafer, Tamir, 2018. "Nonrepresentative Representatives: An Experimental Study of the Decision Making of Elected Politicians," American Political Science Review, Cambridge University Press, vol. 112(2), pages 302-321, May.
    8. Enrique Fatas & Tibor Neugebauer & Pilar Tamborero, 2007. "How Politicians Make Decisions: A Political Choice Experiment," Journal of Economics, Springer, vol. 92(2), pages 167-196, October.
    9. Caroline Bayart & Patrick Bonnel & Catherine Morency, 2008. "Survey Mode Integration and Data Fusion: Methods and challenges," Post-Print halshs-00329174, HAL.
    10. Joni Lovenduski & Pippa Norris, 2003. "Westminster Women: the Politics of Presence," Political Studies, Political Studies Association, vol. 51(1), pages 84-102, March.
    11. Baekgaard, Martin & Christensen, Julian & Dahlmann, Casper Mondrup & Mathiasen, Asbjørn & Petersen, Niels Bjørn Grund, 2019. "The Role of Evidence in Politics: Motivated Reasoning and Persuasion among Politicians," British Journal of Political Science, Cambridge University Press, vol. 49(3), pages 1117-1140, July.
    12. Sheffer, Lior & Loewen, Peter John & Soroka, Stuart & Walgrave, Stefaan & Sheafer, Tamir, 2018. "Nonrepresentative Representatives: An Experimental Study of the Decision Making of Elected Politicians - CORRIGENDUM," American Political Science Review, Cambridge University Press, vol. 112(2), pages 428-428, May.
    13. Sjoerd B Stolwijk & Andreas RT Schuck, 2019. "More interest in interest: Does poll coverage help or hurt efforts to make more young voters show up at the ballot box?," European Union Politics, , vol. 20(3), pages 341-360, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Roberto Brunetti & Matthieu Pourieux, 2023. "Representative Policy-Makers? A Behavioral Experiment with French Politicians," Working Papers 2319, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandro Ambuehl & Sebastian Blesse & Philipp Doerrenberg & Christoph Feldhaus & Axel Ockenfels, 2023. "Politicians' Social Welfare Criteria: An Experiment with German Legislators," CESifo Working Paper Series 10329, CESifo.
    2. Ambuehl, Sandro & Blesse, Sebastian & Doerrenberg, Philipp & Feldhaus, Christoph & Ockenfels, Axel, 2023. "Politicians' social welfare criteria - An experiment with German legislators," ZEW Discussion Papers 23-013, ZEW - Leibniz Centre for European Economic Research.
    3. Jean Roisse Rodrigues Ferreira, 2022. "Decision-Making under Risk: Conditions Affecting the Risk Preferences of Politicians in Digitalization," IJERPH, MDPI, vol. 19(5), pages 1-12, March.
    4. Roberto Brunetti & Matthieu Pourieux, 2023. "Representative Policy-Makers? A Behavioral Experiment with French Politicians," Working Papers 2319, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    5. Laura Hueber & Rene Schwaiger, 2021. "Debiasing Through Experience Sampling: The Case of Myopic Loss Aversion," Working Papers 2021-01, Faculty of Economics and Statistics, Universität Innsbruck.
    6. Donato Masciandaro, 2023. "Politicians, Trust and Financial Literacy: When Do Politicians Care?," BAFFI CAREFIN Working Papers 23206, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    7. Aseem Mahajan & Reuben Kline & Dustin Tingley, 2022. "Collective Risk and Distributional Equity in Climate Change Bargaining," Journal of Conflict Resolution, Peace Science Society (International), vol. 66(1), pages 61-90, January.
    8. Schwaiger, Rene & Kirchler, Michael & Lindner, Florian & Weitzel, Utz, 2020. "Determinants of investor expectations and satisfaction. A study with financial professionals," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    9. Sandro Ambuehl & B. Douglas Bernheim & Axel Ockenfels, 2019. "Projective Paternalism," CESifo Working Paper Series 7762, CESifo.
    10. Binswanger, Johannes & Oechslin, Manuel, 2020. "Better statistics, better economic policies?," European Economic Review, Elsevier, vol. 130(C).
    11. Hueber, Laura & Schwaiger, Rene, 2022. "Debiasing through experience sampling: The case of myopic loss aversion," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 87-138.
    12. Albert Argilaga & Jijian Fan, 2022. "Optimal Policymaking under Yardstick Vote: An Experimental Study," Games, MDPI, vol. 13(3), pages 1-24, May.
    13. Sarah Childs & Julie Withey, 2004. "Women Representatives Acting for Women: Sex and the Signing of Early Day Motions in the 1997 British Parliament," Political Studies, Political Studies Association, vol. 52(3), pages 552-564, October.
    14. Michael Razen & Michael Kirchler & Utz Weitzel, 2019. "Determinants Of Prepaid Systems Of Healthcare Financing - A Worldwide Country-Level Perspective," Working Papers 2019-12, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Razen, Michael & Kirchler, Michael & Weitzel, Utz, 2020. "Domain-specific risk-taking among finance professionals," Journal of Behavioral and Experimental Finance, Elsevier, vol. 27(C).
    16. Hartwell, Christopher A. & Devinney, Timothy, 2021. "Populism, political risk, and pandemics: The challenges of political leadership for business in a post-COVID world," Journal of World Business, Elsevier, vol. 56(4).
    17. Anna Abalkina & Alexander Libman, 2020. "The real costs of plagiarism: Russian governors, plagiarized PhD theses, and infrastructure in Russian regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2793-2820, December.
    18. Donato Masciandaro, 2023. "Politicians, Trust, Financial Literacy and Financial Education: When Do Politicians Care?," BAFFI CAREFIN Working Papers 23208, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    19. Kärnä, Anders & Öhberg, Patrik, 2022. "Misrepresentation and Migration," Working Paper Series 1445, Research Institute of Industrial Economics, revised 11 May 2023.
    20. Persson, Emil & Tinghög, Gustav, 2020. "Opportunity cost neglect in public policy," Journal of Economic Behavior & Organization, Elsevier, vol. 170(C), pages 301-312.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:55:y:2021:i:4:d:10.1007_s11135-020-01052-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.