IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i2d10.1007_s11135-022-01406-9.html
   My bibliography  Save this article

The effect of sampling mode on response rate and bias in elite surveys

Author

Listed:
  • Matias López

    (Albert Hirschman Centre On Democracy, Graduate Institute of Geneva)

Abstract

The literature frequently recommends purposive sampling of elites based on the assumptions that random sampling negatively affects the response rate and that it induces bias. I test these assumptions drawing on metadata from 282 samples of political, economic, and social elites, and on microdata from 2,658 elites. First I use permutations to calculate confidence intervals for the expected response rate following each sampling method. Second, I estimate the effect of random sampling on the final response rate using a range of regression models. Finally, I compare the distributions of the estimators for the average age, the share of male elites, and elites’ ideology by simulating repeated random and purposive samples. Results indicate that both random and purposive sampling of elites generate sufficiently large samples, as well as consistent and unbiased estimators of population parameters. Contradicting methodological guidelines in the field, the conclusion is that random sampling of elites is efficient.

Suggested Citation

  • Matias López, 2023. "The effect of sampling mode on response rate and bias in elite surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1303-1319, April.
  • Handle: RePEc:spr:qualqt:v:57:y:2023:i:2:d:10.1007_s11135-022-01406-9
    DOI: 10.1007/s11135-022-01406-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01406-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-022-01406-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Frederick Solt, 2020. "Measuring Income Inequality Across Countries and Over Time: The Standardized World Income Inequality Database," Social Science Quarterly, Southwestern Social Science Association, vol. 101(3), pages 1183-1199, May.
    2. Bussell, Jennifer, 2020. "Shadowing as a Tool for Studying Political Elites," Political Analysis, Cambridge University Press, vol. 28(4), pages 469-486, October.
    3. Daniel Stevens & Benjamin G. Bishin & Robert R. Barr, 2006. "Authoritarian Attitudes, Democracy, and Policy Preferences among Latin American Elites," American Journal of Political Science, John Wiley & Sons, vol. 50(3), pages 606-620, July.
    4. Håkan Johansson & Anders Uhlin, 2020. "Civil Society Elites: A Research Agenda," Politics and Governance, Cogitatio Press, vol. 8(3), pages 82-85.
    5. Stefaan Walgrave & Jeroen K. Joly, 2018. "Surveying individual political elites: a comparative three-country study," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2221-2237, September.
    6. Bruno Cousin & Shamus Khan & Ashley Mears, 2018. "Theoretical and methodological pathways for research on elites," Post-Print hal-02184100, HAL.
    7. Bruno Cousin & Shamus Khan & Ashley Mears, 2018. "Theoretical and methodological pathways for research on elites," SciencePo Working papers Main hal-02184100, HAL.
    8. Amsden, the late Alice H. & DiCaprio, Alisa & Robinson, James A. (ed.), 2012. "The Role of Elites in Economic Development," OUP Catalogue, Oxford University Press, number 9780199659036.
    9. David E. Broockman & Gregory Ferenstein & Neil Malhotra, 2019. "Predispositions and the Political Behavior of American Economic Elites: Evidence from Technology Entrepreneurs," American Journal of Political Science, John Wiley & Sons, vol. 63(1), pages 212-233, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Felix Bühlmann & Caroline Ahler Christesen & Bruno Cousin & François Denord & Christoph Houman Ellersgaard & Paul Lagneau‐ymonet & Anton Grau Larsen & Mike Savage & Sylvain Thine & Kevin Young & Pedro, 2025. "Varieties of Economic Elites? Preliminary Results From the World Elite Database (WED)," Post-Print hal-05027410, HAL.
    2. Kevin L Young & Timothy Marple & James Heilman & Bruce A Desmarais, 2023. "A double-edged sword: The conditional properties of elite network ties in the financial sector," Environment and Planning A, , vol. 55(4), pages 997-1019, June.
    3. El Rafhi, Bilal & Darcillon, Thibault, 2024. "The evolution of affluent support for redistribution in Germany in the context of rising inequalities," European Journal of Political Economy, Elsevier, vol. 85(C).
    4. Bühlmann, Felix & Christesen, Caroline Ahler & Cousin, Bruno & Denord, François & Ellersgaard, Christoph Houman & Lagneau‐Ymonet, Paul & Larsen, Anton Grau & Savage, Mike & Thine, Sylvain & Young, Kev, 2025. "Varieties of economic elites? Preliminary results from the World Elite Database (WED)," LSE Research Online Documents on Economics 127763, London School of Economics and Political Science, LSE Library.
    5. António Afonso & José Alves & Krzysztof Beck, 2022. "Pay and unemployment determinants of migration flows in the European Union," Working Papers REM 2022/0251, ISEG - Lisbon School of Economics and Management, REM, Universidade de Lisboa.
    6. Isaac Kwesi Ofori & Toyo Amègnonna Marcel Dossou & Seyi Saint Akadiri, 2023. "Towards the quest to reduce income inequality in Africa: is there a synergy between tourism development and governance?," Current Issues in Tourism, Taylor & Francis Journals, vol. 26(3), pages 429-449, February.
    7. Boukraine, Wissem, 2020. "The finance-inequality nexus in the BRICS countries: evidence from an ARDL bound testing approach," MPRA Paper 101976, University Library of Munich, Germany.
    8. António Afonso & Ana Patricia Montes & José M. Domínguez, 2024. "Measuring Tax Burden Efficiency in OECD Countries: An International Comparison," CESifo Working Paper Series 11333, CESifo.
    9. Rutar, Tibor & Rutar, Minea, 2025. "Liberalizing reforms do not cause suicide: Causal estimation using matching, 1980–2019," Journal of Comparative Economics, Elsevier, vol. 53(1), pages 272-289.
    10. Lourdes ROJAS RUBIO, 2022. "Inequality, Corruption and Support for Democracy," THEMA Working Papers 2022-20, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    11. Sher Khan, 2022. "Investigating the Effect of Income Inequality on Corruption: New Evidence from 23 Emerging Countries," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(3), pages 2100-2126, September.
    12. Owolabi, Adegboyega O. & Berdiev, Aziz N. & Saunoris, James W., 2022. "Is the shadow economy procyclical or countercyclical over the business cycle? International evidence," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 257-270.
    13. Block, Joern H. & Hirschmann, Mirko & Kranz, Tobias & Neuenkirch, Matthias, 2023. "Public family firms and economic inequality across societies," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    14. Razafindrakoto, Mireille & Roubaud, François & Rua, Linda, 2021. "Hyper-elites and network: Capturing the powerful upper tail in Madagascar," World Development, Elsevier, vol. 147(C).
    15. Teresa María García-Muñoz & Juliette Milgram-Baleix, 2021. "Explaining Attitudes Towards Immigration: The Role of Economic Factors," Politics and Governance, Cogitatio Press, vol. 9(4), pages 159-173.
    16. Caruso Raul & Antonella Biscione, 2022. "Militarization and Income Inequality in European Countries (2000–2017)," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 28(3), pages 267-285, September.
    17. Uzar, Umut, 2024. "The critical role of green innovation technologies and democracy in the transition to sustainability: A study on leading emerging market economies," Technology in Society, Elsevier, vol. 78(C).
    18. Wang, Kailai & De Vos, Jonas & Smart, Michael & Wang, Sicheng, 2025. "Explaining Youth Driver Licensing Determinants Using XGBoost and SHAP," Transport Policy, Elsevier, vol. 168(C), pages 87-100.
    19. Bloom, David E. & Canning, David & Kotschy, Rainer & Prettner, Klaus & Schünemann, Johannes, 2024. "Health and economic growth: Reconciling the micro and macro evidence," World Development, Elsevier, vol. 178(C).
    20. Obadiah Jonathan Gimba & Mehdi Seraj & Huseyin Ozdeser, 2021. "What drives income inequality in sub‐Saharan Africa and its sub‐regions? An examination of long‐run and short‐run effects," African Development Review, African Development Bank, vol. 33(4), pages 729-741, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:2:d:10.1007_s11135-022-01406-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.