IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v57y2023i1d10.1007_s11135-022-01353-5.html
   My bibliography  Save this article

How do social scientists reach causal inferences? A study of reception

Author

Listed:
  • Alejandro Avenburg

    (National University of San Martín)

  • John Gerring

    (University of Texas)

  • Jason Seawright

    (Northwestern University)

Abstract

In this paper we outline a new area of research, social science reception: how inferences are reached by social scientists. Specifically, we ask how the nature of the evidence affects the sort of causal inferences that social scientists draw. As an exemplar, we focus on multimethod research. Specifically, we subject respondents to an experiment in which each species of evidence constitutes a distinct treatment: (a) qualitative, (b) quantitative, or (c) multimethod. In the abstract, respondents tend to reflect widespread methodological norms about the strengths of multimethod research. However, when confronted with specific studies, scholars are not more likely to believe causal inferences backed by multimethod research than inferences backed by mono-method research. This suggests that there is a misalignment between methodological norms and on-the-ground judgments.

Suggested Citation

  • Alejandro Avenburg & John Gerring & Jason Seawright, 2023. "How do social scientists reach causal inferences? A study of reception," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 257-275, February.
    • Handle: RePEc:spr:qualqt:v:57:y:2023:i:1:d:10.1007_s11135-022-01353-5
    DOI: 10.1007/s11135-022-01353-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-022-01353-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-022-01353-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lieberman, Evan S., 2005. "Nested Analysis as a Mixed-Method Strategy for Comparative Research," American Political Science Review, Cambridge University Press, vol. 99(3), pages 435-452, August.
    2. Beck, Nathaniel, 2006. "Is Causal-Process Observation an Oxymoron?," Political Analysis, Cambridge University Press, vol. 14(3), pages 347-352, July.
    3. Fairfield, Tasha & Charman, Andrew, 2017. "Explicit Bayesian analysis for process tracing: guidelines, opportunities, and caveats," LSE Research Online Documents on Economics 69203, London School of Economics and Political Science, LSE Library.
    4. Humphreys, Macartan & Jacobs, Alan M., 2015. "Mixing Methods: A Bayesian Approach," American Political Science Review, Cambridge University Press, vol. 109(4), pages 653-673, November.
    5. J. Scott Armstrong, 1980. "Unintelligible Management Research and Academic Prestige," Interfaces, INFORMS, vol. 10(2), pages 80-86, April.
    6. Mahoney, James & Goertz, Gary, 2006. "A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research," Political Analysis, Cambridge University Press, vol. 14(3), pages 227-249, July.
    7. Beck, Nathaniel, 2010. "Causal Process “Observation†: Oxymoron or (Fine) Old Wine," Political Analysis, Cambridge University Press, vol. 18(4), pages 499-505.
    8. Trejo, Guillermo, 2009. "Religious Competition and Ethnic Mobilization in Latin America: Why the Catholic Church Promotes Indigenous Movements in Mexico," American Political Science Review, Cambridge University Press, vol. 103(3), pages 323-342, August.
    9. Fairfield, Tasha & Charman, Andrew E., 2017. "Explicit Bayesian Analysis for Process Tracing: Guidelines, Opportunities, and Caveats," Political Analysis, Cambridge University Press, vol. 25(3), pages 363-380, July.
    10. White, Howard, 2002. "Combining Quantitative and Qualitative Approaches in Poverty Analysis," World Development, Elsevier, vol. 30(3), pages 511-522, March.
    11. Hafner-Burton, Emilie M., 2005. "Trading Human Rights: How Preferential Trade Agreements Influence Government Repression," International Organization, Cambridge University Press, vol. 59(3), pages 593-629, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haegeman, Karel & Marinelli, Elisabetta & Scapolo, Fabiana & Ricci, Andrea & Sokolov, Alexander, 2013. "Quantitative and qualitative approaches in Future-oriented Technology Analysis (FTA): From combination to integration?," Technological Forecasting and Social Change, Elsevier, vol. 80(3), pages 386-397.
    2. Gustav Lidén, 2013. "What about theory? The consequences on a widened perspective of social theory," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(1), pages 213-225, January.
    3. Martin Rabbia, 2023. "Why did Argentina and Uruguay decide to pursue a carbon tax? Fiscal reforms and explicit carbon prices," Review of Policy Research, Policy Studies Organization, vol. 40(2), pages 230-259, March.
    4. Fernández Milmanda, Belén & Garay, Candelaria, 2019. "Subnational variation in forest protection in the Argentine Chaco," World Development, Elsevier, vol. 118(C), pages 79-90.
    5. Brandão, Frederico & Befani, Barbara & Soares-Filho, Jaílson & Rajão, Raoni & Garcia, Edenise, 2023. "How to halt deforestation in the Amazon? A Bayesian process-tracing approach," Land Use Policy, Elsevier, vol. 133(C).
    6. Jack S. Levy, 2008. "Case Studies: Types, Designs, and Logics of Inference," Conflict Management and Peace Science, Peace Science Society (International), vol. 25(1), pages 1-18, February.
    7. Amengual, Matthew, 2018. "Buying stability: The distributive outcomes of private politics in the Bolivian mining industry," World Development, Elsevier, vol. 104(C), pages 31-45.
    8. Fairfield, Tasha & Charman, Andrew, 2019. "A Dialogue with the Data: the Bayesian foundations of iterative research in qualitative social science," LSE Research Online Documents on Economics 89261, London School of Economics and Political Science, LSE Library.
    9. Alvarado, Miriam & Penney, Tarra L. & Unwin, Nigel & Murphy, Madhuvanti M. & Adams, Jean, 2021. "Evidence of a health risk ‘signalling effect’ following the introduction of a sugar-sweetened beverage tax," Food Policy, Elsevier, vol. 102(C).
    10. Jørgen Møller & Svend-Erik Skaaning, 2017. "Explanatory Typologies as a Nested Strategy of Inquiry: Combining Cross-case and Within-case Analyses," Sociological Methods & Research, , vol. 46(4), pages 1018-1048, November.
    11. Richards, Paul, 2011. "A Systematic Approach to Cultural Explanations of War: Tracing Causal Processes in Two West African Insurgencies," World Development, Elsevier, vol. 39(2), pages 212-220, February.
    12. Peter Lorentzen & M Taylor Fravel & Jack Paine, 2017. "Qualitative investigation of theoretical models: the value of process tracing," Journal of Theoretical Politics, , vol. 29(3), pages 467-491, July.
    13. Fanelli, Daniele, 2022. "The "Tau" of Science - How to Measure, Study, and Integrate Quantitative and Qualitative Knowledge," MetaArXiv 67sak, Center for Open Science.
    14. David A. Bateman & Dawn Langan Teele, 2020. "A developmental approach to historical causal inference," Public Choice, Springer, vol. 185(3), pages 253-279, December.
    15. Blair, Graeme & Cooper, Jasper & Coppock, Alexander & Humphreys, Macartan, 2019. "Declaring and Diagnosing Research Designs," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 113(3), pages 838-859.
    16. Stefano Costalli & Luigi Moretti & Costantino Pischedda, 2014. "The Economic Costs of Civil War: Synthetic Counterfactual Evidence and the Effects of Ethnic Fractionalization," HiCN Working Papers 184, Households in Conflict Network.
    17. Sarah Ellis Barnekow & Kishore G. Kulkarni, 2017. "Why Regionalism? A Look at the Costs and Benefits of Regional Trade Agreements in Africa," Global Business Review, International Management Institute, vol. 18(1), pages 99-117, February.
    18. Jonas Tallberg & Thomas Sommerer & Theresa Squatrito, 2016. "Democratic memberships in international organizations: Sources of institutional design," The Review of International Organizations, Springer, vol. 11(1), pages 59-87, March.
    19. Francis Teal, 2006. "Consumption and welfare in Ghana in the 1990s," Journal of Development Studies, Taylor & Francis Journals, vol. 42(7), pages 1252-1269.
    20. Boehnke, Denise & Jehling, Mathias & Vogt, Joachim, 2023. "What hinders climate adaptation? Approaching barriers in municipal land use planning through participant observation," Land Use Policy, Elsevier, vol. 132(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:57:y:2023:i:1:d:10.1007_s11135-022-01353-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.