IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2024i65p178-194.html
   My bibliography  Save this article

"Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences

Author

Listed:
  • Libman, A.

    (Free University of Berlin, Germany)

Abstract

The last decade became a period of an empirical turn in economics and in many other social sciences, i. e., increasing role of quantitative empirical research and declining importance of big paradigms and research programs. What does, however, the increase of the number of empirical studies mean for the overall accumulation of knowledge about societies? Fundamentally, generalizable results are frequently seen as an important advantage of the quantitative methods. However, our article shows that standard studies within the framework of the empirical turn hardly communicate with each other, build upon each other or try to refute each other. References to other papers play a more or less symbolic role. Instead of a systematic worldview a sort of a 'zoo' of numerous individual case studies emerges, being hardly connected to each other. This development, however, should not necessarily be perceived as evidence of a crisis in social sciences.

Suggested Citation

  • Libman, A., 2024. ""Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences," Journal of the New Economic Association, New Economic Association, vol. 65(4), pages 178-194.
  • Handle: RePEc:nea:journl:y:2024:i:65:p:178-194
    DOI: 10.31737/22212264_2024_4_178-194
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2024-65-178-194r.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.31737/22212264_2024_4_178-194?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    3. Lieberman, Evan S., 2005. "Nested Analysis as a Mixed-Method Strategy for Comparative Research," American Political Science Review, Cambridge University Press, vol. 99(3), pages 435-452, August.
    4. Mahoney, James & Goertz, Gary, 2006. "A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research," Political Analysis, Cambridge University Press, vol. 14(3), pages 227-249, July.
    5. Daniel J. Benjamin & James O. Berger & Magnus Johannesson & Brian A. Nosek & E.-J. Wagenmakers & Richard Berk & Kenneth A. Bollen & Björn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Chr, 2018. "Redefine statistical significance," Nature Human Behaviour, Nature, vol. 2(1), pages 6-10, January.
      • Daniel Benjamin & James Berger & Magnus Johannesson & Brian Nosek & E. Wagenmakers & Richard Berk & Kenneth Bollen & Bjorn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Christopher Chambe, 2017. "Redefine Statistical Significance," Artefactual Field Experiments 00612, The Field Experiments Website.
    6. Abhijit Vinayak Banerjee, 2020. "Field Experiments and the Practice of Economics," American Economic Review, American Economic Association, vol. 110(7), pages 1937-1951, July.
    7. R. I. Kapeliushnikov, 2018. "On current state of economics: Subjective semi-sociological observations," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 5.
    8. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    9. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    10. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 407-443.
    11. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680, Decembrie.
    12. Arel-Bundock, Vincent & Briggs, Ryan C. & Doucouliagos, Hristos & Mendoza Aviña, Marco & Stanley, Tom D., 2022. "Quantitative Political Science Research is Greatly Underpowered," I4R Discussion Paper Series 6, The Institute for Replication (I4R).
    13. Uhlig, Harald, 2012. "Economics and reality," Journal of Macroeconomics, Elsevier, vol. 34(1), pages 29-41.
    14. Blakeley B. McShane & David Gal & Andrew Gelman & Christian Robert & Jennifer L. Tackett, 2019. "Abandon Statistical Significance," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 235-245, March.
    15. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    16. E. Han Kim & Adair Morse & Luigi Zingales, 2006. "What Has Mattered to Economics Since 1970," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 189-202, Fall.
    17. Jon Baron, 2018. "A Brief History of Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 40-50, July.
    18. David Colander, 2018. "Retrospectives: The Lost Art of Economics," Chapters, in: How Economics Should Be Done, chapter 3, pages 25-32, Edward Elgar Publishing.
    19. Edward Miguel, 2021. "Evidence on Research Transparency in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 193-214, Summer.
    20. Lee Sigelman & Robert Goldfarb, 2012. "The influence of economics on political science: by what pathway?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 19(1), pages 1-19, March.
    21. Kevin Lang, 2023. "How Credible is the Credibility Revolution?," NBER Working Papers 31666, National Bureau of Economic Research, Inc.
    22. Bierens, Herman J. & Swanson, Norman R., 2000. "The econometric consequences of the ceteris paribus condition in economic theory," Journal of Econometrics, Elsevier, vol. 95(2), pages 223-253, April.
    23. R. I. Kapeliushnikov., 2018. "On current state of economics: Subjective semi-sociological observations," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 5.
    24. Herrera, Yoshiko M. & Kapur, Devesh, 2007. "Improving Data Quality: Actors, Incentives, and Capabilities," Political Analysis, Cambridge University Press, vol. 15(4), pages 365-386.
    25. Kim, E. Han & Morse, Adair & Zingales, Luigi, 2006. "What Has Mattered to Economics Since 1970," Working Papers 212, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024. "Meta-analysis of Empirical Estimates of Loss Aversion," Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
    2. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    3. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    4. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    5. Travis J. Lybbert & Steven T. Buccola, 2021. "The evolving ethics of analysis, publication, and transparency in applied economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1330-1351, December.
    6. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    7. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    8. repec:osf:osfxxx:nwp8k_v1 is not listed on IDEAS
    9. Alejandro Avenburg & John Gerring & Jason Seawright, 2023. "How do social scientists reach causal inferences? A study of reception," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 257-275, February.
    10. Gonzalez-Jimenez, David & Capozza, Francesco & Dirkmaat, Thomas & van de Veer, Evelien & van Druten, Amber & Baillon, Aurélien, 2025. "Falling and failing (to learn): Evidence from a nation-wide cybersecurity field experiment with SMEs," Journal of Economic Behavior & Organization, Elsevier, vol. 230(C).
    11. Sebastian Gechert & Bianka Mey & Matej Opatrny & Tomas Havranek & T. D. Stanley & Pedro R. D. Bom & Hristos Doucouliagos & Philipp Heimberger & Zuzana Irsova & Heiko J. Rachinger, 2025. "Conventional wisdom, meta‐analysis, and research revision in economics," Journal of Economic Surveys, Wiley Blackwell, vol. 39(3), pages 980-999, July.
    12. Brown, Craig O., 2020. "Economic leadership and growth," Journal of Monetary Economics, Elsevier, vol. 116(C), pages 298-333.
    13. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    14. Bruns, Stephan B. & Doucouliagos, Anthony & Doucouliagos, Chris & König, Johannes & Stanley, T. D. & Zigova, Katarina, 2025. "The Delayed Acceptance of Female Research in Economics," IZA Discussion Papers 17649, Institute of Labor Economics (IZA).
    15. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johanneson & Michael Kirchler & Albert Menkveld & Michael Razen & Utz Weitzel, 2022. "Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance," Working Papers hal-03810013, HAL.
    16. Stimpfle, Alexander & Stadelmann, David, 2015. "The Impact of Fundamental Development Factors on Different Income Groups: International Evidence," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 113128, Verein für Socialpolitik / German Economic Association.
    17. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    18. Damien Besancenot & Abdelghani Maddi, 2019. "Should citations be weighted to assess the influence of an academic article?," Economics Bulletin, AccessEcon, vol. 435(1), pages 435-445.
    19. Steven T. Berry & Philip A. Haile, 2024. "Nonparametric Identification of Differentiated Products Demand Using Micro Data," Econometrica, Econometric Society, vol. 92(4), pages 1135-1162, July.
    20. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," IZA Discussion Papers 11796, Institute of Labor Economics (IZA).
    21. Merigó, José M. & Gil-Lafuente, Anna M. & Kydland, Finn & Amiguet, Lluis & Vivoda, Vlado & Campbell, Gary & Lei, Yalin & Fleming-Muñoz, David, 2024. "50 years of Resources Policy: A bibliometric analysis," Resources Policy, Elsevier, vol. 96(C).

    More about this item

    Keywords

    empirical research; quantitative methods; credibility revolution; replication; generalization of results;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2024:i:65:p:178-194. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.