IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2024i65p178-194.html

"Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences

Author

Listed:
  • Libman, A.

    (Free University of Berlin, Germany)

Abstract

The last decade became a period of an empirical turn in economics and in many other social sciences, i. e., increasing role of quantitative empirical research and declining importance of big paradigms and research programs. What does, however, the increase of the number of empirical studies mean for the overall accumulation of knowledge about societies? Fundamentally, generalizable results are frequently seen as an important advantage of the quantitative methods. However, our article shows that standard studies within the framework of the empirical turn hardly communicate with each other, build upon each other or try to refute each other. References to other papers play a more or less symbolic role. Instead of a systematic worldview a sort of a 'zoo' of numerous individual case studies emerges, being hardly connected to each other. This development, however, should not necessarily be perceived as evidence of a crisis in social sciences.

Suggested Citation

  • Libman, A., 2024. ""Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences," Journal of the New Economic Association, New Economic Association, vol. 65(4), pages 178-194.
  • Handle: RePEc:nea:journl:y:2024:i:65:p:178-194
    DOI: 10.31737/22212264_2024_4_178-194
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2024-65-178-194r.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.31737/22212264_2024_4_178-194?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    2. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    3. Lieberman, Evan S., 2005. "Nested Analysis as a Mixed-Method Strategy for Comparative Research," American Political Science Review, Cambridge University Press, vol. 99(3), pages 435-452, August.
    4. Mahoney, James & Goertz, Gary, 2006. "A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research," Political Analysis, Cambridge University Press, vol. 14(3), pages 227-249, July.
    5. Daniel J. Benjamin & James O. Berger & Magnus Johannesson & Brian A. Nosek & E.-J. Wagenmakers & Richard Berk & Kenneth A. Bollen & Björn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Chr, 2018. "Redefine statistical significance," Nature Human Behaviour, Nature, vol. 2(1), pages 6-10, January.
      • Daniel Benjamin & James Berger & Magnus Johannesson & Brian Nosek & E. Wagenmakers & Richard Berk & Kenneth Bollen & Bjorn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Christopher Chambe, 2017. "Redefine Statistical Significance," Artefactual Field Experiments 00612, The Field Experiments Website.
    6. R. I. Kapeliushnikov, 2018. "On current state of economics: Subjective semi-sociological observations," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 5.
    7. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    8. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680.
    9. Arel-Bundock, Vincent & Briggs, Ryan C. & Doucouliagos, Hristos & Mendoza Aviña, Marco & Stanley, Tom D., 2022. "Quantitative Political Science Research is Greatly Underpowered," I4R Discussion Paper Series 6, The Institute for Replication (I4R).
    10. Uhlig, Harald, 2012. "Economics and reality," Journal of Macroeconomics, Elsevier, vol. 34(1), pages 29-41.
    11. Blakeley B. McShane & David Gal & Andrew Gelman & Christian Robert & Jennifer L. Tackett, 2019. "Abandon Statistical Significance," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 235-245, March.
    12. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    13. E. Han Kim & Adair Morse & Luigi Zingales, 2006. "What Has Mattered to Economics Since 1970," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 189-202, Fall.
    14. Jon Baron, 2018. "A Brief History of Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 40-50, July.
    15. David Colander, 2018. "Retrospectives: The Lost Art of Economics," Chapters, in: How Economics Should Be Done, chapter 3, pages 25-32, Edward Elgar Publishing.
    16. Edward Miguel, 2021. "Evidence on Research Transparency in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 193-214, Summer.
    17. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 407-443.
    18. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    19. Lee Sigelman & Robert Goldfarb, 2012. "The influence of economics on political science: by what pathway?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 19(1), pages 1-19, March.
    20. Kevin Lang, 2025. "How Credible Is the Credibility Revolution?," Journal of Labor Economics, University of Chicago Press, vol. 43(2), pages 635-663.
    21. Bierens, Herman J. & Swanson, Norman R., 2000. "The econometric consequences of the ceteris paribus condition in economic theory," Journal of Econometrics, Elsevier, vol. 95(2), pages 223-253, April.
    22. R. I. Kapeliushnikov., 2018. "On current state of economics: Subjective semi-sociological observations," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 5.
    23. Herrera, Yoshiko M. & Kapur, Devesh, 2007. "Improving Data Quality: Actors, Incentives, and Capabilities," Political Analysis, Cambridge University Press, vol. 15(4), pages 365-386.
    24. Abhijit Vinayak Banerjee, 2020. "Field Experiments and the Practice of Economics," American Economic Review, American Economic Association, vol. 110(7), pages 1937-1951, July.
    25. Kim, E. Han & Morse, Adair & Zingales, Luigi, 2006. "What Has Mattered to Economics Since 1970," Working Papers 212, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Libman, A., 2025. "Frontiers and crises of the social sciences: Difficulties of cartography," Journal of the New Economic Association, New Economic Association, vol. 69(4), pages 258-264.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ferman, Bruno & Finamor, Lucas, 2025. "There must be an error here! Experimental evidence on coding errors' biases," I4R Discussion Paper Series 266, The Institute for Replication (I4R).
    2. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    3. Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024. "Meta-analysis of Empirical Estimates of Loss Aversion," Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
    4. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    5. Bobasu, Alina & Ciccarelli, Matteo & Notarpietro, Alessandro & Ambrocio, Gene & Auer, Simone & Bonfim, Diana & Bottero, Margherita & Brázdik, František & Buss, Ginters & Byrne, David & Casalis, André , 2025. "Monetary policy transmission: a reference guide through ESCB models and empirical benchmarks," Occasional Paper Series 377, European Central Bank.
    6. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    7. Ali Elminejad & Tomas Havranek & Roman Horvath & Zuzana Irsova, 2023. "Intertemporal Substitution in Labor Supply: A Meta-Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 1095-1113, December.
    8. Travis J. Lybbert & Steven T. Buccola, 2021. "The evolving ethics of analysis, publication, and transparency in applied economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1330-1351, December.
    9. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    10. Avtonomov, V., 2025. "From an economist's point of view..," Journal of the New Economic Association, New Economic Association, vol. 69(4), pages 250-257.
    11. Sebastian Gechert & Bianka Mey & Matej Opatrny & Tomas Havranek & T. D. Stanley & Pedro R. D. Bom & Hristos Doucouliagos & Philipp Heimberger & Zuzana Irsova & Heiko J. Rachinger, 2025. "Conventional wisdom, meta‐analysis, and research revision in economics," Journal of Economic Surveys, Wiley Blackwell, vol. 39(3), pages 980-999, July.
    12. Balafoutas, Loukas & Celse, Jeremy & Karakostas, Alexandros & Umashev, Nicholas, 2025. "Incentives and the replication crisis in social sciences: A critical review of open science practices," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    13. repec:osf:osfxxx:nwp8k_v1 is not listed on IDEAS
    14. Alejandro Avenburg & John Gerring & Jason Seawright, 2023. "How do social scientists reach causal inferences? A study of reception," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 257-275, February.
    15. Gonzalez-Jimenez, David & Capozza, Francesco & Dirkmaat, Thomas & van de Veer, Evelien & van Druten, Amber & Baillon, Aurélien, 2025. "Falling and failing (to learn): Evidence from a nation-wide cybersecurity field experiment with SMEs," Journal of Economic Behavior & Organization, Elsevier, vol. 230(C).
    16. Brown, Craig O., 2020. "Economic leadership and growth," Journal of Monetary Economics, Elsevier, vol. 116(C), pages 298-333.
    17. Christophe Hurlin & Jean-Edouard Colliard & Christophe Pérignon, 2024. "The Economics of Computational Reproducibility," Working Papers hal-04759240, HAL.
    18. Marcus, Jan, 2025. "Replication code as a cornerstone of the credibility revolution 2.0," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 117(C).
    19. Brodeur, Abel & Esterling, Kevin & Ankel-Peters, Jörg & Bueno, Natália S & Desposato, Scott & Dreber, Anna & Genovese, Federica & Green, Donald P & Hepplewhite, Matthew & de la Guardia, Fernando Hoces, 2024. "Promoting Reproducibility and Replicability in Political Science," Department of Economics, Working Paper Series qt23n3n3dg, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    20. Bruns, Stephan B. & Doucouliagos, Anthony & Doucouliagos, Hristos & König, Johannes & Stanley, T.D. & Zigova, Katarina, 2026. "The delayed acceptance of female research in economics," European Economic Review, Elsevier, vol. 182(C).
    21. Christophe Pérignon & Olivier Akmansoy & Christophe Hurlin & Anna Dreber & Felix Holzmeister & Juergen Huber & Magnus Johanneson & Michael Kirchler & Albert J Menkveld & Michael Razen & Utz Weitzel, 2022. "Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance," Working Papers hal-03810013, HAL.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2024:i:65:p:178-194. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.