IDEAS home Printed from https://ideas.repec.org/a/bla/jecsur/v34y2020i3p469-475.html
   My bibliography  Save this article

Reporting Guidelines For Meta‐Analysis In Economics

Author

Listed:
  • Tomáš Havránek
  • T. D. Stanley
  • Hristos Doucouliagos
  • Pedro Bom
  • Jerome Geyer‐Klingeberg
  • Ichiro Iwasaki
  • W. Robert Reed
  • Katja Rost
  • R. C. M. van Aert

Abstract

Meta‐analysis has become the conventional approach to synthesizing the results of empirical economics research. To further improve the transparency and replicability of the reported results and to raise the quality of meta‐analyses, the Meta‐Analysis of Economics Research Network has updated the reporting guidelines that were published by this Journal in 2013. Future meta‐analyses in economics will be expected to follow these updated guidelines or give valid reasons why a meta‐analysis should deviate from them.

Suggested Citation

  • Tomáš Havránek & T. D. Stanley & Hristos Doucouliagos & Pedro Bom & Jerome Geyer‐Klingeberg & Ichiro Iwasaki & W. Robert Reed & Katja Rost & R. C. M. van Aert, 2020. "Reporting Guidelines For Meta‐Analysis In Economics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 469-475, July.
  • Handle: RePEc:bla:jecsur:v:34:y:2020:i:3:p:469-475
    DOI: 10.1111/joes.12363
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/joes.12363
    Download Restriction: no

    File URL: https://libkey.io/10.1111/joes.12363?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John P. A. Ioannidis & T. D. Stanley & Hristos Doucouliagos, 2017. "The Power of Bias in Economics Research," Economic Journal, Royal Economic Society, vol. 127(605), pages 236-265, October.
    2. Jonathan Heathcote & Fabrizio Perri, 2018. "Wealth and Volatility," Review of Economic Studies, Oxford University Press, vol. 85(4), pages 2173-2213.
    3. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    4. Xue, Xindong & Reed, W. Robert & Menclova, Andrea, 2020. "Social capital and health: a meta-analysis," Journal of Health Economics, Elsevier, vol. 72(C).
    5. Cristina Blanco-Perez & Abel Brodeur, 2020. "Publication Bias and Editorial Statement on Negative Findings," The Economic Journal, Royal Economic Society, vol. 130(629), pages 1226-1247.
    6. Jennifer Zelmer, 2003. "Linear Public Goods Experiments: A Meta-Analysis," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 299-310, November.
    7. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2018. "Methods Matter: P-Hacking and Causal Inference in Economics," IZA Discussion Papers 11796, Institute of Labor Economics (IZA).
    8. Tomas Havranek, Dominik Herman, and Zuzana Irsova, 2018. "Does Daylight Saving Save Electricity? A Meta-Analysis," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).
    9. Havranek, Tomas & Horvath, Roman & Irsova, Zuzana & Rusnak, Marek, 2015. "Cross-country heterogeneity in intertemporal substitution," Journal of International Economics, Elsevier, vol. 96(1), pages 100-118.
    10. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    11. Eric M. Leeper & Nora Traum & Todd B. Walker, 2017. "Clearing Up the Fiscal Multiplier Morass," American Economic Review, American Economic Association, vol. 107(8), pages 2409-2454, August.
    12. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    13. Adrien Auclert, 2019. "Monetary Policy and the Redistribution Channel," American Economic Review, American Economic Association, vol. 109(6), pages 2333-2367, June.
    14. George M. Constantinides, 2017. "Asset Pricing: Models and Empirical Evidence," Journal of Political Economy, University of Chicago Press, vol. 125(6), pages 1782-1790.
    15. Tomas Havranek & Zuzana Irsova & Olesia Zeynalova, 2018. "Tuition Fees and University Enrolment: A Meta‐Regression Analysis," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(6), pages 1145-1184, December.
    16. Woodward, Richard T. & Wui, Yong-Suhk, 2001. "The economic value of wetland services: a meta-analysis," Ecological Economics, Elsevier, vol. 37(2), pages 257-270, May.
    17. Annamaria Lusardi & Pierre-Carl Michaud & Olivia S. Mitchell, 2017. "Optimal Financial Knowledge and Wealth Inequality," Journal of Political Economy, University of Chicago Press, vol. 125(2), pages 431-477.
    18. Tomas Havranek & Zuzana Irsova & Olesia Zeynalova, 2017. "Tuition Fees and University Enrollment: A Meta-Analysis," Working Papers IES 2017/16, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Aug 2017.
    19. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    20. Holger Görg & Eric Strobl, 2016. "Multinational Companies And Productivity Spillovers: A Meta-Analysis," World Scientific Book Chapters, in: MULTINATIONAL ENTERPRISES AND HOST COUNTRY DEVELOPMENT Volume 53: World Scientific Studies in International Economics, chapter 8, pages 145-161, World Scientific Publishing Co. Pte. Ltd..
    21. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    22. Sebastian Gechert & Tomas Havranek & Zuzana Irsova & Dominika Kolcunova, 2019. "Death to the Cobb-Douglas Production Function," Working Papers IES 2019/26, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2019.
    23. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.
    24. Tomas Havranek & Zuzana Irsova, 2017. "Do Borders Really Slash Trade? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 65(2), pages 365-396, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zigraiova, Diana & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2021. "How puzzling is the forward premium puzzle? A meta-analysis," European Economic Review, Elsevier, vol. 134(C).
    2. Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2020. "Remittances and economic growth: A meta-analysis," World Development, Elsevier, vol. 134(C).
    3. Bajzik, Josef & Havranek, Tomas & Irsova, Zuzana & Schwarz, Jiri, 2020. "Estimating the Armington elasticity: The importance of study design and publication bias," Journal of International Economics, Elsevier, vol. 127(C).
    4. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    5. Sebastian Gechert & Tomas Havranek & Zuzana Irsova & Dominika Kolcunova, 2022. "Measuring Capital-Labor Substitution: The Importance of Method Choices and Publication Bias," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 45, pages 55-82, July.
    6. Tomas Havranek & Anna Sokolova, 2020. "Do Consumers Really Follow a Rule of Thumb? Three Thousand Estimates from 144 Studies Say 'Probably Not'," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 35, pages 97-122, January.
    7. Roman Horvath & Ali Elminejad & Tomas Havranek, 2020. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," Working Papers IES 2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    8. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    9. Cazachevici, Alina & Havranek, Tomas & Horvath, Roman, 2019. "Remittances and Economic Growth: A Quantitative Survey," EconStor Preprints 205812, ZBW - Leibniz Information Centre for Economics.
    10. Mojmir Hampl & Tomas Havranek, 2020. "Central Bank Equity as an Instrument of Monetary Policy," Comparative Economic Studies, Palgrave Macmillan;Association for Comparative Economic Studies, vol. 62(1), pages 49-68, March.
    11. Doucouliagos, Hristos & Hinz, Thomas & Zigova, Katarina, 2022. "Bias and careers: Evidence from the aid effectiveness literature," European Journal of Political Economy, Elsevier, vol. 71(C).
    12. Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
    13. Havranek, Tomas & Rusnak, Marek & Sokolova, Anna, 2017. "Habit formation in consumption: A meta-analysis," European Economic Review, Elsevier, vol. 95(C), pages 142-167.
    14. Picchio, Matteo & Ubaldi, Michele, 2022. "Unemployment and Health: A Meta-Analysis," GLO Discussion Paper Series 1128, Global Labor Organization (GLO).
    15. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    16. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    17. Filomena, Mattia & Picchio, Matteo, 2021. "Retirement and Health Outcomes in a Meta-Analytical Framework," IZA Discussion Papers 14602, Institute of Labor Economics (IZA).
    18. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    19. Graham Elliott & Nikolay Kudrin & Kaspar Wüthrich, 2022. "Detecting p‐Hacking," Econometrica, Econometric Society, vol. 90(2), pages 887-906, March.
    20. Anton Astakhov & Tomas Havranek & Jiri Novak, 2019. "Firm Size And Stock Returns: A Quantitative Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 33(5), pages 1463-1492, December.

    More about this item

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Meta-Analysis in Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jecsur:v:34:y:2020:i:3:p:469-475. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0950-0804 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.