IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2015-83.html

Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"

Author

Abstract

No abstract is available for this item.

Suggested Citation

  • Andrew C. Chang & Phillip Li, 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"," Finance and Economics Discussion Series 2015-83, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgfe:2015-83
    DOI: 10.17016/FEDS.2015.083
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf
    File Function: Full text
    Download Restriction: no
    File URL: http://dx.doi.org/10.17016/FEDS.2015.083
    File Function: http://dx.doi.org/10.17016/FEDS.2015.083
    Download Restriction: no
    File URL: https://libkey.io/10.17016/FEDS.2015.083?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter N. Ireland, 2009. "On the Welfare Cost of Inflation and the Recent Behavior of Money Demand," American Economic Review, American Economic Association, vol. 99(3), pages 1040-1052, June.
    2. Arvind Krishnamurthy & Annette Vissing-Jorgensen, 2012. "The Aggregate Demand for Treasury Debt," Journal of Political Economy, University of Chicago Press, vol. 120(2), pages 233-267.
    3. Steven D. Levitt, 2002. "Using Electoral Cycles in Police Hiring to Estimate the Effects of Police on Crime: Reply," American Economic Review, American Economic Association, vol. 92(4), pages 1244-1250, September.
    4. Carlo Favero & Francesco Giavazzi, 2012. "Measuring Tax Multipliers: The Narrative Method in Fiscal VARs," American Economic Journal: Economic Policy, American Economic Association, vol. 4(2), pages 69-94, May.
    5. Valerie A. Ramey, 2011. "Identifying Government Spending Shocks: It's all in the Timing," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 1-50.
    6. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    7. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    8. Karel Mertens & Morten Overgaard Ravn, 2011. "Understanding the Aggregate Effects of Anticipated and Unanticipated Tax Policy Shocks," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(1), pages 27-54, January.
    9. Christina D. Romer & David H. Romer, 2010. "The Macroeconomic Effects of Tax Changes: Estimates Based on a New Measure of Fiscal Shocks," American Economic Review, American Economic Association, vol. 100(3), pages 763-801, June.
    10. Carmen M. Reinhart & Kenneth S. Rogoff, 2010. "Growth in a Time of Debt," American Economic Review, American Economic Association, vol. 100(2), pages 573-578, May.
    11. George J. Hall & Thomas J. Sargent, 2011. "Interest Rate Risk and Other Determinants of Post-WWII US Government Debt/GDP Dynamics," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(3), pages 192-214, July.
    12. Alan J. Auerbach & Yuriy Gorodnichenko, 2013. "Corrigendum: Measuring the Output Responses to Fiscal Policy," American Economic Journal: Economic Policy, American Economic Association, vol. 5(3), pages 320-322, August.
    13. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    14. Alan B. Krueger & David Card, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Reply," American Economic Review, American Economic Association, vol. 90(5), pages 1397-1420, December.
    15. Karel Mertens & Morten O. Ravn, 2013. "The Dynamic Effects of Personal and Corporate Income Tax Changes in the United States," American Economic Review, American Economic Association, vol. 103(4), pages 1212-1247, June.
    16. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    17. Barry Nalebuff & Ron Shachar, 1999. "Follow the Leader: Theory and Evidence on Political Participation," American Economic Review, American Economic Association, vol. 89(3), pages 525-547, June.
    18. Giancarlo Corsetti & André Meier & Gernot J. Müller, 2012. "Fiscal Stimulus with Spending Reversals," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 878-895, November.
    19. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    20. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, IZA Network @ LISER.
    21. William Wascher & David Neumark, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Comment," American Economic Review, American Economic Association, vol. 90(5), pages 1362-1396, December.
    22. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    23. Justin McCrary, 2002. "Using Electoral Cycles in Police Hiring to Estimate the Effect of Police on Crime: Comment," American Economic Review, American Economic Association, vol. 92(4), pages 1236-1243, September.
    24. Cynthia Bansak & Mary E. Graham & Allan A. Zebedee, 2012. "Business Cycles and Gender Diversification: An Analysis of Establishment-Level Gender Dissimilarity," American Economic Review, American Economic Association, vol. 102(3), pages 561-565, May.
    25. Robert J. Barro & Charles J. Redlick, 2011. "Macroeconomic Effects From Government Purchases and Taxes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 51-102.
    26. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    27. Christiane Baumeister & Gert Peersman, 2013. "Time-Varying Effects of Oil Supply Shocks on the US Economy," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(4), pages 1-28, October.
    28. Stephanie Schmitt-Grohe & Martin Uribe, 2011. "Business Cycles With A Common Trend in Neutral and Investment-Specific Productivity," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(1), pages 122-135, January.
    29. Thomas Herndon & Michael Ash & Robert Pollin, 2014. "Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 38(2), pages 257-279.
    30. JonasD.M. Fisher & Ryan Peters, 2010. "Using Stock Returns to Identify Government Spending Shocks," Economic Journal, Royal Economic Society, vol. 120(544), pages 414-436, May.
    31. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    32. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    33. Garth Heutel, 2012. "How Should Environmental Policy Respond to Business Cycles? Optimal Policy under Persistent Productivity Shocks," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(2), pages 244-264, April.
    34. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    35. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 407-443.
    36. Colleen Carey & Stephen H. Shore, 2013. "From the Peaks to the Valleys: Cross-State Evidence on Income Volatility over the Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 549-562, May.
    37. B. D. McCullough & H. D. Vinod, 2004. "Verifying the Solution from a Nonlinear Solver: A Case Study: Reply," American Economic Review, American Economic Association, vol. 94(1), pages 400-406, March.
    38. Michelle Alexopoulos & Jon Cohen, 2011. "Volumes of evidence: examining technical change in the last century through a new lens," Canadian Journal of Economics, Canadian Economics Association, vol. 44(2), pages 413-450, May.
    39. Xavier Gabaix, 2011. "The Granular Origins of Aggregate Fluctuations," Econometrica, Econometric Society, vol. 79(3), pages 733-772, May.
    40. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
    41. Donald W. K. Andrews, 2003. "Tests for Parameter Instability and Structural Change with Unknown Change Point: A Corrigendum," Econometrica, Econometric Society, vol. 71(1), pages 395-397, January.
    42. Levitt, Steven D, 1997. "Using Electoral Cycles in Police Hiring to Estimate the Effect of Police on Crime," American Economic Review, American Economic Association, vol. 87(3), pages 270-290, June.
    43. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    44. Michelle Alexopoulos, 2011. "Read All about It!! What Happens Following a Technology Shock?," American Economic Review, American Economic Association, vol. 101(4), pages 1144-1179, June.
    45. Caroline M. Hoxby, 2007. "Does Competition Among Public Schools Benefit Students and Taxpayers? Reply," American Economic Review, American Economic Association, vol. 97(5), pages 2038-2055, December.
    46. Zeynep Senyuz, 2011. "Factor analysis of permanent and transitory dynamics of the US economy and the stock market," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 975-998, September.
    47. Ricardo Reis & Mark W. Watson, 2010. "Relative Goods' Prices, Pure Inflation, and the Phillips Correlation," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 128-157, July.
    48. Sophocles Mavroeidis, 2010. "Monetary Policy Rules and Macroeconomic Stability: Some New Evidence," American Economic Review, American Economic Association, vol. 100(1), pages 491-503, March.
    49. Jesse Rothstein, 2007. "Does Competition Among Public Schools Benefit Students and Taxpayers? Comment," American Economic Review, American Economic Association, vol. 97(5), pages 2026-2037, December.
    50. Anna Kormilitsina, 2011. "Oil Price Shocks and the Optimality of Monetary Policy," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(1), pages 199-223, January.
    51. Fabio Canova & Luca Gambetti, 2010. "Do Expectations Matter? The Great Moderation Revisited," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 183-205, July.
    52. Taylor, John B., 1993. "Discretion versus policy rules in practice," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 39(1), pages 195-214, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    2. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    3. Valérie Orozco & Christophe Bontemps & Elise Maigné & Virginie Piguet & Annie Hofstetter & Anne Lacroix & Fabrice Levert & Jean‐Marc Rousselle, 2020. "How To Make A Pie: Reproducible Research For Empirical Economics And Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 34(5), pages 1134-1169, December.
    4. Maren Duvendack & Richard Palmer-Jones, 2013. "Replication of quantitative work in development studies: Experiences and suggestions," Progress in Development Studies, , vol. 13(4), pages 307-322, October.
    5. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    6. Mertens, Karel & Ravn, Morten O., 2014. "A reconciliation of SVAR and narrative estimates of tax multipliers," Journal of Monetary Economics, Elsevier, vol. 68(S), pages 1-19.
    7. Virkola, Tuomo, 2014. "Exchange Rate Regime, Fiscal Foresight and the Effectiveness of Fiscal Policy in a Small Open Economy," ETLA Reports 20, The Research Institute of the Finnish Economy.
    8. Alesina, Alberto & Favero, Carlo & Giavazzi, Francesco, 2015. "The output effect of fiscal consolidation plans," Journal of International Economics, Elsevier, vol. 96(S1), pages 19-42.
    9. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics, Canadian Economics Association, vol. 41(4), pages 1406-1420, November.
    10. Klein, Mathias & Linnemann, Ludger, 2019. "Tax and spending shocks in the open economy: Are the deficits twins?," European Economic Review, Elsevier, vol. 120(C).
    11. Reda Cherif & Fuad Hasanov, 2018. "Public debt dynamics: the effects of austerity, inflation, and growth shocks," Empirical Economics, Springer, vol. 54(3), pages 1087-1105, May.
    12. Rüth, Sebastian K. & Simon, Camilla, 2020. "How Do Income and the Debt Position of Households Propagate Public into Private Spending?," Working Papers 0676, University of Heidelberg, Department of Economics.
    13. Klein, Mathias & Linnemann, Ludger, 2019. "Tax and spending shocks in the open economy: are the deficits twins?," Working Paper Series 377, Sveriges Riksbank (Central Bank of Sweden).
    14. Mathias Klein & Ludger Linnemann, 2019. "Tax and Spending Shocks in the Open Economy: Are the Deficits Twins?," Discussion Papers of DIW Berlin 1821, DIW Berlin, German Institute for Economic Research.
    15. Max Breitenlechner & Martin Geiger & Mathias Klein, 2024. "The Fiscal Channel of Monetary Policy," Working Papers 2024-07, Faculty of Economics and Statistics, Universität Innsbruck.
    16. Rüth, Sebastian K. & Simon, Camilla, 2022. "How do income and the debt position of households propagate fiscal stimulus into consumption?," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    17. Giancarlo Corsetti & Michael P. Devereux & Luigi Guiso & John Hassler & Gilles Saint-Paul & Hans-Werner Sinn & Jan-Egbert Sturm & Xavier Vives, 2010. "Chapter 3: From Fiscal Rescue to Global Debt," EEAG Report on the European Economy, CESifo, vol. 0, pages 71-100, February.
    18. Samuel Wills, 2012. "Optimal Monetary Responses to Oil Discoveries," Discussion Papers 1408, Centre for Macroeconomics (CFM), revised Apr 2014.
    19. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    20. Anh D. M. Nguyen & Luisanna Onnis & Raffaele Rossi, 2021. "The Macroeconomic Effects of Income and Consumption Tax Changes," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 439-466, May.

    More about this item

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • E01 - Macroeconomics and Monetary Economics - - General - - - Measurement and Data on National Income and Product Accounts and Wealth; Environmental Accounts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say ”Usually Not” (Critical Finance Review forthcoming) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2015-83. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.