IDEAS home Printed from https://ideas.repec.org/a/eee/jmacro/v53y2017icp57-70.html
   My bibliography  Save this article

Indeterminate forecast accuracy under indeterminacy

Author

Listed:
  • Fanelli, Luca
  • Sorge, Marco M.

Abstract

This paper studies whether the observed time variation in the forecast accuracy of macro-econometric models can be reconciled with the monetary policy stance that induces (in)determinacy in stylized DSGE models. Using a small-scale New Keynesian monetary framework as laboratory and structural parameters calibrated to the estimates obtained on U.S. data from different macroeconomics regimes, we exploit reduced-form econometric models – such as Vector Autoregressions – to assess their regime-specific forecastability. We show that conducting (pseudo) out-of-sample forecast comparisons in the presence of indeterminacy is a non-trivial exercise, even when sunspot shocks play no role in generating the data. Overall, our simulation experiment suggests that equilibrium indeterminacy need not lead to superior (absolute or relative) forecast accuracy. This finding challenges the view that the deteriorating performance of forecast models over the Great Moderation relative to the Great Inflation was entirely due to changes in the U.S. monetary policy.

Suggested Citation

  • Fanelli, Luca & Sorge, Marco M., 2017. "Indeterminate forecast accuracy under indeterminacy," Journal of Macroeconomics, Elsevier, vol. 53(C), pages 57-70.
  • Handle: RePEc:eee:jmacro:v:53:y:2017:i:c:p:57-70
    DOI: 10.1016/j.jmacro.2017.05.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0164070416302397
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmacro.2017.05.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    3. Jeff Fuhrer & George Moore, 1995. "Inflation Persistence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 127-159.
    4. Luca Benati & Paolo Surico, 2008. "Evolving U.S. Monetary Policy and The Decline of Inflation Predictability," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 634-646, 04-05.
    5. Kascha, Christian & Mertens, Karel, 2009. "Business cycle analysis and VARMA models," Journal of Economic Dynamics and Control, Elsevier, vol. 33(2), pages 267-282, February.
    6. Thomas A. Lubik & Frank Schorfheide, 2004. "Testing for Indeterminacy: An Application to U.S. Monetary Policy," American Economic Review, American Economic Association, vol. 94(1), pages 190-217, March.
    7. Ivana Komunjer & Serena Ng, 2011. "Dynamic Identification of Dynamic Stochastic General Equilibrium Models," Econometrica, Econometric Society, vol. 79(6), pages 1995-2032, November.
    8. Lucia Alessi & Matteo Barigozzi & Marco Capasso, 2011. "Non‐Fundamentalness in Structural Econometric Models: A Review," International Statistical Review, International Statistical Institute, vol. 79(1), pages 16-47, April.
    9. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    10. Lubik, Thomas A. & Schorfheide, Frank, 2003. "Computing sunspot equilibria in linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 28(2), pages 273-285, November.
    11. Luca Benati, 2008. "Investigating Inflation Persistence Across Monetary Regimes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 1005-1060.
    12. Efrem Castelnuovo & Luca Fanelli, 2015. "Monetary Policy Indeterminacy and Identification Failures in the U.S.: Results from A Robust Test," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 924-947, September.
    13. Herbst, Edward & Schorfheide, Frank, 2012. "Evaluating DSGE model forecasts of comovements," Journal of Econometrics, Elsevier, vol. 171(2), pages 152-166.
    14. Ippei Fujiwara & Yasuo Hirose, 2014. "Indeterminacy and Forecastability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(1), pages 243-251, February.
    15. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    16. Luca Benati & Paolo Surico, 2009. "VAR Analysis and the Great Moderation," American Economic Review, American Economic Association, vol. 99(4), pages 1636-1652, September.
    17. Fanelli, Luca, 2012. "Determinacy, indeterminacy and dynamic misspecification in linear rational expectations models," Journal of Econometrics, Elsevier, vol. 170(1), pages 153-163.
    18. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    19. Raffaella Giacomini, 2015. "Economic theory and forecasting: lessons from the literature," Econometrics Journal, Royal Economic Society, vol. 18(2), pages 22-41, June.
    20. Koop, Gary & Pesaran, M. Hashem & Potter, Simon M., 1996. "Impulse response analysis in nonlinear multivariate models," Journal of Econometrics, Elsevier, vol. 74(1), pages 119-147, September.
    21. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    22. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    23. James H. Stock & Mark W. Watson, 2003. "Has the Business Cycle Changed and Why?," NBER Chapters, in: NBER Macroeconomics Annual 2002, Volume 17, pages 159-230, National Bureau of Economic Research, Inc.
    24. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    25. Fabio Canova & Luca Gambetti, 2010. "Do Expectations Matter? The Great Moderation Revisited," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 183-205, July.
    26. Efrem Castelnuovo & Paolo Surico, 2010. "Monetary Policy, Inflation Expectations and The Price Puzzle," Economic Journal, Royal Economic Society, vol. 120(549), pages 1262-1283, December.
    27. Farmer, Roger E.A. & Khramov, Vadim & Nicolò, Giovanni, 2015. "Solving and estimating indeterminate DSGE models," Journal of Economic Dynamics and Control, Elsevier, vol. 54(C), pages 17-36.
    28. Fanelli, Luca & Paruolo, Paolo, 2010. "Speed of adjustment in cointegrated systems," Journal of Econometrics, Elsevier, vol. 158(1), pages 130-141, September.
    29. Fuhrer, Jeffrey C., 2010. "Inflation Persistence," Handbook of Monetary Economics, in: Benjamin M. Friedman & Michael Woodford (ed.), Handbook of Monetary Economics, edition 1, volume 3, chapter 9, pages 423-486, Elsevier.
    30. Pivetta, Frederic & Reis, Ricardo, 2007. "The persistence of inflation in the United States," Journal of Economic Dynamics and Control, Elsevier, vol. 31(4), pages 1326-1358, April.
    31. Timothy Cogley & Giorgio E. Primiceri & Thomas J. Sargent, 2010. "Inflation-Gap Persistence in the US," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(1), pages 43-69, January.
    32. Sorge, Marco M., 2012. "News shocks or parametric indeterminacy? An observational equivalence result in linear rational expectations models," Economics Letters, Elsevier, vol. 114(2), pages 198-200.
    33. Jean Boivin & Marc P. Giannoni, 2006. "Has Monetary Policy Become More Effective?," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 445-462, August.
    34. Antonello D'Agostino & Paolo Surico, 2012. "A Century of Inflation Forecasts," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1097-1106, November.
    35. Binder,M. & Pesaran,H.M., 1995. "Multivariate Rational Expectations Models and Macroeconomic Modelling: A Review and Some New Results," Cambridge Working Papers in Economics 9415, Faculty of Economics, University of Cambridge.
    36. Laurence Broze & Ariane Szafarz, 1991. "The Econometric Analysis of Non-Uniqueness in Rational Expectations Models," ULB Institutional Repository 2013/649, ULB -- Universite Libre de Bruxelles.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chin, Kuo-Hsuan & Li, Xue, 2019. "Bayesian forecast combination in VAR-DSGE models," Journal of Macroeconomics, Elsevier, vol. 59(C), pages 278-298.
    2. Angelini, Giovanni & Sorge, Marco M., 2021. "Under the same (Chole)sky: DNK models, timing restrictions and recursive identification of monetary policy shocks," Journal of Economic Dynamics and Control, Elsevier, vol. 133(C).
    3. Marco M. Sorge, 2020. "Arbitrary initial conditions and the dimension of indeterminacy in linear rational expectations models," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(1), pages 363-372, June.
    4. Kuo‐Hsuan Chin, 2022. "Inflation persistence and monetary policy: DSGE‐VAR approach," Manchester School, University of Manchester, vol. 90(6), pages 715-729, December.
    5. Sorge, Marco M., 2021. "Stabilizing Taylor rules and determinacy under unit root supply shocks: A re-examination," Journal of Macroeconomics, Elsevier, vol. 68(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luca Fanelli & Marco M. Sorge, 2015. "Indeterminacy, Misspecification and Forecastability: Good Luck in Bad Policy?," CSEF Working Papers 402, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    2. Baele, Lieven & Bekaert, Geert & Cho, Seonghoon & Inghelbrecht, Koen & Moreno, Antonio, 2015. "Macroeconomic regimes," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 51-71.
    3. Qazi Haque, 2022. "Monetary Policy, Inflation Target, and the Great Moderation: An Empirical Investigation," International Journal of Central Banking, International Journal of Central Banking, vol. 18(4), pages 1-52, October.
    4. Angelini, Giovanni & Sorge, Marco M., 2021. "Under the same (Chole)sky: DNK models, timing restrictions and recursive identification of monetary policy shocks," Journal of Economic Dynamics and Control, Elsevier, vol. 133(C).
    5. Castelnuovo, Efrem, 2013. "Monetary policy shocks and financial conditions: A Monte Carlo experiment," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 282-303.
    6. Chin, Kuo-Hsuan & Li, Xue, 2019. "Bayesian forecast combination in VAR-DSGE models," Journal of Macroeconomics, Elsevier, vol. 59(C), pages 278-298.
    7. Ascari, Guido & Castelnuovo, Efrem & Rossi, Lorenza, 2011. "Calvo vs. Rotemberg in a trend inflation world: An empirical investigation," Journal of Economic Dynamics and Control, Elsevier, vol. 35(11), pages 1852-1867.
    8. Qazi Haque, 2017. "Monetary Policy, Target Inflation and the Great Moderation: An Empirical Investigation," School of Economics and Public Policy Working Papers 2017-10, University of Adelaide, School of Economics and Public Policy.
    9. Dave, Chetan & Sorge, Marco M., 2021. "Equilibrium indeterminacy and sunspot tales," European Economic Review, Elsevier, vol. 140(C).
    10. Castelnuovo, Efrem, 2016. "Modest macroeconomic effects of monetary policy shocks during the great moderation: An alternative interpretation," Journal of Macroeconomics, Elsevier, vol. 47(PB), pages 300-314.
    11. Sorge, Marco M., 2021. "Stabilizing Taylor rules and determinacy under unit root supply shocks: A re-examination," Journal of Macroeconomics, Elsevier, vol. 68(C).
    12. Granville, Brigitte & Zeng, Ning, 2019. "Time variation in inflation persistence: New evidence from modelling US inflation," Economic Modelling, Elsevier, vol. 81(C), pages 30-39.
    13. Castelnuovo, Efrem, 2010. "Trend inflation and macroeconomic volatilities in the post-WWII U.S. economy," The North American Journal of Economics and Finance, Elsevier, vol. 21(1), pages 19-33, March.
    14. Kevin Lansing, 2009. "Time Varying U.S. Inflation Dynamics and the New Keynesian Phillips Curve," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 12(2), pages 304-326, April.
    15. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    16. Baumeister, Christiane & Liu, Philip & Mumtaz, Haroon, 2013. "Changes in the effects of monetary policy on disaggregate price dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 37(3), pages 543-560.
    17. Haque, Qazi & Groshenny, Nicolas & Weder, Mark, 2021. "Do we really know that U.S. monetary policy was destabilizing in the 1970s?," European Economic Review, Elsevier, vol. 131(C).
    18. Franke, Reiner & Jang, Tae-Seok & Sacht, Stephen, 2015. "Moment matching versus Bayesian estimation: Backward-looking behaviour in a New-Keynesian baseline model," The North American Journal of Economics and Finance, Elsevier, vol. 31(C), pages 126-154.
    19. Takushi Kurozumi & Willem Van Zandweghe, 2023. "A Theory of Intrinsic Inflation Persistence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 55(8), pages 1961-2000, December.
    20. Luca Benati, 2008. "Investigating Inflation Persistence Across Monetary Regimes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 1005-1060.

    More about this item

    Keywords

    DSGE; Forecasting; Indeterminacy; VAR system;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmacro:v:53:y:2017:i:c:p:57-70. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622617 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.