IDEAS home Printed from https://ideas.repec.org/p/fip/fedkrw/rwp06-09.html
   My bibliography  Save this paper

Forecasting of small macroeconomic VARs in the presence of instabilities

Author

Abstract

Small-scale VARs have come to be widely used in macroeconomics, for purposes ranging from forecasting output, prices, and interest rates to modeling expectations formation in theoretical models. However, a body of recent work suggests such VAR models may be prone to instabilities. In the face of such instabilities, a variety of estimation or forecasting methods might be used to improve the accuracy of forecasts from a VAR. These methods include using different approaches to lag selection, observation windows for estimation, (over-) differencing, intercept correction, stochastically time--varying parameters, break dating, discounted least squares, Bayesian shrinkage, detrending of inflation and interest rates, and model averaging. Focusing on simple models of U.S. output, prices, and interest rates, this paper compares the effectiveness of such methods. Our goal is to identify those approaches that, in real time, yield the most accurate forecasts of these variables. We use forecasts from simple univariate time series models, the Survey of Professional Forecasters and the Federal Reserve Board's Greenbook as benchmarks.

Suggested Citation

  • Todd E. Clark & Michael W. McCracken, 2006. "Forecasting of small macroeconomic VARs in the presence of instabilities," Research Working Paper RWP 06-09, Federal Reserve Bank of Kansas City.
  • Handle: RePEc:fip:fedkrw:rwp06-09
    as

    Download full text from publisher

    File URL: https://www.kansascityfed.org/documents/5352/pdf-RWP06-09.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John M. Roberts, 2006. "Monetary Policy and Inflation Dynamics," International Journal of Central Banking, International Journal of Central Banking, vol. 2(3), September.
    2. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    3. Athanasios Orphanides & John C. Williams, 2005. "Inflation scares and forecast-based monetary policy," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 498-527, April.
    4. Gary Koop & Simon M. Potter, 2003. "Forecasting in large macroeconomic panels using Bayesian Model Averaging," Staff Reports 163, Federal Reserve Bank of New York.
    5. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    6. George W. Evans & Seppo Honkapohja, 2005. "Policy Interaction, Expectations and the Liquidity Trap," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 303-323, April.
    7. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    8. Canova, Fabio, 2002. "G-7 Inflation forecasts," Working Paper Series 151, European Central Bank.
    9. Carlo A. Favero & Massimiliano Marcellino, 2005. "Modelling and Forecasting Fiscal Variables for the Euro Area," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 755-783, December.
    10. Kenneth S. Rogoff, 2003. "Globalization and global disinflation," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 77-112.
    11. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    12. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    13. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    14. Sharon Kozicki, 2004. "How do data revisions affect the evaluation and conduct of monetary policy?," Economic Review, Federal Reserve Bank of Kansas City, vol. 89(Q I), pages 5-38.
    15. Hodrick, Robert J & Prescott, Edward C, 1997. "Postwar U.S. Business Cycles: An Empirical Investigation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 29(1), pages 1-16, February.
    16. Geweke, John & Whiteman, Charles, 2006. "Bayesian Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 1, pages 3-80, Elsevier.
    17. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    18. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    19. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
    20. Cogley, Timothy, 2002. "A Simple Adaptive Measure of Core Inflation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 34(1), pages 94-113, February.
    21. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    22. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    23. Kozicki, Sharon & Tinsley, P A, 1998. "Moving Endpoints and the Internal Consistency of Agents' Ex Ante Forecasts," Computational Economics, Springer;Society for Computational Economics, vol. 11(1-2), pages 21-40, April.
    24. Nelson, Charles R & Schwert, G William, 1977. "Short-Term Interest Rates as Predictors of Inflation: On Testing the Hypothesis That the Real Rate of Interest is Constant," American Economic Review, American Economic Association, vol. 67(3), pages 478-486, June.
    25. Glenn Rudebusch & Lars E.O. Svensson, 1999. "Policy Rules for Inflation Targeting," NBER Chapters, in: Monetary Policy Rules, pages 203-262, National Bureau of Economic Research, Inc.
    26. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    27. Croushore, Dean, 2006. "Forecasting with Real-Time Macroeconomic Data," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 17, pages 961-982, Elsevier.
    28. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    29. Sharon Kozicki & Peter A. Tinsley, 2002. "Alternative sources of the lag dynamics of inflation," Research Working Paper RWP 02-12, Federal Reserve Bank of Kansas City.
    30. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    31. Rudebusch, Glenn D, 2005. "Assessing the Lucas Critique in Monetary Policy Models," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(2), pages 245-272, April.
    32. John M. Maheu & Stephen Gordon, 2008. "Learning, forecasting and structural breaks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 553-583.
    33. Sean D. Campbell, 2005. "Stock market volatility and the Great Moderation," Finance and Economics Discussion Series 2005-47, Board of Governors of the Federal Reserve System (U.S.).
    34. Kozicki, Sharon & Tinsley, P. A., 2001. "Shifting endpoints in the term structure of interest rates," Journal of Monetary Economics, Elsevier, vol. 47(3), pages 613-652, June.
    35. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    36. anonymous, 2005. "Financial market risk premiums: time variation and macroeconomic links, Federal Reserve Board, Washington, D.C., July 21-22, 2005," Proceedings, Board of Governors of the Federal Reserve System (U.S.).
    37. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    38. P. Geoffrey Allen & Robert Fildes, 2005. "Levels, Differences and ECMs – Principles for Improved Econometric Forecasting," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 881-904, December.
    39. Jushan Bai, 1997. "Estimation Of A Change Point In Multiple Regression Models," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 551-563, November.
    40. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    41. Timothy Cogley & Thomas J. Sargent, 2002. "Evolving Post-World War II US Inflation Dynamics," NBER Chapters, in: NBER Macroeconomics Annual 2001, Volume 16, pages 331-388, National Bureau of Economic Research, Inc.
    42. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    43. Arturo Estrella & Jeffrey C. Fuhrer, 2003. "Monetary Policy Shifts and the Stability of Monetary Policy Models," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 94-104, February.
    44. Tor Jacobson & Per Jansson & Anders Vredin & Anders Warne, 2001. "Monetary policy analysis and inflation targeting in a small open economy: a VAR approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 487-520.
    45. Clark, Todd E. & McCracken, Michael W., 2006. "The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1127-1148, August.
    46. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
    47. Hallman, Jeffrey J & Porter, Richard D & Small, David H, 1991. "Is the Price Level Tied to the M2 Monetary Aggregate in the Long Run?," American Economic Review, American Economic Association, vol. 81(4), pages 841-858, September.
    48. Yao, Yi-Ching, 1988. "Estimating the number of change-points via Schwarz' criterion," Statistics & Probability Letters, Elsevier, vol. 6(3), pages 181-189, February.
    49. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
    50. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    51. Branch, William A. & Evans, George W., 2006. "A simple recursive forecasting model," Economics Letters, Elsevier, vol. 91(2), pages 158-166, May.
    52. Robertson, John C & Tallman, Ellis W, 2001. "Improving Federal-Funds Rate Forecasts in VAR Models Used for Policy Analysis," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 324-330, July.
    53. John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, vol. 84(Q1), pages 4-18.
    54. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    55. Kozicki, Sharon & Tinsley, P. A., 2001. "Term structure views of monetary policy under alternative models of agent expectations," Journal of Economic Dynamics and Control, Elsevier, vol. 25(1-2), pages 149-184, January.
    56. Peter Tulip, 2005. "Has output become more predictable? changes in Greenbook forecast accuracy," Finance and Economics Discussion Series 2005-31, Board of Governors of the Federal Reserve System (U.S.).
    57. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    58. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    59. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    60. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    61. Keating, John W., 2000. "Macroeconomic Modeling with Asymmetric Vector Autoregressions," Journal of Macroeconomics, Elsevier, vol. 22(1), pages 1-28, January.
    62. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    63. Flint Brayton & Eileen Mauskopf & David L. Reifschneider & Peter A. Tinsley & John Williams, 1997. "The role of expectations in the FRB/US macroeconomic model," Federal Reserve Bulletin, Board of Governors of the Federal Reserve System (U.S.), vol. 83(Apr), pages 227-245, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    2. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    3. Çepni, Oğuzhan & Gül, Selçuk & Hacıhasanoğlu, Yavuz Selim & Yılmaz, Muhammed Hasan, 2020. "Global uncertainties and portfolio flow dynamics of the BRICS countries," Research in International Business and Finance, Elsevier, vol. 54(C).
    4. BRATU SIMIONESCU, Mihaela, 2012. "Two Quantitative Forecasting Methods For Macroeconomic Indicators In Czech Republic," Annals of Spiru Haret University, Economic Series, Universitatea Spiru Haret, vol. 3(1), pages 71-87.
    5. Kocięcki, Andrzej & Kolasa, Marcin & Rubaszek, Michał, 2012. "A Bayesian method of combining judgmental and model-based density forecasts," Economic Modelling, Elsevier, vol. 29(4), pages 1349-1355.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Todd E. Clark & Michael W. McCracken, 2009. "Improving Forecast Accuracy By Combining Recursive And Rolling Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(2), pages 363-395, May.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    6. Clark, Todd E. & McCracken, Michael W., 2006. "The Predictive Content of the Output Gap for Inflation: Resolving In-Sample and Out-of-Sample Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1127-1148, August.
    7. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    8. Yiru Wang & Barbara Rossi, 2019. "VAR-based Granger-causality test in the presence of instabilities," Economics Working Papers 1642, Department of Economics and Business, Universitat Pompeu Fabra.
    9. Barbara Rossi & Yiru Wang, 2019. "Vector autoregressive-based Granger causality test in the presence of instabilities," Stata Journal, StataCorp LP, vol. 19(4), pages 883-899, December.
    10. Colino, Evelyn V. & Irwin, Scott H. & Garcia, Philip, 2008. "How Much Can Outlook Forecasts be Improved? An Application to the U.S. Hog Market," 2008 Conference, April 21-22, 2008, St. Louis, Missouri 37620, NCCC-134 Conference on Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    11. Rangan Gupta & Alain Kabundi & Stephen Miller & Josine Uwilingiye, 2014. "Using large data sets to forecast sectoral employment," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(2), pages 229-264, June.
    12. Öğünç, Fethi & Akdoğan, Kurmaş & Başer, Selen & Chadwick, Meltem Gülenay & Ertuğ, Dilara & Hülagü, Timur & Kösem, Sevim & Özmen, Mustafa Utku & Tekatlı, Necati, 2013. "Short-term inflation forecasting models for Turkey and a forecast combination analysis," Economic Modelling, Elsevier, vol. 33(C), pages 312-325.
    13. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    14. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    15. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    16. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    17. Knut Are Aastveit & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2017. "Have Standard VARS Remained Stable Since the Crisis?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 931-951, August.
    18. Andrejs Bessonovs, 2015. "Suite of Latvia's GDP forecasting models," Working Papers 2015/01, Latvijas Banka.
    19. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    20. Mayr, Johannes, 2010. "Forecasting Macroeconomic Aggregates," Munich Dissertations in Economics 11140, University of Munich, Department of Economics.

    More about this item

    Keywords

    Economic forecasting; time series analysis; Real-time data;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedkrw:rwp06-09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Zach Kastens (email available below). General contact details of provider: https://edirc.repec.org/data/frbkcus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.