IDEAS home Printed from https://ideas.repec.org/p/een/camaaa/2018-25.html
   My bibliography  Save this paper

How sensitive are VAR forecasts to prior hyperparameters? An automated sensitivity analysis

Author

Listed:
  • Joshua C.C. Chan
  • Liana Jacobi
  • Dan Zhu

Abstract

Vector autoregressions combined with Minnesota-type priors are widely used for macroeconomic forecasting. The fact that strong but sensible priors can substantially improve forecast performance implies VAR forecasts are sensitive to prior hyperparameters. But the nature of this sensitivity is seldom investigated. We develop a general method based on Automatic Differentiation to systematically compute the sensitivities of forecasts—both points and intervals—with respect to any prior hyperparameters. In a forecasting exercise using US data, we find that forecasts are relatively sensitive to the strength of shrinkage for the VAR coefficients, but they are not much affected by the prior mean of the error covariance matrix or the strength of shrinkage for the intercepts.

Suggested Citation

  • Joshua C.C. Chan & Liana Jacobi & Dan Zhu, 2018. "How sensitive are VAR forecasts to prior hyperparameters? An automated sensitivity analysis," CAMA Working Papers 2018-25, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
  • Handle: RePEc:een:camaaa:2018-25
    as

    Download full text from publisher

    File URL: https://cama.crawford.anu.edu.au/sites/default/files/publication/cama_crawford_anu_edu_au/2018-05/25_2018_chan_jacobi_zhu.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Congressional Budget Office, 2018. "The Budget and Economic Outlook: 2018 to 2028," Reports 53651, Congressional Budget Office.
    2. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    3. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    4. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    5. Gary M. Koop, 2013. "Forecasting with Medium and Large Bayesian VARS," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 177-203, March.
    6. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    7. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    8. Cross, Jamie & Poon, Aubrey, 2016. "Forecasting structural change and fat-tailed events in Australian macroeconomic variables," Economic Modelling, Elsevier, vol. 58(C), pages 34-51.
    9. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    10. L. Jeff Hong, 2009. "Estimating Quantile Sensitivities," Operations Research, INFORMS, vol. 57(1), pages 118-130, February.
    11. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    12. Joshua C. C. Chan, 2020. "Large Bayesian VARs: A Flexible Kronecker Error Covariance Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 68-79, January.
    13. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    14. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
    15. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    16. Michael C. Fu & L. Jeff Hong & Jian-Qiang Hu, 2009. "Conditional Monte Carlo Estimation of Quantile Sensitivities," Management Science, INFORMS, vol. 55(12), pages 2019-2027, December.
    17. Poirier, Dale J, 1988. "Frequentist and Subjectivist Perspectives on the Problems of Model Building in Economics," Journal of Economic Perspectives, American Economic Association, vol. 2(1), pages 121-144, Winter.
    18. Kadiyala, K Rao & Karlsson, Sune, 1997. "Numerical Methods for Estimation and Inference in Bayesian VAR-Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(2), pages 99-132, March-Apr.
    19. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    20. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    21. Magnus, J.R. & Neudecker, H., 1979. "The commutation matrix : Some properties and applications," Other publications TiSEM d0b1e779-7795-4676-ac98-1, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2020. "Efficient selection of hyperparameters in large Bayesian VARs using automatic differentiation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 934-943, September.
    2. Zhongdong Yu & Wei Liu & Liming Chen & Serkan Eti & Hasan Dinçer & Serhat Yüksel, 2019. "The Effects of Electricity Production on Industrial Development and Sustainable Economic Growth: A VAR Analysis for BRICS Countries," Sustainability, MDPI, vol. 11(21), pages 1-13, October.
    3. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2022. "An automated prior robustness analysis in Bayesian model comparison," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 583-602, April.
    4. Cross, Jamie L. & Hou, Chenghan & Poon, Aubrey, 2020. "Macroeconomic forecasting with large Bayesian VARs: Global-local priors and the illusion of sparsity," International Journal of Forecasting, Elsevier, vol. 36(3), pages 899-915.
    5. Jamie L. Cross & Chenghan Hou & Gary Koop, 2021. "Macroeconomic Forecasting with Large Stochastic Volatility in Mean VARs," Working Papers No 04/2021, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua C. C. Chan, 2019. "Large Bayesian vector autoregressions," CAMA Working Papers 2019-19, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    2. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2022. "An automated prior robustness analysis in Bayesian model comparison," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 583-602, April.
    3. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    4. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    5. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Large Vector Autoregressions with Stochastic Volatility and Flexible Priors," Working Papers (Old Series) 1617, Federal Reserve Bank of Cleveland.
    6. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano, 2019. "Large Bayesian vector autoregressions with stochastic volatility and non-conjugate priors," Journal of Econometrics, Elsevier, vol. 212(1), pages 137-154.
    7. Joshua C. C. Chan, 2022. "Asymmetric conjugate priors for large Bayesian VARs," Quantitative Economics, Econometric Society, vol. 13(3), pages 1145-1169, July.
    8. Carriero, Andrea & Mumtaz, Haroon & Theophilopoulou, Angeliki, 2015. "Macroeconomic information, structural change, and the prediction of fiscal aggregates," International Journal of Forecasting, Elsevier, vol. 31(2), pages 325-348.
    9. Knut Are Aastveit & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2017. "Have Standard VARS Remained Stable Since the Crisis?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 931-951, August.
    10. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2020. "Efficient selection of hyperparameters in large Bayesian VARs using automatic differentiation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 934-943, September.
    11. Chan, Joshua C.C. & Yu, Xuewen, 2022. "Fast and Accurate Variational Inference for Large Bayesian VARs with Stochastic Volatility," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    12. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Large Vector Autoregressions with Asymmetric Priors," Working Papers 759, Queen Mary University of London, School of Economics and Finance.
    13. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    14. Chan, Joshua C.C., 2023. "Comparing stochastic volatility specifications for large Bayesian VARs," Journal of Econometrics, Elsevier, vol. 235(2), pages 1419-1446.
    15. Florian Huber & Tamás Krisztin & Philipp Piribauer, 2017. "Forecasting Global Equity Indices Using Large Bayesian Vars," Bulletin of Economic Research, Wiley Blackwell, vol. 69(3), pages 288-308, July.
    16. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    17. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    18. Karlsson, Sune & Mazur, Stepan & Nguyen, Hoang, 2023. "Vector autoregression models with skewness and heavy tails," Journal of Economic Dynamics and Control, Elsevier, vol. 146(C).
    19. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    20. Joshua Chan, 2023. "BVARs and Stochastic Volatility," Papers 2310.14438, arXiv.org.

    More about this item

    Keywords

    vector autoregression; automatic differentiation; interval forecasts;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:een:camaaa:2018-25. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cama Admin (email available below). General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.