IDEAS home Printed from https://ideas.repec.org/a/eee/moneco/v118y2021icp312-330.html
   My bibliography  Save this article

Backtesting global Growth-at-Risk

Author

Listed:
  • Brownlees, Christian
  • Souza, André B.M.

Abstract

We conduct an out-of-sample backtesting exercise of Growth-at-Risk (GaR) predictions for 24 OECD countries. We consider forecasts constructed from quantile regression and GARCH models. The quantile regression forecasts are based on a set of recently proposed measures of downside risks to GDP, including the national financial conditions index. The backtesting results show that quantile regression and GARCH forecasts have a similar performance. If anything, our evidence suggests that standard volatility models such as the GARCH(1,1) are more accurate.

Suggested Citation

  • Brownlees, Christian & Souza, André B.M., 2021. "Backtesting global Growth-at-Risk," Journal of Monetary Economics, Elsevier, vol. 118(C), pages 312-330.
    • Handle: RePEc:eee:moneco:v:118:y:2021:i:c:p:312-330
    DOI: 10.1016/j.jmoneco.2020.11.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304393220301288
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmoneco.2020.11.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mr. Ananthakrishnan Prasad & Mr. Selim A Elekdag & Mr. Phakawa Jeasakul & Romain Lafarguette & Mr. Adrian Alter & Alan Xiaochen Feng & Changchun Wang, 2019. "Growth at Risk: Concept and Application in IMF Country Surveillance," IMF Working Papers 2019/036, International Monetary Fund.
    2. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    3. Jon Faust & Simon Gilchrist & Jonathan H. Wright & Egon Zakrajšsek, 2013. "Credit Spreads as Predictors of Real-Time Economic Activity: A Bayesian Model-Averaging Approach," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1501-1519, December.
    4. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    5. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    6. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    7. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    8. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    9. Christian Brownlees & Robert F. Engle, 2017. "SRISK: A Conditional Capital Shortfall Measure of Systemic Risk," Review of Financial Studies, Society for Financial Studies, vol. 30(1), pages 48-79.
    10. Estrella, Arturo & Hardouvelis, Gikas A, 1991. "The Term Structure as a Predictor of Real Economic Activity," Journal of Finance, American Finance Association, vol. 46(2), pages 555-576, June.
    11. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    12. White, Halbert & Kim, Tae-Hwan & Manganelli, Simone, 2015. "VAR for VaR: Measuring tail dependence using multivariate regression quantiles," Journal of Econometrics, Elsevier, vol. 187(1), pages 169-188.
    13. Tobias Adrian & Federico Grinberg & Nellie Liang & Sheheryar Malik & Jie Yu, 2022. "The Term Structure of Growth-at-Risk," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(3), pages 283-323, July.
    14. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    15. Linda Allen & Turan G. Bali & Yi Tang, 2012. "Does Systemic Risk in the Financial Sector Predict Future Economic Downturns?," Review of Financial Studies, Society for Financial Studies, vol. 25(10), pages 3000-3036.
    16. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    17. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    18. Stijn Claessens & M. Ayhan Kose & Marco E. Terrones, 2009. "What happens during recessions, crunches and busts? [Business cycles for G-7 and European countries]," Economic Policy, CEPR;CES;MSH, vol. 24(60), pages 653-700.
    19. Chavleishvili, Sulkhan & Manganelli, Simone, 2019. "Forecasting and stress testing with quantile vector autoregression," Working Paper Series 2330, European Central Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Demetrescu, Matei & Hosseinkouchack, Mehdi & Rodrigues, Paulo M. M., 2023. "Tests of no cross-sectional error dependence in panel quantile regressions," Ruhr Economic Papers 1041, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    2. Aaron J. Amburgey & Michael W. McCracken, 2023. "On the real‐time predictive content of financial condition indices for growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(2), pages 137-163, March.
    3. Aleksei Kipriyanov, 2022. "Comparison of Models for Growth-at-Risk Forecasting," Russian Journal of Money and Finance, Bank of Russia, vol. 81(1), pages 23-45, March.
    4. Paul Labonne & Leif Anders Thorsrud, 2023. "Risky news and credit market sentiment," Working Papers No 14/2023, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    5. Martin Gachter & Elias Hasler & Florian Huber, 2023. "A tale of two tails: 130 years of growth-at-risk," Papers 2302.08920, arXiv.org.
    6. Martin Gächter & Martin Geiger & Elias Hasler, 2023. "On the Structural Determinants of Growth-at-Risk," International Journal of Central Banking, International Journal of Central Banking, vol. 19(2), pages 251-293, June.
    7. James Mitchell & Aubrey Poon & Dan Zhu, 2022. "Constructing Density Forecasts from Quantile Regressions: Multimodality in Macro-Financial Dynamics," Working Papers 22-12R, Federal Reserve Bank of Cleveland, revised 11 Apr 2023.
    8. Corradi, Valentina & Fosten, Jack & Gutknecht, Daniel, 2023. "Out-of-sample tests for conditional quantile coverage an application to Growth-at-Risk," Journal of Econometrics, Elsevier, vol. 236(2).
    9. Iseringhausen, Martin, 2024. "A time-varying skewness model for Growth-at-Risk," International Journal of Forecasting, Elsevier, vol. 40(1), pages 229-246.
    10. Korobilis, Dimitris & Landau, Bettina & Musso, Alberto & Phella, Anthoulla, 2021. "The time-varying evolution of inflation risks," Working Paper Series 2600, European Central Bank.
    11. Botelho, Vasco & Foroni, Claudia & Renzetti, Andrea, 2023. "Labour at risk," Working Paper Series 2840, European Central Bank.
    12. Matei Demetrescu & Robinson Kruse-Becher, 2021. "Is U.S. real output growth really non-normal? Testing distributional assumptions in time-varying location-scale models," CREATES Research Papers 2021-07, Department of Economics and Business Economics, Aarhus University.
    13. Lang, Jan Hannes & Rusnák, Marek & Greiwe, Moritz, 2023. "Medium-term growth-at-risk in the euro area," Working Paper Series 2808, European Central Bank.
    14. Beutel, Johannes & Emter, Lorenz & Metiu, Norbert & Prieto, Esteban & Schüler, Yves, 2022. "The global financial cycle and macroeconomic tail risks," Discussion Papers 43/2022, Deutsche Bundesbank.
    15. Paulo M.M. Rodrigues & Matei Demetrescu, 2022. "Cross-Sectional Error Dependence in Panel Quantile Regressions," Working Papers w202213, Banco de Portugal, Economics and Research Department.
    16. Suarez, Javier, 2022. "Growth-at-risk and macroprudential policy design," Journal of Financial Stability, Elsevier, vol. 60(C).
    17. Timo Dimitriadis & Yannick Hoga, 2023. "Regressions under Adverse Conditions," Papers 2311.13327, arXiv.org.
    18. Busetti, Fabio & Caivano, Michele & Delle Monache, Davide & Pacella, Claudia, 2021. "The time-varying risk of Italian GDP," Economic Modelling, Elsevier, vol. 101(C).
    19. Stolbov, Mikhail & Shchepeleva, Maria, 2022. "Modeling global real economic activity: Evidence from variable selection across quantiles," The Journal of Economic Asymmetries, Elsevier, vol. 25(C).
    20. Wolf, Elias, 2023. "Estimating Growth at Risk with Skewed Stochastic Volatility Models," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277696, Verein für Socialpolitik / German Economic Association.
    21. Mihail Yanchev, 2022. "Deep Growth-at-Risk Model: Nowcasting the 2020 Pandemic Lockdown Recession in Small Open Economies," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 7, pages 20-41.
    22. Timo Dimitriadis & Yannick Hoga, 2022. "Dynamic CoVaR Modeling," Papers 2206.14275, arXiv.org, revised Feb 2024.
    23. Jack Fosten & Daniel Gutknecht & Marc-Oliver Pohle, 2023. "Testing Quantile Forecast Optimality," Papers 2302.02747, arXiv.org, revised Oct 2023.
    24. Sulkhan Chavleishvili & Simone Manganelli, 2024. "Forecasting and stress testing with quantile vector autoregression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 66-85, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diks, Cees & Fang, Hao, 2020. "Comparing density forecasts in a risk management context," International Journal of Forecasting, Elsevier, vol. 36(2), pages 531-551.
    2. Iseringhausen, Martin, 2024. "A time-varying skewness model for Growth-at-Risk," International Journal of Forecasting, Elsevier, vol. 40(1), pages 229-246.
    3. Giglio, Stefano & Kelly, Bryan & Pruitt, Seth, 2016. "Systemic risk and the macroeconomy: An empirical evaluation," Journal of Financial Economics, Elsevier, vol. 119(3), pages 457-471.
    4. Niango Ange Joseph Yapi, 2020. "Exchange rate predictive densities and currency risks: A quantile regression approach," EconomiX Working Papers 2020-16, University of Paris Nanterre, EconomiX.
    5. Timo Dimitriadis & Yannick Hoga, 2023. "Regressions under Adverse Conditions," Papers 2311.13327, arXiv.org.
    6. František Čech & Jozef Baruník, 2019. "Panel quantile regressions for estimating and predicting the value‐at‐risk of commodities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 39(9), pages 1167-1189, September.
    7. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    8. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    9. Hua, Jian & Manzan, Sebastiano, 2013. "Forecasting the return distribution using high-frequency volatility measures," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4381-4403.
    10. Bonaccolto, Giovanni & Caporin, Massimiliano & Paterlini, Sandra, 2019. "Decomposing and backtesting a flexible specification for CoVaR," Journal of Banking & Finance, Elsevier, vol. 108(C).
    11. Leopoldo Catania & Alessandra Luati & Pierluigi Vallarino, 2021. "Economic vulnerability is state dependent," CREATES Research Papers 2021-09, Department of Economics and Business Economics, Aarhus University.
    12. Laura Garcia-Jorcano & Lidia Sanchis-Marco, 2023. "Measuring Systemic Risk Using Multivariate Quantile-Located ES Models," Journal of Financial Econometrics, Oxford University Press, vol. 21(1), pages 1-72.
    13. Schüler, Yves S., 2020. "The impact of uncertainty and certainty shocks," Discussion Papers 14/2020, Deutsche Bundesbank.
    14. Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel R. Smith, 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 150-160, January.
    15. Busetti, Fabio & Caivano, Michele & Delle Monache, Davide & Pacella, Claudia, 2021. "The time-varying risk of Italian GDP," Economic Modelling, Elsevier, vol. 101(C).
    16. Gourieroux, C. & Jasiak, J., 2008. "Dynamic quantile models," Journal of Econometrics, Elsevier, vol. 147(1), pages 198-205, November.
    17. Clancy, Daragh & Gabriele, Carmine & Žigraiová, Diana, 2022. "Sovereign bond market spillovers from crisis-time developments in Greece," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 78(C).
    18. Angelica Gianfreda & Derek Bunn, 2018. "A Stochastic Latent Moment Model for Electricity Price Formation," BEMPS - Bozen Economics & Management Paper Series BEMPS46, Faculty of Economics and Management at the Free University of Bozen.
    19. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    20. Xu, Yan & Wang, Xinyu & Liu, Hening, 2021. "Quantile-based GARCH-MIDAS: Estimating value-at-risk using mixed-frequency information," Finance Research Letters, Elsevier, vol. 43(C).

    More about this item

    Keywords

    Growth-at-Risk; Backtesting; Quantile regression; GARCH;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:moneco:v:118:y:2021:i:c:p:312-330. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505566 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.