IDEAS home Printed from https://ideas.repec.org/p/bog/wpaper/203.html
   My bibliography  Save this paper

Credit risk stress testing for EU15 banks: a model combination approach

Author

Listed:
  • George Papadopoulos

    (Democritus University of Thrace)

  • Savas Papadopoulos

    (Bank of Greece)

  • Thomas Sager

    (University of Texas)

Abstract

In bank stress tests, the role of a satellite model is to tie bank-specific risk variables to macroeconomic variables that can generate stress. For valid stress tests it is important to develop a comprehensive satellite model that both preserves the sense of known economic relationships and also exhibits high predictive ability. However, it is often difficult to achieve these desiderata in a single satellite model. Multicollinearity of key macro variables and limited data may militate against inclusion of all important stress variables, thus limiting the range of stress scenarios. In order to address this problem we depart from the custom of using a single model as the "true" satellite. Instead, we generate a full space of candidate models that we then screen for reasonable candidates that remain sufficiently rich to cover a wide range of stress scenarios. We then develop composite models by combining the surviving candidate models through weighting. The result is a composite satellite model that includes all the desired macroeconomic variables, reflects the expected relationships with the dependent variable (NPL growth) and exhibits more than 20% lower RMSE compared to a commonly used benchmark model. An illustrative stress testing application shows that this approach can provide policy makers with prudent estimates of credit risk.

Suggested Citation

  • George Papadopoulos & Savas Papadopoulos & Thomas Sager, 2016. "Credit risk stress testing for EU15 banks: a model combination approach," Working Papers 203, Bank of Greece.
  • Handle: RePEc:bog:wpaper:203
    as

    Download full text from publisher

    File URL: http://www.bankofgreece.gr/BogEkdoseis/Paper2016203.pdf
    File Function: Full Text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Perotti, Roberto, 1996. "Fiscal Consolidation in Europe: Composition Matters," American Economic Review, American Economic Association, vol. 86(2), pages 105-110, May.
    2. Hilde C. Bjørnland & Karsten Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2012. "Does Forecast Combination Improve Norges Bank Inflation Forecasts?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 163-179, April.
    3. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," LIDAM Discussion Papers CORE 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Antonella Foglia, 2009. "Stress Testing Credit Risk: A Survey of Authorities' Aproaches," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 9-45, September.
    5. Gabriel Jiménez & Jesús Saurina, 2006. "Credit Cycles, Credit Risk, and Prudential Regulation," International Journal of Central Banking, International Journal of Central Banking, vol. 2(2), May.
    6. Mr. Paul Louis Ceriel Hilbers & Mr. Matthew T Jones & Mr. Graham L Slack, 2004. "Stress Testing Financial Systems: What to Do When the Governor Calls," IMF Working Papers 2004/127, International Monetary Fund.
    7. Del Negro, Marco & Hasegawa, Raiden B. & Schorfheide, Frank, 2016. "Dynamic prediction pools: An investigation of financial frictions and forecasting performance," Journal of Econometrics, Elsevier, vol. 192(2), pages 391-405.
    8. Buncic, Daniel & Melecky, Martin, 2013. "Macroprudential stress testing of credit risk: A practical approach for policy makers," Journal of Financial Stability, Elsevier, vol. 9(3), pages 347-370.
    9. Gross, Marco & Población García, Francisco Javier, 2015. "A false sense of security in applying handpicked equations for stress test purposes," Working Paper Series 1845, European Central Bank.
    10. Granger, Clive W. J. & Jeon, Yongil, 2004. "Thick modeling," Economic Modelling, Elsevier, vol. 21(2), pages 323-343, March.
    11. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    12. Melecky, Martin & Podpiera, Anca Maria, 2010. "Macroprudential stress-testing practices of central banks in central and south eastern Europe : an overview and challenges ahead," Policy Research Working Paper Series 5434, The World Bank.
    13. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    14. Louzis, Dimitrios P. & Vouldis, Angelos T. & Metaxas, Vasilios L., 2012. "Macroeconomic and bank-specific determinants of non-performing loans in Greece: A comparative study of mortgage, business and consumer loan portfolios," Journal of Banking & Finance, Elsevier, vol. 36(4), pages 1012-1027.
    15. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    16. Carmen M. Reinhart & Kenneth S. Rogoff, 2011. "From Financial Crash to Debt Crisis," American Economic Review, American Economic Association, vol. 101(5), pages 1676-1706, August.
    17. Marco Aiolfi & Carlo Ambrogio Favero, "undated". "Model Uncertainty, Thick Modelling and the predictability of Stock Returns," Working Papers 221, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    18. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    19. Quagliariello,Mario (ed.), 2009. "Stress-testing the Banking System," Cambridge Books, Cambridge University Press, number 9780521767309.
    20. John Geweke & Gianni Amisano, 2012. "Prediction with Misspecified Models," American Economic Review, American Economic Association, vol. 102(3), pages 482-486, May.
    21. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    22. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    23. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    24. Vazquez, Francisco & Tabak, Benjamin M. & Souto, Marcos, 2012. "A macro stress test model of credit risk for the Brazilian banking sector," Journal of Financial Stability, Elsevier, vol. 8(2), pages 69-83.
    25. Gabriele Galati & Richhild Moessner, 2013. "Macroprudential Policy – A Literature Review," Journal of Economic Surveys, Wiley Blackwell, vol. 27(5), pages 846-878, December.
    26. Henry, Jérôme & Zimmermann, Maik & Leber, Miha & Kolb, Markus & Grodzicki, Maciej & Amzallag, Adrien & Vouldis, Angelos & Hałaj, Grzegorz & Pancaro, Cosimo & Gross, Marco & Baudino, Patrizia & Sydow, , 2013. "A macro stress testing framework for assessing systemic risks in the banking sector," Occasional Paper Series 152, European Central Bank.
    27. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
    28. Andreas Jobst & Ms. Li L Ong & Mr. Christian Schmieder, 2013. "A Framework for Macroprudential Bank Solvency Stress Testing: Application to S-25 and Other G-20 Country FSAPs," IMF Working Papers 2013/068, International Monetary Fund.
    29. repec:onb:oenbwp:y:2002:i:3:b:3 is not listed on IDEAS
    30. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258.
    31. Claudio Borio, 2010. "Ten propositions about liquidity crises," CESifo Economic Studies, CESifo, vol. 56(1), pages 70-95, March.
    32. Mr. Daniel C Hardy & Mr. Christian Schmieder, 2013. "Rules of Thumb for Bank Solvency Stress Testing," IMF Working Papers 2013/232, International Monetary Fund.
    33. Harvir Kalirai & Martin Scheicher, 2002. "Macroeconomic Stress Testing: Preliminary Evidence for Austria," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 3, pages 58-74.
    34. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    35. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    36. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    37. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    38. Petr Jakubik & Christian Schmieder, 2008. "Stress Testing Credit Risk: Is the Czech Republic Different from Germany?," Working Papers 2008/9, Czech National Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Szybisz, Martin Andres, 2018. "Banking net income and macroeconomics, from multicollinearity to Granger causality using US data," MPRA Paper 90473, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Georgios Papadopoulos & Dionysios Chionis & Nikolaos P. Rachaniotis, 2018. "Macro-financial linkages during tranquil and crisis periods: evidence from stressed economies," Risk Management, Palgrave Macmillan, vol. 20(2), pages 142-166, May.
    2. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    3. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    4. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    5. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    6. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    7. Patrick Van Roy & Stijn Ferrari & Cristina Vespro, 2018. "Sensitivity of credit risk stress test results: Modelling issues with an application to Belgium," Working Paper Research 338, National Bank of Belgium.
    8. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    9. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    10. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    11. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    12. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    13. Karsten R. Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2009. "Evaluating ensemble density combination - forecasting GDP and inflation," Working Paper 2009/19, Norges Bank.
    14. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    15. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    16. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    17. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    18. Tumala, Mohammed M & Olubusoye, Olusanya E & Yaaba, Baba N & Yaya, OlaOluwa S & Akanbi, Olawale B, 2017. "Forecasting Nigerian Inflation using Model Averaging methods: Modelling Frameworks to Central Banks," MPRA Paper 88754, University Library of Munich, Germany, revised Feb 2018.
    19. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    20. Busch, Ramona & Koziol, Philipp & Mitrovic, Marc, 2015. "Many a little makes a mickle: Macro portfolio stress test for small and medium-sized German banks," Discussion Papers 23/2015, Deutsche Bundesbank.

    More about this item

    Keywords

    Financial stability; Macroprudential policy; Non-performing loans; Forecast combination; Predictive modelling;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bog:wpaper:203. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anastasios Rizos (email available below). General contact details of provider: https://edirc.repec.org/data/boggvgr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.