IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/94779.html
   My bibliography  Save this paper

Bank Net Interest Margin Forecasting and Capital Adequacy Stress Testing by Machine Learning Techniques

Author

Listed:
  • Brummelhuis, Raymond
  • Luo, Zhongmin

Abstract

The 2007-09 financial crisis revealed that the investors in the financial market were more concerned about the future as opposed to the current capital adequacy for banks. Stress testing promises to complement the regulatory capital adequacy regimes, which assess a bank's current capital adequacy, with the ability to assess its future capital adequacy based on the projected asset-losses and incomes from the forecasting models from regulators and banks. The effectiveness of stress-test rests on its ability to inform the financial market, which depends on whether or not the market has confidence in the model-projected asset-losses and incomes for banks. Post-crisis studies found that the stress-test results are uninformative and receive insignificant market reactions; others question its validity on the grounds of the poor forecast accuracy using linear regression models which forecast the banking-industry incomes measured by Aggregate Net Interest Margin. Instead, our study focuses on NIM forecasting at an individual bank's level and employs both linear regression and non-linear Machine Learning techniques. First, we present both the linear and non-linear Machine Learning regression techniques used in our study. Then, based on out-of-sample tests and literature-recommended forecasting techniques, we compare the NIM forecast accuracy by 162 models based on 11 different regression techniques, finding that some Machine Learning techniques as well as some linear ones can achieve significantly higher accuracy than the random-walk benchmark, which invalidates the grounds used by the literature to challenge the validity of stress-test. Last, our results from forecast accuracy comparisons are either consistent with or complement those from existing forecasting literature. We believe that the paper is the first systematic study on forecasting bank-specific NIM by Machine Learning Techniques; also, it is a first systematic study on forecast accuracy comparison including both linear and non-linear Machine Learning techniques using financial data for a critical real-world problem; it is a multi-step forecasting example involving iterative forecasting, rolling-origins, recalibration with forecast accuracy measure being scale-independent; robust regression proved to be beneficial for forecasting in presence of outliers. It concludes with policy suggestions and future research directions.

Suggested Citation

  • Brummelhuis, Raymond & Luo, Zhongmin, 2019. "Bank Net Interest Margin Forecasting and Capital Adequacy Stress Testing by Machine Learning Techniques," MPRA Paper 94779, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:94779
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/94779/1/MPRA_paper_94779.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    2. Covas, Francisco B. & Rump, Ben & Zakrajšek, Egon, 2014. "Stress-testing US bank holding companies: A dynamic panel quantile regression approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 691-713.
    3. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    4. Kilian, Lutz & Taylor, Mark P., 2003. "Why is it so difficult to beat the random walk forecast of exchange rates?," Journal of International Economics, Elsevier, vol. 60(1), pages 85-107, May.
    5. Nesreen Ahmed & Amir Atiya & Neamat El Gayar & Hisham El-Shishiny, 2010. "An Empirical Comparison of Machine Learning Models for Time Series Forecasting," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 594-621.
    6. Sarno,Lucio & Taylor,Mark P., 2003. "The Economics of Exchange Rates," Cambridge Books, Cambridge University Press, number 9780521485845.
    7. Chao Chen & Jamie Twycross & Jonathan M Garibaldi, 2017. "A new accuracy measure based on bounded relative error for time series forecasting," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-23, March.
    8. Brummelhuis, Raymond & Luo, Zhongmin, 2018. "Arbitrage Opportunities in CDS Term Structure: Theory and Implications for OTC Derivatives," MPRA Paper 94778, University Library of Munich, Germany.
    9. Raymond Brummelhuis & Zhongmin Luo, 2018. "Arbitrage Opportunities in CDS Term Structure: Theory and Implications for OTC Derivatives," Papers 1811.08038, arXiv.org, revised Dec 2018.
    10. Schuermann, Til, 2014. "Stress testing banks," International Journal of Forecasting, Elsevier, vol. 30(3), pages 717-728.
    11. Antje Berndt & Rohan Douglas & Darrell Duffie & Mark Ferguson, "undated". "Measuring Default Risk Premia from Default Swap Rates and EDFs," GSIA Working Papers 2006-E31, Carnegie Mellon University, Tepper School of Business.
    12. Acharya, Viral & Engle, Robert & Pierret, Diane, 2014. "Testing macroprudential stress tests: The risk of regulatory risk weights," Journal of Monetary Economics, Elsevier, vol. 65(C), pages 36-53.
    13. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    14. Luca Guerrieri & Michelle Welch, 2012. "Can macro variables used in stress testing forecast the performance of banks?," Finance and Economics Discussion Series 2012-49, Board of Governors of the Federal Reserve System (U.S.).
    15. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    16. Kupiec, Paul H., 2018. "On the accuracy of alternative approaches for calibrating bank stress test models," Journal of Financial Stability, Elsevier, vol. 38(C), pages 132-146.
    17. Hirtle, Beverly & Kovner, Anna & Vickery, James & Bhanot, Meru, 2016. "Assessing financial stability: The Capital and Loss Assessment under Stress Scenarios (CLASS) model," Journal of Banking & Finance, Elsevier, vol. 69(S1), pages 35-55.
    18. Ho, Thomas S. Y. & Saunders, Anthony, 1981. "The Determinants of Bank Interest Margins: Theory and Empirical Evidence," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 16(4), pages 581-600, November.
    19. Alexander J. McNeil & Rüdiger Frey & Paul Embrechts, 2015. "Quantitative Risk Management: Concepts, Techniques and Tools Revised edition," Economics Books, Princeton University Press, edition 2, number 10496.
    20. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    21. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Busch, Ramona & Koziol, Philipp & Mitrovic, Marc, 2018. "Many a little makes a mickle: Stress testing small and medium-sized German banks," The Quarterly Review of Economics and Finance, Elsevier, vol. 68(C), pages 237-253.
    3. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    4. Huber, Jakob & Stuckenschmidt, Heiner, 2020. "Daily retail demand forecasting using machine learning with emphasis on calendric special days," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1420-1438.
    5. Van Belle, Jente & Guns, Tias & Verbeke, Wouter, 2021. "Using shared sell-through data to forecast wholesaler demand in multi-echelon supply chains," European Journal of Operational Research, Elsevier, vol. 288(2), pages 466-479.
    6. Acharya, Viral V. & Berger, Allen N. & Roman, Raluca A., 2018. "Lending implications of U.S. bank stress tests: Costs or benefits?," Journal of Financial Intermediation, Elsevier, vol. 34(C), pages 58-90.
    7. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    8. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    9. Wu, Deming & Fang, Ming & Wang, Qing, 2018. "An empirical study of bank stress testing for auto loans," Journal of Financial Stability, Elsevier, vol. 39(C), pages 79-89.
    10. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    11. Javier Arroyo & Rosa Espínola & Carlos Maté, 2011. "Different Approaches to Forecast Interval Time Series: A Comparison in Finance," Computational Economics, Springer;Society for Computational Economics, vol. 37(2), pages 169-191, February.
    12. Jondeau, Eric & Khalilzadeh, Amir, 2022. "Predicting the stressed expected loss of large U.S. banks," Journal of Banking & Finance, Elsevier, vol. 134(C).
    13. Nguyen, Thach Vu Hong & Ahmed, Shamim & Chevapatrakul, Thanaset & Onali, Enrico, 2020. "Do stress tests affect bank liquidity creation?," Journal of Corporate Finance, Elsevier, vol. 64(C).
    14. Wright, Jonathan H., 2008. "Bayesian Model Averaging and exchange rate forecasts," Journal of Econometrics, Elsevier, vol. 146(2), pages 329-341, October.
    15. Paroissien, Emmanuel, 2020. "Forecasting bulk prices of Bordeaux wines using leading indicators," International Journal of Forecasting, Elsevier, vol. 36(2), pages 292-309.
    16. Barrow, Devon K., 2016. "Forecasting intraday call arrivals using the seasonal moving average method," Journal of Business Research, Elsevier, vol. 69(12), pages 6088-6096.
    17. Bontempi, Gianluca & Ben Taieb, Souhaib, 2011. "Conditionally dependent strategies for multiple-step-ahead prediction in local learning," International Journal of Forecasting, Elsevier, vol. 27(3), pages 689-699, July.
    18. Kunze, Frederik, 2017. "Predicting exchange rates in Asia: New insights on the accuracy of survey forecasts," University of Göttingen Working Papers in Economics 326, University of Goettingen, Department of Economics.
    19. Alejandro Parot & Kevin Michell & Werner D. Kristjanpoller, 2019. "Using Artificial Neural Networks to forecast Exchange Rate, including VAR‐VECM residual analysis and prediction linear combination," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 26(1), pages 3-15, January.
    20. Isabel Figuerola‐Ferretti & Alejandro Rodríguez & Eduardo Schwartz, 2021. "Oil price analysts' forecasts," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(9), pages 1351-1374, September.

    More about this item

    Keywords

    Regression; Machine Learning; Time Series Analysis; Bank Capital; Stress Test; Net Interest Margin; Forecasting; PPNR; CCAR;
    All these keywords.

    JEL classification:

    • C4 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • C6 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling
    • G01 - Financial Economics - - General - - - Financial Crises

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:94779. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.