IDEAS home Printed from https://ideas.repec.org/p/rdg/emxxdp/em-dp2022-06.html
   My bibliography  Save this paper

Financial Stability Surveillance Tools: Evaluating the Performance of Stress Indices

Author

Listed:
  • Kaelo Ntwaepelo

    (Department of Economics, University of Reading)

  • Grivas Chiyaba

    (Department of Economics, University of Reading)

Abstract

In this study, we aim to address the emerging debate about whether financial stress indices (FSIs) constructed using advanced methods such as the dynamic factor model and the principal component analysis method, perform better than those aggregated using simple averages, for the case of South Africa. To do so, we construct three FSIs using: the equal-variance weighting method (EVM), the principal component analysis method (PCA) and the dynamic factor model (FAM). We compare the performance of the indices for the period 2009-2020, using four criteria: quantile regressions, ordered probit model, local projections and the autoregressive integrated moving average (ARIMA) forecasting model. The results suggest that FSIs aggregated using the dynamic factor model and the principal component analysis method have a significant comparative advantage in predicting a financial crisis and capturing the vulnerability of the South African financial system to external monetary policy shocks. This suggests that the aggregation method and weighting system involved in constructing a financial stress index affects its performance in monitoring financial stability.

Suggested Citation

  • Kaelo Ntwaepelo & Grivas Chiyaba, 2022. "Financial Stability Surveillance Tools: Evaluating the Performance of Stress Indices," Economics Discussion Papers em-dp2022-06, Department of Economics, University of Reading.
    • Handle: RePEc:rdg:emxxdp:em-dp2022-06
    as

    Download full text from publisher

    File URL: https://www.reading.ac.uk/web/FILES/economics/emdp202206.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Islami, Mevlud & Kurz-Kim, Jeong-Ryeol, 2013. "A single composite financial stress indicator and its real impact in the euro area," Discussion Papers 31/2013, Deutsche Bundesbank.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Lucia Alessi & Mark Kerssenfischer, 2019. "The response of asset prices to monetary policy shocks: Stronger than thought," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(5), pages 661-672, August.
    4. Hyeongwoo Kim & Wen Shi, 2021. "Forecasting financial vulnerability in the USA: A factor model approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 439-457, April.
    5. Arrigoni, Simone & Bobasu, Alina & Venditti, Fabrizio, 2020. "The simpler the better: measuring financial conditions for monetary policy and financial stability," Working Paper Series 2451, European Central Bank.
    6. Chadwick, Meltem Gulenay & Ozturk, Huseyin, 2019. "Measuring financial systemic stress for Turkey: A search for the best composite indicator," Economic Systems, Elsevier, vol. 43(1), pages 151-172.
    7. Alain Kabundi & Asithandile Mbelu, 2021. "Estimating a time-varying financial conditions index for South Africa," Empirical Economics, Springer, vol. 60(4), pages 1817-1844, April.
    8. Tuomas Antero Peltonen & Michela Rancan & Peter Sarlin, 2019. "Interconnectedness of the banking sector as a vulnerability to crises," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 24(2), pages 963-990, April.
    9. Hyeongwoo Kim & Wen Shi & Hyun Hak Kim, 2020. "Forecasting financial stress indices in Korea: a factor model approach," Empirical Economics, Springer, vol. 59(6), pages 2859-2898, December.
    10. Serena Merrino, 2021. "State-dependent fiscal multipliers and financial dynamics: An impulse response analysis by local projections for South Africa," WIDER Working Paper Series wp-2021-77, World Institute for Development Economic Research (UNU-WIDER).
    11. Ari, Anil & Chen, Sophia & Ratnovski, Lev, 2021. "The dynamics of non-performing loans during banking crises: A new database with post-COVID-19 implications," Journal of Banking & Finance, Elsevier, vol. 133(C).
    12. Hubrich, Kirstin & Tetlow, Robert J., 2015. "Financial stress and economic dynamics: The transmission of crises," Journal of Monetary Economics, Elsevier, vol. 70(C), pages 100-115.
    13. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    14. Illing, Mark & Liu, Ying, 2006. "Measuring financial stress in a developed country: An application to Canada," Journal of Financial Stability, Elsevier, vol. 2(3), pages 243-265, October.
    15. Mthuli Ncube & Nombulelo Gumata & Eliphas Ndou, 2016. "Global Growth and Financial Spillovers and the South African Macro-economy," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-137-51296-3, October.
    16. Ziegler, Andreas, 2002. "Simulated Classical Tests in the Multiperiod Multinomial Probit Model," ZEW Discussion Papers 02-38, ZEW - Leibniz Centre for European Economic Research.
    17. Òscar Jordà, 2005. "Estimation and Inference of Impulse Responses by Local Projections," American Economic Review, American Economic Association, vol. 95(1), pages 161-182, March.
    18. repec:zbw:bofrdp:2015_007 is not listed on IDEAS
    19. Troy Davig & Craig S. Hakkio, 2010. "What is the effect of financial stress on economic activity," Economic Review, Federal Reserve Bank of Kansas City, vol. 95(Q II), pages 35-62.
    20. Dake Li & Mikkel Plagborg-Møller & Christian K. Wolf, 2021. "Local Projections vs. VARs: Lessons From Thousands of DGPs," Working Papers 2021-55, Princeton University. Economics Department..
    21. Scott Brave & R. Andrew Butters, 2012. "Diagnosing the Financial System: Financial Conditions and Financial Stress," International Journal of Central Banking, International Journal of Central Banking, vol. 8(2), pages 191-239, June.
    22. Balcilar, Mehmet & Gupta, Rangan & van Eyden, Reneé & Thompson, Kirsten & Majumdar, Anandamayee, 2018. "Comparing the forecasting ability of financial conditions indices: The case of South Africa," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 245-259.
    23. Begüm Yurteri Kösedağlı & A. Özlem Önder, 2021. "Determinants of financial stress in emerging market economies: Are spatial effects important?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4653-4669, July.
    24. Georgi Petrov Georgiev, 2012. "Practical aspects in measuring and monitoring the liquidity risk pursuant to the Basel III international framework," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 5, pages 144-164.
    25. Serena Merrino, 2021. "Statedependent fiscal multipliers and financial dynamics An impulse response analysis by local projections for South Africa," Working Papers 11015, South African Reserve Bank.
    26. Ján Malega & Roman Horváth, 2017. "Financial Stress in the Czech Republic: Measurement and Effects on the Real Economy," Prague Economic Papers, Prague University of Economics and Business, vol. 2017(3), pages 257-268.
    27. Luis Viceira & Carolin Pflueger & John Campbell, 2014. "Monetary Policy Drivers of Bond and Equity Risks," 2014 Meeting Papers 137, Society for Economic Dynamics.
    28. Mark Illing & Ying Liu, 2003. "An Index of Financial Stress for Canada," Staff Working Papers 03-14, Bank of Canada.
    29. Jan Hatzius & Peter Hooper & Frederic S. Mishkin & Kermit L. Schoenholtz & Mark W. Watson, 2010. "Financial Conditions Indexes: A Fresh Look after the Financial Crisis," NBER Working Papers 16150, National Bureau of Economic Research, Inc.
    30. Craig S. Hakkio & William R. Keeton, 2009. "Financial stress: what is it, how can it be measured, and why does it matter?," Economic Review, Federal Reserve Bank of Kansas City, vol. 94(Q II), pages 5-50.
    31. Jan Willem Slingenberg & Jakob de Haan, 2011. "Forecasting Financial Stress," DNB Working Papers 292, Netherlands Central Bank, Research Department.
    32. Ravi Balakrishnan & Stephan Danninger & Selim Elekdag & Irina Tytell, 2011. "The Transmission of Financial Stress from Advanced to Emerging Economies," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 47(0), pages 40-68, May.
    33. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    34. Barend de Beer & Zeph Nhleko, 2009. "Measuring the economic impact of private equity funds: the South African experience," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Proceedings of the IFC Conference on "Measuring financial innovation and its impact", Basel, 26-27 August 2008, volume 31, pages 495-510, Bank for International Settlements.
    35. Cardarelli, Roberto & Elekdag, Selim & Lall, Subir, 2011. "Financial stress and economic contractions," Journal of Financial Stability, Elsevier, vol. 7(2), pages 78-97, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kappler, Marcus & Schleer, Frauke, 2017. "A financially stressed euro area," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 11, pages 1-37.
    2. Mansour-Ichrakieh, Layal, 2020. "The impact of Israeli Geopolitical Risks on the Lebanese Financial Market: A Destabilizer Multiplier," MPRA Paper 99376, University Library of Munich, Germany.
    3. Haddou, Samira, 2022. "International financial stress spillovers to bank lending: Do internal characteristics matter?," International Review of Financial Analysis, Elsevier, vol. 83(C).
    4. Duprey, Thibaut & Klaus, Benjamin & Peltonen, Tuomas, 2017. "Dating systemic financial stress episodes in the EU countries," Journal of Financial Stability, Elsevier, vol. 32(C), pages 30-56.
    5. Layal MansourIshrakieh & Leila Dagher & Sadika El Hariri, 2020. "A financial stress index for a highly dollarized developing country : The case of Lebanon," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 20(2), pages 43-52.
    6. Chavleishvili, Sulkhan & Kremer, Manfred, 2023. "Measuring systemic financial stress and its risks for growth," Working Paper Series 2842, European Central Bank.
    7. Mansour-Ichrakieh, Layal & Zeaiter, Hussein, 2019. "The role of geopolitical risks on the Turkish economy opportunity or threat," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    8. Mansour Ishrakieh, Layal & Dagher, Leila & El Hariri, Sadika, 2018. "The Institute of Financial Economics Financial Stress Index (IFEFSI) for Lebanon," MPRA Paper 116054, University Library of Munich, Germany.
    9. Kehinde Damilola Ilesanmi & Devi Datt Tewari, 2020. "Financial Stress Index and Economic Activity in South Africa: New Evidence," Economies, MDPI, vol. 8(4), pages 1-19, December.
    10. Apostolakis, George N. & Floros, Christos & Gkillas, Konstantinos & Wohar, Mark, 2021. "Financial stress, economic policy uncertainty, and oil price uncertainty," Energy Economics, Elsevier, vol. 104(C).
    11. Huotari, Jarkko, 2015. "Measuring financial stress – A country specific stress index for Finland," Bank of Finland Research Discussion Papers 7/2015, Bank of Finland.
    12. Robert Vermeulen & Marco Hoeberichts & Bořek Vašíček & Diana Žigraiová & Kateřina Šmídková & Jakob Haan, 2015. "Financial Stress Indices and Financial Crises," Open Economies Review, Springer, vol. 26(3), pages 383-406, July.
    13. Evgenidis, Anastasios & Tsagkanos, Athanasios, 2017. "Asymmetric effects of the international transmission of US financial stress. A threshold-VAR approach," International Review of Financial Analysis, Elsevier, vol. 51(C), pages 69-81.
    14. Hyeongwoo Kim & Wen Shi, 2021. "Forecasting financial vulnerability in the USA: A factor model approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 439-457, April.
    15. Long, Shaobo & Li, Zixuan, 2023. "Dynamic spillover effects of global financial stress: Evidence from the quantile VAR network," International Review of Financial Analysis, Elsevier, vol. 90(C).
    16. repec:zbw:bofrdp:2015_007 is not listed on IDEAS
    17. Tan, Sook-Rei & Li, Changtai & Yeap, Xiu Wei, 2022. "A time-varying copula approach for constructing a daily financial systemic stress index," The North American Journal of Economics and Finance, Elsevier, vol. 63(C).
    18. Mittnik, Stefan & Semmler, Willi, 2013. "The real consequences of financial stress," Journal of Economic Dynamics and Control, Elsevier, vol. 37(8), pages 1479-1499.
    19. Andrea Cipollini & Ieva Mikaliunaite, 2021. "Financial distress and real economic activity in Lithuania: a Granger causality test based on mixed-frequency VAR," Empirical Economics, Springer, vol. 61(2), pages 855-881, August.
    20. Chen, Louisa & Verousis, Thanos & Wang, Kai & Zhou, Zhiping, 2023. "Financial stress and commodity price volatility," Energy Economics, Elsevier, vol. 125(C).
    21. Park, Cyn-Young & Mercado, Rogelio V., 2014. "Determinants of financial stress in emerging market economies," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 199-224.

    More about this item

    Keywords

    financial stress index; forecasts; local projections; ordered probit model; quantile regression;
    All these keywords.

    JEL classification:

    • B26 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Financial Economics
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E44 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Financial Markets and the Macroeconomy
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rdg:emxxdp:em-dp2022-06. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexander Mihailov (email available below). General contact details of provider: https://edirc.repec.org/data/derdguk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.