IDEAS home Printed from https://ideas.repec.org/a/eee/finsta/v27y2016icp234-249.html

Evaluating measures of adverse financial conditions

Author

Listed:
  • Oet, Mikhail V.
  • Gramlich, Dieter
  • Sarlin, Peter

Abstract

Timely identification and anticipation of adverse conditions in the financial system are critical for macroprudential policy. However, there is no consensus on how to evaluate the quality of systemic measures. This paper provides a framework to compare measures of systemic conditions. We illustrate the proposed tests with a case study of US measures from 1976 to 2013. We find that measures which include information from multiple markets improve identification of critical system states. However, tested measures show limited capacity to anticipate critical episodes.

Suggested Citation

  • Oet, Mikhail V. & Gramlich, Dieter & Sarlin, Peter, 2016. "Evaluating measures of adverse financial conditions," Journal of Financial Stability, Elsevier, vol. 27(C), pages 234-249.
    • Handle: RePEc:eee:finsta:v:27:y:2016:i:c:p:234-249
    DOI: 10.1016/j.jfs.2016.06.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S157230891630050X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jfs.2016.06.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
    2. Samuel Ronnqvist & Peter Sarlin, 2015. "Detect & Describe: Deep learning of bank stress in the news," Papers 1507.07870, arXiv.org.
    3. Zarnowitz, Victor, 1985. "Recent Work on Business Cycles in Historical Perspective: A Review of Theories and Evidence," Journal of Economic Literature, American Economic Association, vol. 23(2), pages 523-580, June.
    4. Claudio Borio, 2003. "Towards a Macroprudential Framework for Financial Supervision and Regulation?," CESifo Economic Studies, CESifo Group, vol. 49(2), pages 181-215.
    5. Michael D. Bordo & Owen F. Humpage & Anna J. Schwartz, 2015. "Strained Relations: US Foreign-Exchange Operations and Monetary Policy in the Twentieth Century," NBER Books, National Bureau of Economic Research, Inc, number bord12-1, January.
    6. J. Doyne Farmer & Andrew W. Lo, 1999. "Frontiers of Finance: Evolution and Efficient Markets," Working Papers 99-06-039, Santa Fe Institute.
    7. Scott Brave & R. Andrew Butters, 2012. "Diagnosing the Financial System: Financial Conditions and Financial Stress," International Journal of Central Banking, International Journal of Central Banking, vol. 8(2), pages 191-239, June.
    8. C. H. Hommes, 2001. "Financial markets as nonlinear adaptive evolutionary systems," Quantitative Finance, Taylor & Francis Journals, vol. 1(1), pages 149-167.
    9. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    10. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    11. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    12. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    13. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    14. Sarlin, Peter, 2013. "On policymakers’ loss functions and the evaluation of early warning systems," Economics Letters, Elsevier, vol. 119(1), pages 1-7.
    15. W. Allen Wallis & Geoffrey H. Moore, 1941. "A Significance Test for Time Series and Other Ordered Observations," NBER Chapters, in: A Significance Test for Time Series and Other Ordered Observations, pages 1-67, National Bureau of Economic Research, Inc.
    16. Drehmann, Mathias & Juselius, Mikael, 2014. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," International Journal of Forecasting, Elsevier, vol. 30(3), pages 759-780.
    17. Babecký, Jan & Havránek, Tomáš & Matějů, Jakub & Rusnák, Marek & Šmídková, Kateřina & Vašíček, Bořek, 2013. "Leading indicators of crisis incidence: Evidence from developed countries," Journal of International Money and Finance, Elsevier, vol. 35(C), pages 1-19.
    18. Bussiere, Matthieu & Fratzscher, Marcel, 2008. "Low probability, high impact: Policy making and extreme events," Journal of Policy Modeling, Elsevier, vol. 30(1), pages 111-121.
    19. Berg, Andrew & Pattillo, Catherine, 1999. "Predicting currency crises:: The indicators approach and an alternative," Journal of International Money and Finance, Elsevier, vol. 18(4), pages 561-586, August.
    20. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    21. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    22. Irène Andreou & Gilles Dufrénot, 2009. "A Forewarning Indicator System for Financial Crises: the Case of Six Central and Eastern European Countries," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 24, pages 87-115.
    23. Elke Hanschel & Pierre Monnin, 2005. "Measuring and forecasting stress in the banking sector: evidence from Switzerland," BIS Papers chapters, in: Bank for International Settlements (ed.), Investigating the relationship between the financial and real economy, volume 22, pages 431-49, Bank for International Settlements.
    24. Dieter Gerdesmeier & Hans‐Eggert Reimers & Barbara Roffia, 2010. "Asset Price Misalignments and the Role of Money and Credit," International Finance, Wiley Blackwell, vol. 13(3), pages 377-407, December.
    25. William A. Brock & Steven N. Durlauf & Kenneth D. West, 2003. "Policy Evaluation in Uncertain Economic Environments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(1), pages 235-322.
    26. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    27. Marco Gallegati, 2014. "Early Warning Signals of Financial Stress: A “Wavelet-Based” Composite Indicators Approach," Dynamic Modeling and Econometrics in Economics and Finance, in: Frauke Schleer-van Gellecom (ed.), Advances in Non-linear Economic Modeling, edition 127, pages 115-138, Springer.
    28. Kremer, Manfred & Lo Duca, Marco & Holló, Dániel, 2012. "CISS - a composite indicator of systemic stress in the financial system," Working Paper Series 1426, European Central Bank.
    29. Anton Korinek, 2011. "Systemic Risk-Taking: Amplification Effects, Externalities, and Regulatory Responses," NFI Working Papers 2011-WP-13, Indiana State University, Scott College of Business, Networks Financial Institute.
    30. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    31. Elsner, Wolfram & Heinrich, Torsten & Schwardt, Henning, 2014. "The Microeconomics of Complex Economies," Elsevier Monographs, Elsevier, edition 1, number 9780124115859.
    32. Jan Hatzius & Peter Hooper & Frederic S. Mishkin & Kermit L. Schoenholtz & Mark W. Watson, 2010. "Financial Conditions Indexes: A Fresh Look after the Financial Crisis," NBER Working Papers 16150, National Bureau of Economic Research, Inc.
    33. Simon, Herbert A, 1979. "Rational Decision Making in Business Organizations," American Economic Review, American Economic Association, vol. 69(4), pages 493-513, September.
    34. Claudio Borio & Philip Lowe, 2002. "Assessing the risk of banking crises," BIS Quarterly Review, Bank for International Settlements, December.
    35. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    36. Craig S. Hakkio & William R. Keeton, 2009. "Financial stress: what is it, how can it be measured, and why does it matter?," Economic Review, Federal Reserve Bank of Kansas City, vol. 94(Q II), pages 5-50.
    37. Demirguc, Asli & Detragiache, Enrica, 2000. "Monitoring Banking Sector Fragility: A Multivariate Logit Approach," The World Bank Economic Review, World Bank, vol. 14(2), pages 287-307, May.
    38. Alessi, Lucia & Detken, Carsten, 2014. "On policymakers’ loss functions and the evaluation of early warning systems: Comment," Economics Letters, Elsevier, vol. 124(3), pages 338-340.
    39. Illing, Mark & Liu, Ying, 2006. "Measuring financial stress in a developed country: An application to Canada," Journal of Financial Stability, Elsevier, vol. 2(3), pages 243-265, October.
    40. Luc Laeven & Fabian Valencia, 2020. "Systemic Banking Crises Database II," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 68(2), pages 307-361, June.
    41. repec:ecb:ecbwps:20111426 is not listed on IDEAS
    42. Mantegna,Rosario N. & Stanley,H. Eugene, 2007. "Introduction to Econophysics," Cambridge Books, Cambridge University Press, number 9780521039871, November.
    43. Hali J. Edison, 2003. "Do indicators of financial crises work? An evaluation of an early warning system," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 11-53.
    44. repec:bla:jfinan:v:44:y:1989:i:5:p:1115-53 is not listed on IDEAS
    45. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    46. Herbert A. Simon, 1991. "Organizations and Markets," Journal of Economic Perspectives, American Economic Association, vol. 5(2), pages 25-44, Spring.
    47. Holopainen, Markus & Sarlin, Peter, 2015. "Toward robust early-warning models: A horse race, ensembles and model uncertainty," Research Discussion Papers 6/2015, Bank of Finland.
    48. Michael D. Bordo & Michael J. Dueker & David C. Wheelock, 2002. "Aggregate Price Shocks and Financial Instability: A Historical Analysis," Economic Inquiry, Western Economic Association International, vol. 40(4), pages 521-538, October.
    49. Kevin L. Kliesen & Michael T. Owyang & E. Katarina Vermann, 2012. "Disentangling diverse measures: a survey of financial stress indexes," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 369-398.
    50. Amira Dridi & Mohamed El Ghourabi & Mohamed Limam, 2012. "On monitoring financial stress index with extreme value theory," Quantitative Finance, Taylor & Francis Journals, vol. 12(3), pages 329-339, March.
    51. Mark Carlson & Kurt Lewis & William Nelson, 2014. "Using Policy Intervention To Identify Financial Stress," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 59-72, January.
    52. Davis, E. Philip & Karim, Dilruba, 2008. "Comparing early warning systems for banking crises," Journal of Financial Stability, Elsevier, vol. 4(2), pages 89-120, June.
    53. W. Allen Wallis & Geoffrey H. Moore, 1941. "A Significance Test for Time Series and Other Ordered Observations," NBER Books, National Bureau of Economic Research, Inc, number wall41-1, January.
    54. Mikhail V. Oet & John M. Dooley & Amanda C. Janosko & Dieter Gramlich & Stephen J. Ong, 2015. "Supervising System Stress in Multiple Markets," Risks, MDPI, vol. 3(3), pages 1-25, September.
    55. Charles T. Carlstrom & Timothy S. Fuerst, 2014. "Adding Double Inertia to Taylor Rules to Improve Accuracy," Economic Commentary, Federal Reserve Bank of Cleveland, issue May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mazboudi, Mohamad & Hasan, Iftekhar, 2018. "Secrecy, information shocks, and corporate investment: Evidence from European Union countries," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 54(C), pages 166-176.
    2. Zhang, Lei & Zhou, Junhu & Zang, Yuyu, 2025. "Financial risk identification and control in the openness context: A system dynamics approach to Renminbi Internationalization," International Review of Economics & Finance, Elsevier, vol. 97(C).
    3. Huang, Xiaoyong & Jia, Fei & Xu, Xiangyun & Yu shi,, 2019. "The threshold effect of market sentiment and inflation expectations on gold price," Resources Policy, Elsevier, vol. 62(C), pages 77-83.
    4. Fan He & Xuansen He, 2019. "A Continuous Differentiable Wavelet Shrinkage Function for Economic Data Denoising," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 729-761, August.
    5. Huang, Xiaoyong & Yu, Cong & Chen, Yunping & Jia, Fei & Xu, Xiangyun, 2022. "Rigid payment breaking, default spread and yields of Chinese treasury bonds," The North American Journal of Economics and Finance, Elsevier, vol. 59(C).
    6. Hasan, Iftekhar & Meslier, Céline & Tarazi, Amine & Zhou, Mingming, 2018. "Does it pay to get connected? An examination of bank alliance network and bond spread," Journal of Economics and Business, Elsevier, vol. 95(C), pages 141-163.
    7. Mazboudi, Mohamad & Hasan, Iftekhar, 2018. "Secrecy, information shocks, and corporate investment: Evidence from European Union countries," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 54(C), pages 166-176.
    8. Hasan, Iftekhar & Khurshed, Arif & Mohamed, Abdulkadir & Wang, Fan, 2018. "Do venture capital firms benefit from a presence on boards of directors of mature public companies?," Journal of Corporate Finance, Elsevier, vol. 49(C), pages 125-140.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Dooley & Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong & Peter Sarlin, 2015. "Evaluating the Information Value for Measures of Systemic Conditions," Working Papers (Old Series) 1513, Federal Reserve Bank of Cleveland.
    2. Timothy Bianco & Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong, 2012. "Financial stress index: a lens for supervising the financial system," Working Papers (Old Series) 12-37, Federal Reserve Bank of Cleveland.
    3. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    4. Mikhail V. Oet & John M. Dooley & Amanda C. Janosko & Dieter Gramlich & Stephen J. Ong, 2015. "Supervising System Stress in Multiple Markets," Risks, MDPI, vol. 3(3), pages 1-25, September.
    5. Sun, Lixin & Huang, Yuqin, 2016. "Measuring the instability of China's financial system: Indices construction and an early warning system," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 10, pages 1-41.
    6. Truong, Chi & Sheen, Jeffrey & Trück, Stefan & Villafuerte, James, 2022. "Early warning systems using dynamic factor models: An application to Asian economies," Journal of Financial Stability, Elsevier, vol. 58(C).
    7. Mansour-Ichrakieh, Layal & Zeaiter, Hussein, 2019. "The role of geopolitical risks on the Turkish economy opportunity or threat," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    8. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    9. Lo Duca, Marco & Koban, Anne & Basten, Marisa & Bengtsson, Elias & Klaus, Benjamin & Kusmierczyk, Piotr & Lang, Jan Hannes & Detken, Carsten & Peltonen, Tuomas, 2017. "A new database for financial crises in European countries," ESRB Occasional Paper Series 13, European Systemic Risk Board.
    10. Sarlin, Peter & von Schweinitz, Gregor, 2021. "Optimizing Policymakers’ Loss Functions In Crisis Prediction: Before, Within Or After?," Macroeconomic Dynamics, Cambridge University Press, vol. 25(1), pages 100-123, January.
    11. Layal MansourIshrakieh & Leila Dagher & Sadika El Hariri, 2020. "A financial stress index for a highly dollarized developing country : The case of Lebanon," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 20(2), pages 43-52.
    12. Zsuzsanna Hosszu & Gergely Lakos, 2022. "Early Warning Performance of Univariate Credit-to-GDP Gaps," MNB Occasional Papers 2022/142, Magyar Nemzeti Bank (Central Bank of Hungary).
    13. Beltran, Daniel O. & Dalal, Vihar M. & Jahan-Parvar, Mohammad R. & Paine, Fiona A., 2024. "Optimizing composite early warning indicators," The North American Journal of Economics and Finance, Elsevier, vol. 74(C).
    14. Mansour Ishrakieh, Layal & Dagher, Leila & El Hariri, Sadika, 2018. "The Institute of Financial Economics Financial Stress Index (IFEFSI) for Lebanon," MPRA Paper 116054, University Library of Munich, Germany.
    15. Lo Luca, Marco & Peltonen, Tuomas, 2011. "Macro-financial vulnerabilities and future financial stress : Assessing systemic risks and predicting systemic events," BOFIT Discussion Papers 2/2011, Bank of Finland, Institute for Economies in Transition.
    16. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    17. Zigraiova, Diana & Jakubik, Petr, 2015. "Systemic event prediction by an aggregate early warning system: An application to the Czech Republic," Economic Systems, Elsevier, vol. 39(4), pages 553-576.
    18. Hyeongwoo Kim & Wen Shi & Hyun Hak Kim, 2020. "Forecasting financial stress indices in Korea: a factor model approach," Empirical Economics, Springer, vol. 59(6), pages 2859-2898, December.
    19. Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong, 2013. "Policy in adaptive financial markets—the use of systemic risk early warning tools," Working Papers (Old Series) 1309, Federal Reserve Bank of Cleveland.
    20. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • G01 - Financial Economics - - General - - - Financial Crises
    • G18 - Financial Economics - - General Financial Markets - - - Government Policy and Regulation
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finsta:v:27:y:2016:i:c:p:234-249. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jfstabil .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.