IDEAS home Printed from https://ideas.repec.org/a/eee/finsta/v27y2016icp234-249.html
   My bibliography  Save this article

Evaluating measures of adverse financial conditions

Author

Listed:
  • Oet, Mikhail V.
  • Gramlich, Dieter
  • Sarlin, Peter

Abstract

Timely identification and anticipation of adverse conditions in the financial system are critical for macroprudential policy. However, there is no consensus on how to evaluate the quality of systemic measures. This paper provides a framework to compare measures of systemic conditions. We illustrate the proposed tests with a case study of US measures from 1976 to 2013. We find that measures which include information from multiple markets improve identification of critical system states. However, tested measures show limited capacity to anticipate critical episodes.

Suggested Citation

  • Oet, Mikhail V. & Gramlich, Dieter & Sarlin, Peter, 2016. "Evaluating measures of adverse financial conditions," Journal of Financial Stability, Elsevier, vol. 27(C), pages 234-249.
    • Handle: RePEc:eee:finsta:v:27:y:2016:i:c:p:234-249
    DOI: 10.1016/j.jfs.2016.06.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S157230891630050X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jfs.2016.06.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zarnowitz, Victor, 1985. "Recent Work on Business Cycles in Historical Perspective: A Review of Theories and Evidence," Journal of Economic Literature, American Economic Association, vol. 23(2), pages 523-580, June.
    2. C. H. Hommes, 2001. "Financial markets as nonlinear adaptive evolutionary systems," Quantitative Finance, Taylor & Francis Journals, vol. 1(1), pages 149-167.
    3. Andreou, Irène & Dufrénot, Gilles, 2009. "A Forewarning Indicator System for Financial Crises: the Case of Six Central and Eastern European Countries," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 24, pages 87-115.
    4. Luc Laeven & Fabian Valencia, 2020. "Systemic Banking Crises Database II," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 68(2), pages 307-361, June.
    5. Drehmann, Mathias & Juselius, Mikael, 2014. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," International Journal of Forecasting, Elsevier, vol. 30(3), pages 759-780.
    6. Dieter Gerdesmeier & Hans‐Eggert Reimers & Barbara Roffia, 2010. "Asset Price Misalignments and the Role of Money and Credit," International Finance, Wiley Blackwell, vol. 13(3), pages 377-407, December.
    7. Sarlin, Peter, 2013. "On policymakers’ loss functions and the evaluation of early warning systems," Economics Letters, Elsevier, vol. 119(1), pages 1-7.
    8. Babecký, Jan & Havránek, Tomáš & Matějů, Jakub & Rusnák, Marek & Šmídková, Kateřina & Vašíček, Bořek, 2013. "Leading indicators of crisis incidence: Evidence from developed countries," Journal of International Money and Finance, Elsevier, vol. 35(C), pages 1-19.
    9. Mantegna,Rosario N. & Stanley,H. Eugene, 2007. "Introduction to Econophysics," Cambridge Books, Cambridge University Press, number 9780521039871.
    10. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    11. William A. Brock & Steven N. Durlauf & Kenneth D. West, 2003. "Policy Evaluation in Uncertain Economic Environments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(1), pages 235-322.
    12. Kremer, Manfred & Lo Duca, Marco & Holló, Dániel, 2012. "CISS - a composite indicator of systemic stress in the financial system," Working Paper Series 1426, European Central Bank.
    13. Anton Korinek, 2011. "Systemic Risk-Taking: Amplification Effects, Externalities, and Regulatory Responses," NFI Working Papers 2011-WP-13, Indiana State University, Scott College of Business, Networks Financial Institute.
    14. Elsner, Wolfram & Heinrich, Torsten & Schwardt, Henning, 2014. "The Microeconomics of Complex Economies," Elsevier Monographs, Elsevier, edition 1, number 9780124115859.
    15. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    16. Alessi, Lucia & Detken, Carsten, 2014. "On policymakers’ loss functions and the evaluation of early warning systems: Comment," Economics Letters, Elsevier, vol. 124(3), pages 338-340.
    17. Illing, Mark & Liu, Ying, 2006. "Measuring financial stress in a developed country: An application to Canada," Journal of Financial Stability, Elsevier, vol. 2(3), pages 243-265, October.
    18. repec:ecb:ecbwps:20111426 is not listed on IDEAS
    19. William A. Brock & Cars H. Hommes, 1997. "A Rational Route to Randomness," Econometrica, Econometric Society, vol. 65(5), pages 1059-1096, September.
    20. Hali J. Edison, 2003. "Do indicators of financial crises work? An evaluation of an early warning system," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 11-53.
    21. Schwert, G William, 1989. " Why Does Stock Market Volatility Change over Time?," Journal of Finance, American Finance Association, vol. 44(5), pages 1115-1153, December.
    22. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    23. Kevin L. Kliesen & Michael T. Owyang & E. Katarina Vermann, 2012. "Disentangling diverse measures: a survey of financial stress indexes," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 369-398.
    24. Mark Carlson & Kurt Lewis & William Nelson, 2014. "Using Policy Intervention To Identify Financial Stress," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 59-72, January.
    25. Davis, E. Philip & Karim, Dilruba, 2008. "Comparing early warning systems for banking crises," Journal of Financial Stability, Elsevier, vol. 4(2), pages 89-120, June.
    26. Mikhail V. Oet & John M. Dooley & Amanda C. Janosko & Dieter Gramlich & Stephen J. Ong, 2015. "Supervising System Stress in Multiple Markets," Risks, MDPI, vol. 3(3), pages 1-25, September.
    27. Michael D. Bordo & Michael J. Dueker & David C. Wheelock, 2002. "Aggregate Price Shocks and Financial Instability: A Historical Analysis," Economic Inquiry, Western Economic Association International, vol. 40(4), pages 521-538, October.
    28. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    29. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    30. W. Allen Wallis & Geoffrey H. Moore, 1941. "A Significance Test for Time Series and Other Ordered Observations," NBER Chapters, in: A Significance Test for Time Series and Other Ordered Observations, pages 1-67, National Bureau of Economic Research, Inc.
    31. Bussiere, Matthieu & Fratzscher, Marcel, 2008. "Low probability, high impact: Policy making and extreme events," Journal of Policy Modeling, Elsevier, vol. 30(1), pages 111-121.
    32. Elke Hanschel & Pierre Monnin, 2005. "Measuring and forecasting stress in the banking sector: evidence from Switzerland," BIS Papers chapters, in: Bank for International Settlements (ed.), Investigating the relationship between the financial and real economy, volume 22, pages 431-49, Bank for International Settlements.
    33. Demirguc, Asli & Detragiache, Enrica, 2000. "Monitoring Banking Sector Fragility: A Multivariate Logit Approach," The World Bank Economic Review, World Bank, vol. 14(2), pages 287-307, May.
    34. Marco Gallegati, 2014. "Early Warning Signals of Financial Stress: A “Wavelet-Based” Composite Indicators Approach," Dynamic Modeling and Econometrics in Economics and Finance, in: Frauke Schleer-van Gellecom (ed.), Advances in Non-linear Economic Modeling, edition 127, pages 115-138, Springer.
    35. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    36. Jan Hatzius & Peter Hooper & Frederic S. Mishkin & Kermit L. Schoenholtz & Mark W. Watson, 2010. "Financial Conditions Indexes: A Fresh Look after the Financial Crisis," NBER Working Papers 16150, National Bureau of Economic Research, Inc.
    37. Craig S. Hakkio & William R. Keeton, 2009. "Financial stress: what is it, how can it be measured, and why does it matter?," Economic Review, Federal Reserve Bank of Kansas City, vol. 94(Q II), pages 5-50.
    38. Simon, Herbert A, 1979. "Rational Decision Making in Business Organizations," American Economic Review, American Economic Association, vol. 69(4), pages 493-513, September.
    39. Herbert A. Simon, 1991. "Organizations and Markets," Journal of Economic Perspectives, American Economic Association, vol. 5(2), pages 25-44, Spring.
    40. Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
    41. Samuel Ronnqvist & Peter Sarlin, 2015. "Detect & Describe: Deep learning of bank stress in the news," Papers 1507.07870, arXiv.org.
    42. Michael D. Bordo & Owen F. Humpage & Anna J. Schwartz, 2015. "Strained Relations: US Foreign-Exchange Operations and Monetary Policy in the Twentieth Century," NBER Books, National Bureau of Economic Research, Inc, number bord12-1, March.
    43. J. Doyne Farmer & Andrew W. Lo, 1999. "Frontiers of Finance: Evolution and Efficient Markets," Working Papers 99-06-039, Santa Fe Institute.
    44. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    45. repec:zbw:bofrdp:2015_006 is not listed on IDEAS
    46. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    47. Amira Dridi & Mohamed El Ghourabi & Mohamed Limam, 2012. "On monitoring financial stress index with extreme value theory," Quantitative Finance, Taylor & Francis Journals, vol. 12(3), pages 329-339, March.
    48. Charles T. Carlstrom & Timothy S. Fuerst, 2014. "Adding Double Inertia to Taylor Rules to Improve Accuracy," Economic Commentary, Federal Reserve Bank of Cleveland, issue May.
    49. Claudio Borio, 2003. "Towards a Macroprudential Framework for Financial Supervision and Regulation?," CESifo Economic Studies, CESifo Group, vol. 49(2), pages 181-215.
    50. Scott Brave & R. Andrew Butters, 2012. "Diagnosing the Financial System: Financial Conditions and Financial Stress," International Journal of Central Banking, International Journal of Central Banking, vol. 8(2), pages 191-239, June.
    51. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    52. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    53. Berg, Andrew & Pattillo, Catherine, 1999. "Predicting currency crises:: The indicators approach and an alternative," Journal of International Money and Finance, Elsevier, vol. 18(4), pages 561-586, August.
    54. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    55. Claudio Borio & Philip Lowe, 2002. "Assessing the risk of banking crises," BIS Quarterly Review, Bank for International Settlements, December.
    56. W. Allen Wallis & Geoffrey H. Moore, 1941. "A Significance Test for Time Series and Other Ordered Observations," NBER Books, National Bureau of Economic Research, Inc, number wall41-1, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:zbw:bofrdp:2017_019 is not listed on IDEAS
    2. Hasan, Iftekhar & Meslier, Céline & Tarazi, Amine & Zhou, Mingming, 2018. "Does it pay to get connected? An examination of bank alliance network and bond spread," Journal of Economics and Business, Elsevier, vol. 95(C), pages 141-163.
    3. Huang, Xiaoyong & Yu, Cong & Chen, Yunping & Jia, Fei & Xu, Xiangyun, 2022. "Rigid payment breaking, default spread and yields of Chinese treasury bonds," The North American Journal of Economics and Finance, Elsevier, vol. 59(C).
    4. Mazboudi, Mohamad & Hasan, Iftekhar, 2018. "Secrecy, information shocks, and corporate investment: Evidence from European Union countries," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 54(C), pages 166-176.
    5. Mazboudi, Mohamad & Hasan, Iftekhar, 2017. "Secrecy, information shocks, and corporate investment: Evidence from European Union countries," Bank of Finland Research Discussion Papers 19/2017, Bank of Finland.
    6. Huang, Xiaoyong & Jia, Fei & Xu, Xiangyun & Yu shi,, 2019. "The threshold effect of market sentiment and inflation expectations on gold price," Resources Policy, Elsevier, vol. 62(C), pages 77-83.
    7. Fan He & Xuansen He, 2019. "A Continuous Differentiable Wavelet Shrinkage Function for Economic Data Denoising," Computational Economics, Springer;Society for Computational Economics, vol. 54(2), pages 729-761, August.
    8. Hasan, Iftekhar & Khurshed, Arif & Mohamed, Abdulkadir & Wang, Fan, 2018. "Do venture capital firms benefit from a presence on boards of directors of mature public companies?," Journal of Corporate Finance, Elsevier, vol. 49(C), pages 125-140.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John Dooley & Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong & Peter Sarlin, 2015. "Evaluating the Information Value for Measures of Systemic Conditions," Working Papers (Old Series) 1513, Federal Reserve Bank of Cleveland.
    2. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    3. Timothy Bianco & Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong, 2012. "Financial stress index: a lens for supervising the financial system," Working Papers (Old Series) 12-37, Federal Reserve Bank of Cleveland.
    4. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    5. Mikhail V. Oet & John M. Dooley & Amanda C. Janosko & Dieter Gramlich & Stephen J. Ong, 2015. "Supervising System Stress in Multiple Markets," Risks, MDPI, vol. 3(3), pages 1-25, September.
    6. Sun, Lixin & Huang, Yuqin, 2016. "Measuring the instability of China's financial system: Indices construction and an early warning system," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 10, pages 1-41.
    7. Truong, Chi & Sheen, Jeffrey & Trück, Stefan & Villafuerte, James, 2022. "Early warning systems using dynamic factor models: An application to Asian economies," Journal of Financial Stability, Elsevier, vol. 58(C).
    8. Mansour-Ichrakieh, Layal & Zeaiter, Hussein, 2019. "The role of geopolitical risks on the Turkish economy opportunity or threat," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    9. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    10. Lo Duca, Marco & Koban, Anne & Basten, Marisa & Bengtsson, Elias & Klaus, Benjamin & Kusmierczyk, Piotr & Lang, Jan Hannes & Detken, Carsten & Peltonen, Tuomas, 2017. "A new database for financial crises in European countries," ESRB Occasional Paper Series 13, European Systemic Risk Board.
    11. Layal MansourIshrakieh & Leila Dagher & Sadika El Hariri, 2020. "A financial stress index for a highly dollarized developing country : The case of Lebanon," Central Bank Review, Research and Monetary Policy Department, Central Bank of the Republic of Turkey, vol. 20(2), pages 43-52.
    12. Mansour Ishrakieh, Layal & Dagher, Leila & El Hariri, Sadika, 2018. "The Institute of Financial Economics Financial Stress Index (IFEFSI) for Lebanon," MPRA Paper 116054, University Library of Munich, Germany.
    13. repec:zbw:bofitp:2011_002 is not listed on IDEAS
    14. Lo Luca, Marco & Peltonen, Tuomas, 2011. "Macro-financial vulnerabilities and future financial stress : Assessing systemic risks and predicting systemic events," BOFIT Discussion Papers 2/2011, Bank of Finland, Institute for Economies in Transition.
    15. Hyeongwoo Kim & Wen Shi & Hyun Hak Kim, 2020. "Forecasting financial stress indices in Korea: a factor model approach," Empirical Economics, Springer, vol. 59(6), pages 2859-2898, December.
    16. Mikkel Hermansen & Oliver Röhn, 2017. "Economic resilience: The usefulness of early warning indicators in OECD countries," OECD Journal: Economic Studies, OECD Publishing, vol. 2016(1), pages 9-35.
    17. Sarlin, Peter & von Schweinitz, Gregor, 2021. "Optimizing Policymakers’ Loss Functions In Crisis Prediction: Before, Within Or After?," Macroeconomic Dynamics, Cambridge University Press, vol. 25(1), pages 100-123, January.
    18. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    19. Zigraiova, Diana & Jakubik, Petr, 2015. "Systemic event prediction by an aggregate early warning system: An application to the Czech Republic," Economic Systems, Elsevier, vol. 39(4), pages 553-576.
    20. Hyeongwoo Kim & Wen Shi, 2021. "Forecasting financial vulnerability in the USA: A factor model approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 439-457, April.
    21. Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong, 2013. "Policy in adaptive financial markets—the use of systemic risk early warning tools," Working Papers (Old Series) 1309, Federal Reserve Bank of Cleveland.

    More about this item

    Keywords

    Measures of systemic conditions; Evaluation of information quality; Signal extraction approach; Pervasiveness; Persistence; Severity; Noise-to-signal ratio; Relative usefulness; Information value;
    All these keywords.

    JEL classification:

    • G01 - Financial Economics - - General - - - Financial Crises
    • G18 - Financial Economics - - General Financial Markets - - - Government Policy and Regulation
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finsta:v:27:y:2016:i:c:p:234-249. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jfstabil .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.