IDEAS home Printed from https://ideas.repec.org/p/fip/fedcwp/1513.html

Evaluating the Information Value for Measures of Systemic Conditions

Author

Listed:
  • John Dooley
  • Dieter Gramlich
  • Mikhail V. Oet
  • Stephen J. Ong
  • Peter Sarlin

Abstract

Timely identification of coincident systemic conditions and forward-looking capacity to anticipate adverse developments are critical for macroprudential policy. Despite clear recognition of these factors in literature, an evaluation methodology and empirical tests for the information value of coincident measures are lacking. This paper provides a twofold contribution to the literature: (i) a general-purpose evaluation framework for assessing information value for measures of systemic conditions, and (ii) an empirical assessment of the information value for several alternative measures of US systemic conditions. We find substantial differences among the measures, of which the Cleveland Financial Stress Index shows best-in-class identification performance. In terms of forecasting performance, Kamakura?s Troubled Company Index, Cleveland Financial Stress Index, and Goldman Sachs Financial Conditions Index show moderately stable usefulness metrics over time.

Suggested Citation

  • John Dooley & Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong & Peter Sarlin, 2015. "Evaluating the Information Value for Measures of Systemic Conditions," Working Papers (Old Series) 1513, Federal Reserve Bank of Cleveland.
    • Handle: RePEc:fip:fedcwp:1513
    DOI: 10.26509/frbc-wp-201513
    as

    Download full text from publisher

    File URL: https://doi.org/10.26509/frbc-wp-201513
    File Function: Persistent link
    Download Restriction: no
    File URL: https://www.clevelandfed.org/-/media/project/clevelandfedtenant/clevelandfedsite/publications/working-papers/2015/wp-1513-evaluating-the-information-value-for-measures-of-systemic-conditions-pdf.pdf
    File Function: Full text
    Download Restriction: no
    File URL: https://libkey.io/10.26509/frbc-wp-201513?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. C. H. Hommes, 2001. "Financial markets as nonlinear adaptive evolutionary systems," Quantitative Finance, Taylor & Francis Journals, vol. 1(1), pages 149-167.
    2. Oet, Mikhail V. & Bianco, Timothy & Gramlich, Dieter & Ong, Stephen J., 2013. "SAFE: An early warning system for systemic banking risk," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4510-4533.
    3. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    4. Babecký, Jan & Havránek, Tomáš & Matějů, Jakub & Rusnák, Marek & Šmídková, Kateřina & Vašíček, Bořek, 2013. "Leading indicators of crisis incidence: Evidence from developed countries," Journal of International Money and Finance, Elsevier, vol. 35(C), pages 1-19.
    5. A. Joanne Kellermann & Jakob de Haan & Femke de Vries (ed.), 2013. "Financial Supervision in the 21st Century," Springer Books, Springer, edition 127, number 978-3-642-36733-5, December.
    6. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    7. Hali J. Edison, 2003. "Do indicators of financial crises work? An evaluation of an early warning system," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 11-53.
    8. Alex Cukierman, 2011. "Reflections on the Crisis and on its Lessons for Regulatory Reforms and for Central Bank Policies," Chapters, in: Sylvester Eijffinger & Donato Masciandaro (ed.), Handbook of Central Banking, Financial Regulation and Supervision, chapter 3, Edward Elgar Publishing.
    9. Fuertes, Ana-Maria & Kalotychou, Elena, 2007. "Optimal design of early warning systems for sovereign debt crises," International Journal of Forecasting, Elsevier, vol. 23(1), pages 85-100.
    10. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    11. Holopainen, Markus & Sarlin, Peter, 2015. "Toward robust early-warning models: A horse race, ensembles and model uncertainty," Research Discussion Papers 6/2015, Bank of Finland.
    12. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    13. Kevin L. Kliesen & Michael T. Owyang & E. Katarina Vermann, 2012. "Disentangling diverse measures: a survey of financial stress indexes," Review, Federal Reserve Bank of St. Louis, issue Sep, pages 369-398.
    14. Davis, E. Philip & Karim, Dilruba, 2008. "Comparing early warning systems for banking crises," Journal of Financial Stability, Elsevier, vol. 4(2), pages 89-120, June.
    15. Brock, William A. & Hommes, Cars H., 1998. "Heterogeneous beliefs and routes to chaos in a simple asset pricing model," Journal of Economic Dynamics and Control, Elsevier, vol. 22(8-9), pages 1235-1274, August.
    16. Claudio Borio, 2003. "Towards a Macroprudential Framework for Financial Supervision and Regulation?," CESifo Economic Studies, CESifo Group, vol. 49(2), pages 181-215.
    17. Jan Frait & Zlatuse Komarkova, 2011. "Financial Stability, Systemic Risk and Macroprudential Policy," Occasional Publications - Chapters in Edited Volumes, in: CNB Financial Stability Report 2010/2011, chapter 0, pages 96-111, Czech National Bank, Research and Statistics Department.
    18. Markus Holopainen & Peter Sarlin, 2015. "Toward robust early-warning models: A horse race, ensembles and model uncertainty," Papers 1501.04682, arXiv.org, revised Apr 2016.
    19. William A. Brock & Cars H. Hommes, 2001. "A Rational Route to Randomness," Chapters, in: W. D. Dechert (ed.), Growth Theory, Nonlinear Dynamics and Economic Modelling, chapter 16, pages 402-438, Edward Elgar Publishing.
    20. Luc Laeven & Fabian Valencia, 2020. "Systemic Banking Crises Database II," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 68(2), pages 307-361, June.
    21. Sharada Alampalli, 2013. "Information infrastructure for systemic regulation," Journal of Financial Regulation and Compliance, Emerald Group Publishing Limited, vol. 21(3), pages 204-216, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    2. Mikhail V. Oet & John M. Dooley & Amanda C. Janosko & Dieter Gramlich & Stephen J. Ong, 2015. "Supervising System Stress in Multiple Markets," Risks, MDPI, vol. 3(3), pages 1-25, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oet, Mikhail V. & Gramlich, Dieter & Sarlin, Peter, 2016. "Evaluating measures of adverse financial conditions," Journal of Financial Stability, Elsevier, vol. 27(C), pages 234-249.
    2. Dieter Gramlich & Mikhail V. Oet & Stephen J. Ong, 2013. "Policy in adaptive financial markets—the use of systemic risk early warning tools," Working Papers (Old Series) 1309, Federal Reserve Bank of Cleveland.
    3. Tuomas Antero Peltonen & Michela Rancan & Peter Sarlin, 2019. "Interconnectedness of the banking sector as a vulnerability to crises," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 24(2), pages 963-990, April.
    4. Sarlin, Peter & von Schweinitz, Gregor, 2021. "Optimizing Policymakers’ Loss Functions In Crisis Prediction: Before, Within Or After?," Macroeconomic Dynamics, Cambridge University Press, vol. 25(1), pages 100-123, January.
    5. Mikhail V. Oet & John M. Dooley & Stephen J. Ong, 2015. "The Financial Stress Index: Identification of Systemic Risk Conditions," Risks, MDPI, vol. 3(3), pages 1-25, September.
    6. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    7. Truong, Chi & Sheen, Jeffrey & Trück, Stefan & Villafuerte, James, 2022. "Early warning systems using dynamic factor models: An application to Asian economies," Journal of Financial Stability, Elsevier, vol. 58(C).
    8. Alonso-Alvarez, Irma & Molina, Luis, 2023. "How to foresee crises? A new synthetic index of vulnerabilities for emerging economies," Economic Modelling, Elsevier, vol. 125(C).
    9. Fendel Ralf & Stremmel Hanno, 2016. "Characteristics of Banking Crises: A Comparative Study with Geographical Contagion," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(3), pages 349-388, May.
    10. Vašíček, Bořek & Žigraiová, Diana & Hoeberichts, Marco & Vermeulen, Robert & Šmídková, Kateřina & de Haan, Jakob, 2017. "Leading indicators of financial stress: New evidence," Journal of Financial Stability, Elsevier, vol. 28(C), pages 240-257.
    11. Antunes, António & Bonfim, Diana & Monteiro, Nuno & Rodrigues, Paulo M.M., 2018. "Forecasting banking crises with dynamic panel probit models," International Journal of Forecasting, Elsevier, vol. 34(2), pages 249-275.
    12. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    13. von Schweinitz, Gregor & Sarlin, Peter, 2015. "Signaling Crises: How to Get Good Out-of-Sample Performance Out of the Early Warning System," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112964, Verein für Socialpolitik / German Economic Association.
    14. Billio, Monica & Casarin, Roberto & Costola, Michele & Pasqualini, Andrea, 2016. "An entropy-based early warning indicator for systemic risk," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 45(C), pages 42-59.
    15. Boysen-Hogrefe, Jens & Gern, Klaus-Jürgen & Groll, Dominik & Jannsen, Nils & Kooths, Stefan & Plödt, Martin & van Roye, Björn & Scheide, Joachim & Schwarzmüller, Tim, 2015. "Das europäische Verfahren zur Vermeidung und Korrektur makroökonomischer Ungleichgewichte: Auswertung der bisherigen Erfahrung und mögliche Reformansätze," Kieler Beiträge zur Wirtschaftspolitik 7, Kiel Institute for the World Economy (IfW Kiel).
    16. Schudel, Willem, 2015. "Shifting horizons: assessing macro trends before, during, and following systemic banking crises," Working Paper Series 1766, European Central Bank.
    17. Lanbiao Liu & Chen Chen & Bo Wang, 2022. "Predicting financial crises with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 871-910, August.
    18. Irma Alonso & Luis Molina, 2019. "The SHERLOC: an EWS-based index of vulnerability for emerging economies," Working Papers 1946, Banco de España.
    19. Kamila Tomczak, 2023. "Transmission of the 2007–2008 financial crisis in advanced countries of the European Union," Bulletin of Economic Research, Wiley Blackwell, vol. 75(1), pages 40-64, January.
    20. Ruoxi Zhang & Xue Li & Satish Chand, 2018. "An Early Warning Of An Impending Currency Crisis In China," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 64(05), pages 1101-1125, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G01 - Financial Economics - - General - - - Financial Crises
    • G18 - Financial Economics - - General Financial Markets - - - Government Policy and Regulation
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedcwp:1513. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: 4D Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbclus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.